How Ollama Handles Parallel Requests
Configuring ollama for parallel requests executions.
When the Ollama server receives two requests at the same time, its behavior depends on its configuration and available system resources.
Hardware
Installing Epson EcoTank ET-8500 Linux Driver
It's much simpler comparing to old printer drivers
Installing ET-8500 on Windows is well documented in instruction. The ET-8500 Linux Driver installation is simple but not trivial.
Large Language Models Speed Test
Let's test the LLMs' speed on GPU vs CPU
Comparing prediction speed of several versions of LLMs: llama3 (Meta/Facebook), phi3 (Microsoft), gemma (Google), mistral(open source) on CPU and GPU.