llm-benchmark | An open-source CLI tool to get throughputs of different models on different machines via Ollama

Several devices(computers) had been running llm-benchmark, you can see the results (tokens/sec) on Windows, macOS, and Linux. I encourage people running ollama should also run this benchmark tool to guide future people to buy next powerful machines. It’s even helpful for ollama developers to check if new changes make ollama run faster or slower.