Ollama Herd

Capacity Growth

Throughput Trend

Model Throughput (latest run)

Model Latency (latest run)

Model Performance Over Time

Node Utilization (latest run)

Date Duration Nodes Models Requests Tok/s Latency p50 TTFT p50
Ollama Herd v0.1.0 — Created by Twins at Geeks in the Woods
Connected