Ollama Herd

Avg Latency by Model

Token Distribution

Model Requests Avg Latency Tokens/sec Prompt Tokens Completion Tokens Last Seen
Ollama Herd v0.1.0 — Created by Twins at Geeks in the Woods
Connected