Estimates for a short prompt on a single device. Measured numbers come from community benchmarks (r/LocalLLaMA, localscore.ai and more); others are derived from similar setups or projected from specs. Open source on GitHub.
Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
Pick hardware and a model, and feel the real speed of a local LLM before you buy. Simulates tokens/sec and time-to-first-token from verified benchmarks for GPUs, Macs, and more.
HN Hacker News 
Read the full story on Hacker News That's the opening of the story. The full piece is published by Hacker News.
Continue reading ↗ Story details
- Published
- By
- albinstman
- Format
- Article
- Original
- llmspeed.dev ↗
