Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
Llmspeed, a tool to experience the speed of local LLMs before buying hardware, has been released.
Key points
- •Selecting hardware like GPUs or Macs and a model simulates speed based on verified benchmarks.
- •It allows checking tokens per second and time-to-first-token.
- •It helps predict local LLM environment performance to assist in appropriate hardware selection.