Hacker NewsHN submitter: albinstman
Original published:

Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware

Llmspeed, a tool to experience the speed of local LLMs before buying hardware, has been released.

Key points

  • •Selecting hardware like GPUs or Macs and a model simulates speed based on verified benchmarks.
  • •It allows checking tokens per second and time-to-first-token.
  • •It helps predict local LLM environment performance to assist in appropriate hardware selection.
See more