PC Watchby 稲津 定晃
Original published:

最大2倍高速な推論エンジン「Magnitude」公開、ハードごとに自動最適化

Magnitude AI released "Magnitude," an open-source LLM inference engine developed for AI agents.

Key points

  • •It is an open-source LLM inference engine developed for AI agents.
  • •It is licensed under Apache-2.0, allowing free use with no token costs.
  • •It features automatic optimization for each hardware configuration.
See more