最大2倍高速な推論エンジン「Magnitude」公開、ハードごとに自動最適化
AI summary
Editorial policyMagnitude AI released "Magnitude," an open-source LLM inference engine developed for AI agents.
Key points
- •It is an open-source LLM inference engine developed for AI agents.
- •It is licensed under Apache-2.0, allowing free use with no token costs.
- •It features automatic optimization for each hardware configuration.