Magnitude, a self-optimizing inference engine for agents, was announced, claiming up to 2x faster performance than llama.cpp on hardware.
- •It is an inference engine that runs on any hardware, including Mac, Linux, and Windows.
- •It achieves up to 2x speed improvement compared to the existing inference engine llama.cpp.
- •The developer previously created an open-source browser agent that gained over 4,000 GitHub stars and 100,000 downloads.