DeepSeek just open-sourced its inference engine
DeepSeek has open-sourced DeepInfer, a high-performance and large-scale inference framework designed specifically for its models.
Key points
- •DeepSeek has open-sourced the inference engine DeepInfer.
- •The framework is a high-performance and large-scale inference infrastructure designed for DeepSeek models.
- •It is available through the deepseek-ai/DeepInfer repository on GitHub.