Hacker NewsHN submitter: Andydy25
Original published:

Launch HN: Respan (YC W24) – Open-source Rust AI gateway built around plugins

Respan announced an open-source Rust AI gateway centered on plugins, adopting a design where providers, protocols, and features can be assembled as modules.

Key points

  • •Decouples providers, protocols like MCP and voice, modalities like images and videos, and features like fallbacks and PII redaction into plugins.
  • •Provides a small core and public interfaces instead of packaging numerous providers and features into a single gateway.
  • •Aims to allow teams to freely assemble the AI infrastructure needed for their applications.
#Generative AI Tools & Use#Semiconductors & Infrastructure
See more