Commercial features
- Intelligent routing
- Context window compression
- Cluster mode
- OpenTelemetry (OTel) support
- OAuth authentication
- Single sign-on (SSO)
- Dashboard customization
- LDAP integration
Roadmap to 0.2.0
- Broader provider support beyond the current catalog
- Workflows rework with better UI/UX and a more flexible design
- Guardrails hardening: better UI, simpler architecture, easier custom guardrails, and response-side guardrails applied before output reaches the client
- Provider-native passthrough for all providers, beyond the current beta coverage
- Full support for the OpenAI
/conversationslifecycle - Full support for the OpenAI
/responseslifecycle - Anthropic-compatible
/messagesingress and/messages/count_tokens - Budget management with limits per
user_pathand/or API key - Editable model pricing for accurate cost tracking and budgeting
- Prompt cache visibility showing how much of each prompt was cached by the provider
- UI visibility for prompt caching and local cache usage
- Fixed failover charts in the dashboard
Any suggestions?
The roadmap is shaped by what users actually need — tell us what’s missing:- Chat with us on Discord
- Report an issue or request a feature on GitHub
- Schedule a short call with the team