Roadmap
XeroML is fully open source and developed in the open. The roadmap reflects community input from GitHub Discussions, user interviews, and internal priorities.
How We Prioritize
Roadmap items are selected based on:
- Impact — how many users the feature unblocks or improves workflows for
- Demand — upvotes and discussion volume on GitHub
- Strategic fit — alignment with XeroML’s mission to be the best open-source LLM engineering platform
Contributing to the Roadmap
You can influence what gets built:
- Vote on existing items — upvote issues on GitHub that matter to you
- Propose new features — open a GitHub Discussion with your use case
- Contribute code — the core platform, SDKs, and integrations all accept PRs
Stay Updated
- GitHub Discussions — propose and discuss features
- GitHub Issues — track specific bugs and requests
- Changelog — every release with what changed and why
- Mailing list — low-frequency announcements for major releases
Planned Areas
The following areas are actively being worked on or planned for upcoming releases. See GitHub for the full list of in-progress issues.
Observability
- Deterministic evaluation checks (regex, JSON schema) as online evaluators
- Improved agent graph visualization for deeply nested traces
- Custom dashboards with configurable metrics widgets
Prompt Management
- Collaborative prompt editing with comments and review workflows
- Prompt A/B testing with traffic splitting labels
- Prompt diff viewer for comparing versions side-by-side
Evaluation
- Deterministic online evaluators (roadmap item)
- Expanded LLM-as-a-judge templates for common use cases
- Batch evaluation via API for large dataset runs
Platform
- Additional data export formats (Parquet, JSON Lines)
- Enhanced role-based access control for enterprise teams
- Audit logs for compliance-sensitive environments
This page reflects high-level direction. Specific timelines are not guaranteed. For the latest status on any item, check the linked GitHub issues.