Directory / Ragas
Ragas
Verified
Open evaluation metrics for RAG and LLM applications.
Ragas is an open-source evaluation library for RAG and LLM apps: faithfulness, relevancy, and related metrics. Retrieval-shaped features can use it as a verification layer.
- Model support
- Multi-model
- Deployment
- Self-hosted
- Open source
- Yes
- License
- Apache-2.0
- Pricing model
- Free
- Added / updated
- 19 Aug 2026 / 19 Aug 2026
docs.ragas.io · Docs · Source
Assessment
Ragas targets retrieval and LLM application evaluation instead of general backend pull requests. Its metrics can run outside a vendor UI, but judge-based measures still need hold-out cases.
Strengths
- Apache-2.0 RAG metrics.
- Widely used, model-agnostic.
- CI-integrable.
Limitations
- Wrong tool for a generic service diff.
- LLM-judge metrics are approximate.
- No pull-request app.