softwarefactory.build

A directory and guide library for agent-native software factories.

Directory / Ragas

Ragas

Verified

Open metrics for RAG and LLM application quality.

Ragas is an open-source evaluation library for RAG and LLM apps: faithfulness, relevancy, and related metrics. It is a verification tool when the factory ships retrieval-shaped features.

Verification
Model independence
Multi-model
Deployment
Self-hosted
Open source
Yes
License
Apache-2.0
Pricing model
Free
Added / updated
19 Aug 2026 / 19 Aug 2026

docs.ragas.io · Docs · Source

Editorial take

Ragas is not for general backend PRs. Listed so RAG factories have a metric library that is not a vendor UI. Judge metrics still need hold-outs.

Strengths

  • Apache-2.0 RAG metrics.
  • Widely used, model-agnostic.
  • CI-integrable.

Limitations

  • Wrong tool for a generic service diff.
  • LLM-judge metrics are approximate.
  • Not a PR app.

Fields last checked against primary sources on . Pricing and plan names rot; follow the vendor URL.