Directory / Helicone
Helicone
Verified
Open LLM gateway with logs, caching, and spend controls.
Helicone is an open-source gateway and observability layer for LLM APIs. It provides proxying, logs, caching, and rate limits for inference traffic.
- Model support
- Router
- Deployment
- Cloud, Self-hosted
- Open source
- Yes
- License
- Apache-2.0
- Pricing model
- Mixed
- Added / updated
- 19 Aug 2026 / 19 Aug 2026
www.helicone.ai · Docs · Source
Assessment
Helicone is a provider-facing gateway with observability and basic traffic controls. It can measure inference usage across providers; a separate system handles code-change evaluation.
Strengths
- Apache-2.0 proxy you can self-host.
- Cost, latency, and log visibility across providers.
- Caching/rate limits as factory controls.
Limitations
- A proxy outage is an inference outage.
- Not an eval framework by itself.
- Cloud vs OSS.