HoneyHive is an observability and evaluation platform for LLM applications and agents, unifying tracing, offline evaluation against test datasets, human review queues, and experimentation. It supports any model provider and integrates with common agent and LLM frameworks through OpenTelemetry-based SDKs. A free developer tier includes a monthly event allowance with full platform access; paid plans are custom-quoted and scale with usage, retention, and enterprise deployment options. It targets teams that need domain-expert annotation alongside automated evals.
llm-tracingevalshuman-review
Overview
- Founded
- 2022
- Pricing tier
- Mid
- Startup-friendly
- Yes
- Enterprise-ready
- Yes
LLM observability
- Request tracing
- Yes
- Quality evals
- Yes
- Prompt management
- Yes
- LLM gateway
- No
- Open-source
- No
- Self-hostable
- No
- Free tier
- Yes: Developer tier: 10k events/mo, 5 users