Portkey is an AI gateway with observability built in: applications route model calls through it to gain retries, fallbacks, load balancing, caching, and guardrails across 250+ providers. Every request is logged with cost and latency detail. It also provides prompt management with versioning. The gateway core is open source and self-hostable, and the hosted service offers a free Developer tier with a monthly log allowance, a flat-priced Production plan with usage overage, and quote-based enterprise options with VPC deployment.
llm-gatewayllm-tracingprompt-managementopen-source
Overview
- Founded
- 2023
- Pricing tier
- Mid
- Startup-friendly
- Yes
- Enterprise-ready
- Yes
LLM observability
- Request tracing
- Yes
- Quality evals
- No
- Prompt management
- Yes
- LLM gateway
- Yes
- Open-source
- Yes
- Self-hostable
- Yes
- Free tier
- Yes: Developer plan: 10k logs/mo; OSS gateway self-host free