Run your own gateway
Start the gateway with the documented npm launcher or Docker image.
Self-hosted gateway
Bifrost
Run an OpenAI-compatible gateway with provider failover, load balancing and a web interface for configuration.
Sources reviewed . Documentation review; not a performance benchmark or runtime test.
What can you do with Bifrost?
Distribute requests
Configure load balancing and fallback providers or models.
Manage request controls
Review caching, usage tracking and access controls for your deployment.
Before you integrate
Plan provider credentials and gateway hosting. Check which governance capabilities require an enterprise deployment.
Test against your own workload
Compare successful responses, latency and the total bill, including retries and fallbacks. Verify streaming, tool calls and structured output on the routes you plan to use. These are evaluation steps, not claims that every feature is supported.
Check model-provider incidents →Pricing and model access
Model rates, platform fees, credits and eligibility can change. Check the publisher’s current terms before choosing a route. Our calculator estimates model token costs; it does not quote a negotiated Bifrost bill.
Check Bifrost documentation ↗Package download trends
Downloads include automated installs and repeat downloads. They do not measure unique users, hosted requests or market share.
@maximhq/bifrost
npm · Gateway launcher
3,058 downloads in 28 days
2026-09-29 to 2026-10-26
-61.4% versus the previous 28 days
Source and comparison period
Previous: 7,929 downloads, 2026-09-01 to 2026-09-28.
Retrieved 2026-10-27. This is a saved snapshot, not a live count.
Sources and corrections
Suggest an update →Compare related routing products
Selected by product type and shared routing capabilities.
LiteLLM →
Run a proxy or use a Python router to distribute requests across model deployments, with load balancing, retries, cooldowns and fallbacks.
TensorZero →
An open-source gateway with routing, observability and evaluation. Its official repository is archived; assess maintenance before adopting it.
Cloudflare AI Gateway →
Manage model requests with logging, caching and rate limits, plus fallback providers for errors or configured timeouts.