Apache Software Foundation top-level project
The open-source API Gateway & AI Gateway
High-performance traffic management for APIs, microservices, and LLM workloads — dynamic routing, load balancing, authentication, and observability.
- 100+plugins
- ~18kQPS / core
- 0.2 msadded latency
- Apache 2.0licensed
Get started with Apache APISIX
AI Gateway
The same gateway, now for your LLM traffic
Proxy, secure, and govern traffic to 20+ LLM providers — with the performance, plugins, and observability you already run for your APIs.
AI apps & agents→ Apache APISIX→ OpenAIAnthropicAWS BedrockDeepSeekOllama+ more
Multi-LLM proxy
Route to OpenAI, Anthropic, AWS Bedrock, DeepSeek, Ollama and 20+ providers through one endpoint.
LLM load balancing
Distribute traffic across providers and models for throughput and resilience.
Retry & fallback
Fail over to a backup model or provider automatically when one is unavailable.
Token rate limiting
Cap usage and cost with token-based rate limits per consumer.
Prompt security
Guardrails, content moderation, and prompt decoration before requests reach the model.
MCP support
Expose and govern Model Context Protocol tools through the gateway.
Architecture
Dynamic by design, built on NGINX and etcd
Requests flow through a hot-reloadable plugin pipeline; etcd distributes configuration across the cluster in real time, with no restarts.
Building for large-scale, high value systems
Apache APISIX provides open source API Gateway to help you manage microservices, delivering the ultimate performance, security, and scalable platform for all your APIs and microservices.
Why APISIX API Gateway?
Reduce time fighting bugs, focus on designing world-class systems with API Gateway
APISIX API Gateway offers 100+ open-source plugins, comprehensive API management capabilities, and advanced technical advantages.
Integrates with your stack
Connect APISIX to your observability, security, service discovery, and AI tools through 100+ plugins.
Performance
Ultimate performance
Apache APISIX Gateway uses radixtree-route-matching and etcd under the hood to provide you the ability to create high speed synchronized systems. From routing to built-in plugins, all these are designed and implemented to be uber performant with the minimum latency possible.
Security
Shield against the malicious
Apache APISIX Gateway provides multiple security plugins for identity authentication and API verification, including CORS, JWT, Key Auth, OpenID Connect (OIDC), Keycloak, etc. We put stability and security first.
Scalability and availability
Scales with your users
Apache APISIX Gateway provides the ability to write your own custom plugins, use custom Load Balancing Algorithms during the balancer phase for scaling and custom Routing algorithms for fine control on routing.
Fully dynamic
Save dev-time, design what matters
As API Gateway, Apache APISIX provides Hot updates and Hot plugins, which continuously update configurations without restarts, saving development time and stress. In addition, health checks, circuit breakers, and many more features keep the system balanced.
Multi-platform and protocol
Create once, run anywhere
Platform agnostic, no vendor lock-in. Apache APISIX as API Management solution, can run from bare-metal to Kubernetes. It supports HTTP to gRPC transcoding, websockets, gRPC, Dubbo, MQTT proxy and multiple platforms including ARM64, don't worry about the lock-in of the infra technology.
