api-gateway
Open-Source AI Gateway with Workflows, Aliases, and Usage Tracking. AI Gateway for Tracking, Decoupling, Debugging your AI Usage.
High-performance AI gateway written in Go - unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama. LiteLLM alternative with observability, guardrails & streaming.
Build better APIs faster. Open source API management platform.
Redefined API management for developers. Quickly add API keys, rate limiting, and usage analytics to your API at any scale.
🧪 Local Stack for testing Agent. MCP gateway with a built-in skill library.
One YAML. One endpoint. Every MCP server plus the skills you author alongside them.
Gridctl aggregates tools from MCP servers into a single gateway and serves Agent Skills as MCP prompts to upstream clients. Define your stack in YAML, apply with one command, and connect Claude Desktop (or any MCP client) through one endpoint.
Related contents:
Zero trace. Full answer. — Transparent Claude API proxy that anonymizes PII and sensitive data before it leaves your environment. From pentesters, to pentesters.
PromptZero applies Zero Trust principles to LLM interactions. A local, transparent proxy that detects and replaces sensitive data — identities, infrastructure, secrets, client material — in your prompts before they leave your environment, and restores the real values in the response. Never trust the API. Always verify what crosses the boundary. Your data stays home.
Related contents:
Free AI Gateway for Multi-Provider LLMs.
Never stop coding. Free AI gateway: one endpoint, 231+ providers (50+ free), connect Claude Code, Codex, Cursor, Cline & Copilot to FREE Claude/GPT/Gemini. RTK+Caveman stacked compression saves 15-95% tokens, smart auto-fallback, MCP/A2A, multimodal APIs, Desktop/PWA.
LLM Gateway to provide model access, logging and usage tracking across 100+ LLMs. All in the OpenAI format.
Related contents:
- You need more than a vector database @ Redis.
- À la découverte de liteLLM, une plateforme pour les gouverner tous @ Arneo's YouTube :fr:.
- TeamPCP supply chain attack spreads to PyPI @ Reversing Labs.
- How a Poisoned Security Scanner Became the Key to Backdooring LiteLLM @ snyk.
- Building a Kubernetes-native pattern for AI infrastructure at scale @ The New Stack.
- My minute-by-minute response to the LiteLLM malware attack @ futuresearch.
- A popular Python library just became a backdoor to your entire machine @ XDA.
- LLMs on Kubernetes Part 1: Understanding the threat model @ CNCF.
A comprehensive solution for managing, securing, and accessing Model Context Protocol (MCP) servers at scale. Built for enterprises, development teams, and autonomous AI agents.
Enterprise-ready MCP Gateway & Registry that centralizes AI development tools with secure OAuth authentication, dynamic tool discovery, and unified access for both autonomous AI agents and AI coding assistants. Transform scattered MCP server chaos into governed, auditable tool access with Keycloak/Cognito integration.
Related contents:
Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway . Manage your Application and API traffic with Envoy Gateway.
Aimed at making it easy to adopt, use, and manage Envoy Proxy. Deploy as a Standalone or Kubernetes-based API Gateway, implementing and extending the Kubernetes Gateway API.
Related contents:
superglue is an open-source server that sits as a layer between complex APIs and your application. With superglue, you always get the data that you want in the format that you expect. Fetch data from JSON and XML APIs, as well as CSV and Excel files in seconds.
Open-source auth gateway connecting 1000+ SaaS providers to AI agents through SDK, CLI, MCP, HTTP, and OpenAPI.
OpenConnector is an open-source connector gateway for AI agents and an alternative to Composio. Connect user app accounts once, then expose a shared catalog of 1,000+ providers and 10,000+ prebuilt Actions to agents and applications.
A set of Otoroshi plugins to interact with LLMs.
Connect, setup, secure and seamlessly manage LLM models using an Universal/OpenAI compatible API.
An Envoy-Powered, Kubernetes-Native API Gateway
Kgateway is feature-rich, fast, and flexible. It excels in function-level routing, supports legacy apps, microservices and serverless, offers robust discovery capabilities, integrates seamlessly with open-source projects, and is designed to support hybrid applications with various technologies, architectures, protocols, and clouds.
Related contents:
The Platform Powering the API World. 🦍 The Cloud-Native API Gateway.
Kong or Kong API Gateway is a cloud-native, platform-agnostic, scalable API Gateway distinguished for its high performance and extensibility via plugins.
By providing functionality for proxying, routing, load balancing, health checking, authentication (and more), Kong serves as the central layer for orchestrating microservices or conventional API traffic with ease.
API management on top of a reverse proxy.
Otoroshi is a layer of lightweight api management on top of a modern http reverse proxy written in Scala and developped by the MAIF OSS team. Otoroshi is designed to handle all the calls to and between your microservices without service locator and let you change configuration dynamicaly at runtime.
Gateway API is an official Kubernetes project focused on L4 and L7 routing in Kubernetes. This project represents the next generation of Kubernetes Ingress, Load Balancing, and Service Mesh APIs. From the outset, it has been designed to be generic, expressive, and role-oriented.
Related contents:
Simple CLI tool for deterministic routing of queries between local and hosted LLM models.
A fast, offline hard-or-easy call on every prompt — scored deterministically, with no model call. Route the easy ones to your small/local model and the hard ones to your big one, or compose any model-router behind it.
Go beyond nascent AI demos. The intelligent AI-native gateway for prompts and agentic apps.
Effortlessly build AI apps that can answer questions and help users get things done. Arch is the AI-native proxy that handles the pesky heavy-lifting so that you can move faster in building agentic apps, prevent harmful outcomes, and rapidly incorporate latest models.
AI-native (edge and LLM) proxy for agents. Move faster by letting Arch handle the pesky heavy lifting in building agentic apps -- ⚡️ query understanding and routing, seamless integration of prompts with tools, and unified access and observability of LLMs. Built by the contributors of Envoy proxy.
A lightweight API gateway built in Python.
Doorman is a simple, lightweight, cost‑effective gateway for AI, REST, SOAP, GraphQL, and gRPC APIs. Manage auth, routing, rate limiting, logging, and caching.
Speed application development and boost developer productivity. Ambassador is redefining how APIs are developed from design to production.
Emissary-Ingress is an open-source Kubernetes-native API Gateway + Layer 7 load balancer + Kubernetes Ingress built on Envoy Proxy. Emissary-ingress is a CNCF incubation project (and was formerly known as Ambassador API Gateway).
An open source registry and proxy that federates MCP, A2A, and REST/gRPC APIs with centralized governance, discovery, and observability. Optimizes Agent & Tool calling, and supports plugins.
ContextForge is an open source registry and proxy that federates tools, agents, and APIs into one clean endpoint for your AI clients. It provides centralized governance, discovery, and observability across your AI infrastructure.
Model Context Protocol Gateway.
Model Context Protocol gateway & proxy - unify REST, MCP, and A2A with federation, virtual servers, retries, security, and an optional admin UI.
ContextForge MCP Gateway is a feature-rich gateway, proxy and MCP Registry that federates MCP and REST services - unifying discovery, auth, rate-limiting, observability, virtual servers, multi-transport protocols, and an optional Admin UI into one clean endpoint for your AI clients. It runs as a fully compliant MCP server, deployable via PyPI or Docker, and scales to multi-cluster environments on Kubernetes with Redis-backed federation and caching.
Related contents:
Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just an endpoint change.
A drop-in proxy for Anthropic, OpenAI, and Gemini that picks the best model for every request: using a tiny on-box embedder, not a vibes-based prompt.
Ultra performant API Gateway with middlewares. A project hosted at The Linux Foundation.
An open framework to assemble ultra performance API Gateways with middlewares; formerly known as KrakenD framework, and core service of the KrakenD API Gateway. An extendable, simple and stateless high-performance API Gateway framework designed for both cloud-native and on-prem setups.
Lura is an API Gateway builder and proxy generator that sits between the client and all the source servers, adding a new layer that removes all the complexity to the clients, providing them only the information that the UI needs. Lura acts as an aggregator of many sources into single endpoints and allows you to group, wrap, transform and shrink responses. Additionally it supports a myriad of middlewares and plugins that allow you to extend the functionality, such as adding Oauth authorization or security layers.
Otari Gateway is the open-source gateway that puts a single OpenAI-compatible API in front of many LLM providers.
Run it in your own infrastructure. Use it standalone, or connect it to otari.ai for hosted routing, authentication, and usage reporting.
Agent Connectivity Solved. Next Generation Agentic Proxy for AI Agents and MCP servers.
Agent Gateway is an open source data plane built on AI-native protocols (A2A & MCP) to connect, secure, and observe agent-to-agent and agent-to-tool communication across any framework and environment.
Related contents:
Zuul is a gateway service that provides dynamic routing, monitoring, resiliency, security, and more.
Related contents:
Simple, unified interface to multiple Generative AI providers.
aisuite makes it easy for developers to use multiple LLM through a standardized interface. Using an interface similar to OpenAI's, aisuite makes it easy to interact with the most popular LLMs and compare the results. It is a thin wrapper around python client libraries, and allows creators to seamlessly swap out and test responses from different LLM providers without changing their code. Today, the library is primarily focussed on chat completions. We will expand it cover more use cases in near future.
MCP OAuth Proxy incl. dynamic client registration (DCR), MCP prompt analytics and MCP firewall to build enterprise grade MCP servers.
Jetski is an Open Source MCP Analytics and Authentication Platform - part of HyprMCP. It solves the three biggest problems teams face when developing MCP servers with zero code changes: