Go beyond nascent AI demos. The intelligent AI-native gateway for prompts and agentic apps.

Effortlessly build AI apps that can answer questions and help users get things done. Arch is the AI-native proxy that handles the pesky heavy-lifting so that you can move faster in building agentic apps, prevent harmful outcomes, and rapidly incorporate latest models.

AI-native (edge and LLM) proxy for agents. Move faster by letting Arch handle the pesky heavy lifting in building agentic apps -- query understanding and routing, seamless integration of prompts with tools, and unified access and observability of LLMs. Built by the contributors of Envoy proxy.

• Arch Gateway @ GitHub.

superglue is an open-source server that sits as a layer between complex APIs and your application. With superglue, you always get the data that you want in the format that you expect. Fetch data from JSON and XML APIs, as well as CSV and Excel files in seconds.

• superglue @ GitHub.

LLM Gateway to provide model access, logging and usage tracking across 100+ LLMs. All in the OpenAI format.

• LiteLLM @ GitHub.

Related contents:

• You need more than a vector database @ Redis.

Ultra performant API Gateway with middlewares. A project hosted at The Linux Foundation.

An open framework to assemble ultra performance API Gateways with middlewares; formerly known as KrakenD framework, and core service of the KrakenD API Gateway.
An extendable, simple and stateless high-performance API Gateway framework designed for both cloud-native and on-prem setups.

Lura is an API Gateway builder and proxy generator that sits between the client and all the source servers, adding a new layer that removes all the complexity to the clients, providing them only the information that the UI needs. Lura acts as an aggregator of many sources into single endpoints and allows you to group, wrap, transform and shrink responses. Additionally it supports a myriad of middlewares and plugins that allow you to extend the functionality, such as adding Oauth authorization or security layers.

• The Lura Project framework @ GitHub.

A set of Otoroshi plugins to interact with LLMs.

Connect, setup, secure and seamlessly manage LLM models using an Universal/OpenAI compatible API.

• Otoroshi LLM Extension @ GitHub.
• Otoroshi with LLM : Pilotez et sécurisez vos modèles d'IA @ CleverCloud's YouTube .

API management on top of a reverse proxy.

Otoroshi is a layer of lightweight api management on top of a modern http reverse proxy written in Scala and developped by the MAIF OSS team. Otoroshi is designed to handle all the calls to and between your microservices without service locator and let you change configuration dynamicaly at runtime.

• Otoroshi @ GitHub.
• Otoroshi with LLM : Pilotez et sécurisez vos modèles d'IA @ CleverCloud's YouTube .

Speed application development and boost developer productivity. Ambassador is redefining how APIs are developed from design to production.

Emissary-Ingress is an open-source Kubernetes-native API Gateway + Layer 7 load balancer + Kubernetes Ingress built on Envoy Proxy. Emissary-ingress is a CNCF incubation project (and was formerly known as Ambassador API Gateway).

• Emissary-ingress @ GitHub.

The Platform Powering the API World. The Cloud-Native API Gateway.

Kong or Kong API Gateway is a cloud-native, platform-agnostic, scalable API Gateway distinguished for its high performance and extensibility via plugins.

By providing functionality for proxying, routing, load balancing, health checking, authentication (and more), Kong serves as the central layer for orchestrating microservices or conventional API traffic with ease.

• Kong @ GitHub.