BigHugger
GH Repository · Portkey-AI

gateway

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

stars
13,020
30-day movement
starts with the next reading
Related entries
60
Connections
2
typescriptdockeragent-frameworkTypeScriptmodel-routermcp-serversgatewaygenerative-aillmsnodemcpmcp-clientai-gatewayllmllmopslangchainhacktoberfestopenaillm-gatewaymcp-gateway

Portkey AI Gateway is a TypeScript-based AI gateway that routes requests to 1,600+ LLMs through a single API and includes 50+ integrated AI guardrails. It also functions in the agentic ecosystem with MCP support, acting as an MCP gateway and client.

You reach for it when you need one unified API to access many LLM providers while applying guardrails and routing in front of them.

Use it to

  • Route requests across multiple LLM providers through one API
  • Apply AI guardrails to model calls
  • Connect agents via MCP client and gateway support
  • Centralize LLM ops for LangChain or OpenAI-based stacks
  • Self-host the gateway with Docker

For Developers and teams running LLM applications in production

Role
agent-framework
Language
TypeScript
Licence
MIT
Forks
1,305
Open issues
115
Last push
2026-05-25
Latest release
v1.0.0 · 2024-01-03
topicsllm-gatewaymodel-routerai-guardrailsmcpllmopstypescript