AgentSidekick

Model Gateways & Routing

Proxies that route requests across LLM providers. As of 2026-11-21, 431 indexed products match this subcategory (198 with full profiles); 167 were published in the last 90 days, against 85 in the 90 days before, slower than the catalogue as a whole. By GitHub stars, OmniRoute leads, holding 11% of the stars of the 352 products here with their own repository. The most common form is MCP servers (70% of indexed products).

SubcategorySegment label: Lagging the catalogue DER

Segment statistics

Whole catalogue (all 431 indexed products, not only profiled ones). Calculated 2026-11-21.

431DERIndexed products198 with full profiles
167DERLaunched, last 90 days85 in the 90 days before
28DERMomentum vs catalogue50 = same pace as the catalogue
11%DERLargest project's share of starsAcross 352 products with their own repository
0.054DERConcentration (HHI)About 18 equal-sized projects’ worth; unconcentrated
9SRCMedian starsPer product with its own repository
77%DEROpen sourceMarked open source; unknown counts as not

Lagging the catalogue. Mid-sized for its level, with launches growing more slowly than the catalogue’s. Size is ranked against the other subcategory nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).

Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.054, attention is spread as if across about 18 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is unconcentrated. Stars measure attention, not usage or quality.

Which product forms serve it

The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.

Products in Model Gateways & Routing by product type, as of 2026-11-21
Product type IndexedShareWith a profile
MCP servers30370.3%74
Infrastructure399.0%38
Plugins214.9%18
Agent skills173.9%17
Agent projects173.9%17
Frameworks112.6%11
IDE extensions81.9%8
Libraries71.6%7
SaaS products20.46%2
Developer tools20.46%2
AI APIs20.46%2
Rules packs10.23%1
Platforms10.23%1

3 capabilities

Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.

CapabilityIndexed ProfiledNew, 90 daysLabel
Multi-provider AccessOne API for many model providers.24811894Crowded, slowing
LLM Caching & Rate LimitsCaching responses and enforcing token budgets.744033Established
Model RoutingPicking the right model per request with fallbacks.471816Lagging the catalogue

Top 40 products by GitHub stars

Search the directory

Profiled products only (198 of 431), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.

Model Gateways & Routing: top profiled products by GitHub stars, 2026-11-21
#ProductTypePublisherCapabilities GitHub stars Last push LicenceSave and compare
1OmniRouteNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributorsAgent projectcheaper-inference89ktodayMIT
2dsh-our-free-model在 dsh 里装上这个插件即可,无需登录、注册或填 API Key,就能使用包括 DeepSeek V4.1 Flash、Kimi K3 在内的前沿模型——完全免费,不限量。 All you do is install this plugin in dsh: no login, no sign-up, no API key — the frontier models are just there, DeepSeek V4.1 Flash and Kimi K3 among them. Completely free, with no usage cap.Agent projectEbony-Vinyl83ktoday—
3LiteLLMPython SDK and proxy server that expose 100+ model providers through an OpenAI-compatible API with keys, budgets, rate limits, fallbacks and logging.InfrastructureBerriAI64ktodayMIT
4gooseOpen-source, local general-purpose AI agent (desktop app and CLI) for coding, research, writing and automation that works with any LLM and is extended through MCP extensions, YAML recipes and subagents.PlatformAgentic AI Foundation (originally Block)57k1d agoApache-2.0
5nanobotYour lightweight open-source personal agent.MCP serverHKUDS50ktodayMIT
6Kong AI GatewaySet of AI plugins for the Kong API gateway that proxy and govern LLM traffic with prompt guards, semantic caching, routing and MCP traffic controls.InfrastructureKong44k1d agoApache-2.0
7CodewhaleAn open-source coding agent for your terminal, written in Rust. It works with any model, can split one task across several agents, and every line of it is yours to read.Agent projectcodewhale-hq41ktodayMIT
8LangfuseOpen-source LLM engineering platform for tracing, prompt management, evaluations and datasets, self-hosted or Langfuse Cloud.Developer toolClickHouse (Langfuse)38ktodayMIT
9mcp-for-blenderCommunity plugin to control Blender 3D with any LLM of your choice. Not affiliated with the official Blender Foundation.MCP serverahujasid35k3d agoMIT
109routerUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.Agent projectdecolua33k5d agoMIT
11gpt-researcherAn autonomous agent that conducts deep research on any data using any LLM providersMCP serverassafelovic31k9d agoApache-2.0
12Auto-claude-code-research-in-sleepARIS ⚔️ (Auto-Research-In-Sleep) — Lightweight Markdown-only skills for autonomous ML research: cross-model review loops, idea discovery, and experiment automation. No framework, no lock-in — works with Claude Code, Codex, OpenClaw, or any LLM agent.MCP serverwanshuiyin20k2d agoMIT
13Portkey AI GatewayGateway that routes requests to many LLM providers with retries, fallbacks, load balancing, caching and guardrails; open-source core plus hosted control plane.InfrastructurePalo Alto Networks (Portkey)13k1d agoMIT
14InsForgeThe all-in-one, open-source backend platform for agentic coding. InsForge gives your coding agent database, auth, storage, compute, hosting, and AI gateway to ship full-stack apps end-to-end.Agent projectInsForge13k1d agoApache-2.0
15OpenLLMRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.Infrastructurebentoml13k5d agoApache-2.0
16mcp-useOpen-source library for connecting any LLM to MCP servers and building custom MCP agents and servers in Python or TypeScript.LibraryManufact11ktodayMIT
17tykOpen Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)MCP serverTykTechnologies11ktoday—
18BifrostGo-based LLM gateway exposing many providers through one OpenAI-compatible API with failover, load balancing, governance and an MCP gateway.InfrastructureMaxim AI9.9ktodayApache-2.0
19llm-gatewayOpen Source LLM Gateway 🦚Infrastructuremnfst7.7k4d agoMIT
20planoPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.Infrastructurekatanemo7.1k28d agoApache-2.0
21ANUSA free coding agent in your terminal. It runs on the smartest free model that is up today.Agent projectanus-dev6.6k1mo agoMIT
22KunLocal-first AI agent workspace for coding, writing, design, research, and automation — one runtime for desktop GUI and TUI.Agent projectKunAgent6.4k5d ago—
23agentgatewayRust data plane for agent traffic that proxies MCP, A2A and LLM calls with authentication, authorisation policies and telemetry.InfrastructureLinux Foundation6.3ktodayApache-2.0
24HeliconeProxy-based LLM observability that logs requests, costs and latency with one-line integration, plus an AI gateway.Developer toolMintlify (Helicone)6.3k4d agoApache-2.0
25monidMonid - OpenRouter for agent tools. Join our community at https://discord.gg/rQzztcgJV8Agent projectmonid-ai6.2k4d agoMIT
26youtube-automation-agent🎬 Open-source, self-hosted AI agent that runs a YouTube channel end to end: researches topics, writes scripts, generates narration, visuals and video, optimizes SEO, and publishes after your approval, then learns from analytics. Works with Gemini, OpenAI, OpenRouter, DeepSeek and more.Agent projectdarkzOGx5.3k1d agoMIT
27council-of-high-intelligenceStructured multi-perspective deliberation for hard decisions. Run full councils, focused triads, or duo debates across Claude Code, Codex, Gemini CLI, and OpenCode.Framework0xNyk4.9k5d agoMIT
28ContextForge MCP GatewayGateway and registry that federates MCP servers, A2A agents and REST APIs behind one endpoint with auth, rate limiting and observability.InfrastructureIBM4.9k1d agoApache-2.0
29OB1Open Brain — The infrastructure layer for your thinking. One database, one AI gateway, one chat channel — any AI plugs in. No middleware, no SaaS.Agent projectNateBJones-Projects4.8ktoday—
30all-agentic-architectures35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, BrowserAgent, ...) — a Python library and runnable textbook with multi-provider LLM support and a 17-task benchmark leaderboard.Agent projectFareedKhan-dev4.8k5d agoMIT
31gptmeYour agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!Agent projectgptme4.5ktodayMIT
32Claude APIAPI for Claude models with tool use, extended thinking, prompt caching, a remote MCP connector and server-side tools such as web search and code execution.APIAnthropic4.1k1d agoApache-2.0
33ableton-mcpControl Ableton Live with any LLM: create tracks, arrange clips & compose music via MCPMCP serverahujasid3.4k2mo agoMIT
34FuxiFuXi is a fast, self-contained AI coding agent that lives in your terminal — edit code, run commands, and drive tools, with cost-aware routing across LLM providers.Agent projectfuxicodex3.2k1mo ago—
35VCPToolBoxVCP 部署在 AI 模型 API 与前端应用之间,是面向AGI OS开发和探索的工业级基建示范项目。通过统一指令协议、多层级持久化记忆、分布式插件引擎及多 Agent 协作框架,将原本“无状态、无记忆、无工具调用能力”的大语言模型,彻底改造成拥有永久自我意识、物理世界操作权及群体协作智能的完整智能体系统。Frameworklioensky2.5k1d ago—
36Agent RouterKubernetes-native AI gateway built on Envoy Gateway that exposes models through an OpenAI-compatible API and tools through an MCP gateway, with rate limiting and access control.InfrastructureAgentic AI Foundation (Linux Foundation)2.4k1d agoApache-2.0
37claude-real-videoLet any LLM watch a video locally — and search everything it has ever watched.MCP serverHUANGCHIHHUNGLeo2.3k1d agoMIT
38company-research-agentAn agentic company research tool powered by LangGraph and Tavily that conducts deep diligence on companies using a multi-agent framework. It leverages OpenRouter on the backend for rapid inference with any leading model.Frameworkguy-hartstein2.3k18d agoApache-2.0
39future-agiOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.Infrastructurefuture-agi2.3ktodayApache-2.0
40CoreCoderMinimal AI coding agent (~1,000 lines of Python) inspired by Claude Code. Works with any LLM. Think NanoGPT for coding agents. Formerly NanoCoder.Agent projecthe-yufeng1.9k1d agoMIT

Most common integrations

Third-party services named by products in this node, whole catalogue.

IntegrationProducts Share
Azure30.7%
GitHub30.7%
Google Cloud30.7%
Vercel30.7%
Blender20.5%
Discord20.5%
Solana20.5%
Telegram20.5%
AWS10.2%
Gmail10.2%
Grafana10.2%
GraphQL10.2%
Kubernetes10.2%
Netlify10.2%
PostgreSQL10.2%

Launches per month

New Model Gateways & Routing products per monthSRC

Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.

New Model Gateways & Routing products per monthWhole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.. Products published: 24 points, latest 46 products in 2026-11.
Show the data as a table
New Model Gateways & Routing products per month. Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.
Products published (products)
2024-112
2024-121
2025-012
2025-022
2025-036
2025-054
2025-061
2025-072
2025-081
2025-097
2025-102
2025-112
2025-124
2026-019
2026-0220
2026-0325
2026-0423
2026-0526
2026-0625
2026-0736
2026-0828
2026-0934
2026-1073
2026-1146

Related opportunities

Opportunity radar

Scored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.

OpportunityCompetitionConfidenceScore
Coverage gap: Model RoutingModel RoutingHighLow57.3
Coverage gap: LLM Caching & Rate LimitsLLM Caching & Rate LimitsHighLow54.1

Limits of these numbers

  • Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
  • About half of the catalogue matches no node at all, so absolute counts understate every category.
  • Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
  • Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.

Page data last updated .