AgentSidekick

Web Search

Search engines and search APIs for agents. As of 2026-11-21, 654 indexed products match this subcategory (145 with full profiles); 387 were published in the last 90 days, against 132 in the 90 days before, roughly in step with the catalogue as a whole. By GitHub stars, Firecrawl leads, holding 46% of the stars of the 421 products here with their own repository. The most common form is MCP servers (95% of indexed products).

SubcategorySegment label: Established DER

Segment statistics

Whole catalogue (all 654 indexed products, not only profiled ones). Calculated 2026-11-21.

654DERIndexed products145 with full profiles
387DERLaunched, last 90 days132 in the 90 days before
46DERMomentum vs catalogue50 = same pace as the catalogue
46%DERLargest project's share of starsAcross 421 products with their own repository
0.249DERConcentration (HHI)About 4 equal-sized projects’ worth; moderately concentrated
1SRCMedian starsPer product with its own repository
57%DEROpen sourceMarked open source; unknown counts as not

Established. Mid-sized for its level, with launches roughly in step with the catalogue. Size is ranked against the other subcategory nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).

Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.249, attention is spread as if across about 4 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is moderately concentrated. Stars measure attention, not usage or quality.

Which product forms serve it

The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.

Products in Web Search by product type, as of 2026-11-21
Product type IndexedShareWith a profile
MCP servers62094.8%112
Agent skills142.1%14
AI APIs81.2%8
Plugins71.1%7
Frameworks30.46%3
Infrastructure10.15%0
Agent projects10.15%1

3 capabilities

Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.

CapabilityIndexed ProfiledNew, 90 daysLabel
Search APIsProgrammatic search providers.1464166Lagging the catalogue
News & FeedsNews search and RSS feeds.1121578Outpacing the catalogue
Local SearchBusinesses and places nearby.491439Outpacing the catalogue

Top 40 products by GitHub stars

Search the directory

Profiled products only (145 of 654), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.

Web Search: top profiled products by GitHub stars, 2026-11-21
#ProductTypePublisherCapabilities GitHub stars Last push LicenceSave and compare
1FirecrawlAPI that crawls and scrapes websites into clean Markdown or structured JSON, with search, map and agentic extract endpoints.APIfirecrawl206ktodayAGPL-3.0
2TrendRadar⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, web search, MCP & smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅 + 定时联网搜索,支持关键词与 AI 智能筛选。AI 翻译 + AI 分析简报直推手机,支持接入 MCP 架构,赋能 AI 自然语言对话分析、实时检索、情感洞察与趋势预测。支持 Docker,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/Bark/Slack 等渠道智能推送。MCP serversansan064ktodayGPL-3.0
3OpenAI APIAPI for GPT and reasoning models via the Responses and Chat Completions endpoints, with built-in tools such as web search, file search, code interpreter and computer use.APIopenai32k1d agoApache-2.0
4OpenSEOKeyword research, site audits, rank tracking and AI visibility for your AI agent.MCP servereveryapp.com28k1d agoMIT
5Jina ReaderAPI that converts any URL into LLM-friendly Markdown (r.jina.ai) and runs web search returning cleaned page content (s.jina.ai).APIjina-ai12k6mo agoApache-2.0
6AIHOTChinese AI news: search topics, explore hot events, and read daily, weekly and monthly briefs.MCP serverKKKKhazix11ktodayMIT
7Firecrawl MCP ServerFirecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.MCP serverfirecrawl7.9k1d agoMIT
8big-AGIThe AI workspace for experts. Switch across 800+ models mid-chat, tune 40+ parameters, Beam models side by side. BYO keys, self-hostable. Built on our native-protocol engine: reliable, hyper-configurable, and fast.Agent projectenricoros7.2k1d agoMIT
9MindSearch🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)FrameworkInternLM6.9k1y agoApache-2.0
10Airweave SearchMCP server for searching Airweave collections with natural language queries.MCP serverairweave-ai6.5k5mo agoMIT
11wigoloLocal-first web intelligence MCP server for AI coding agentsMCP serverKnockOutEZ5.6k1d ago—
12ExaOfficial Exa MCP for web search, content fetching, and multi-step research.MCP serverexa.ai5.3ktodayMIT
13exaExa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers, and more.Pluginexa-labs5.3ktodayMIT
14Claude APIAPI for Claude models with tool use, extended thinking, prompt caching, a remote MCP connector and server-side tools such as web search and code execution.APIAnthropic4.1k1d agoApache-2.0
15Gemini APIDeveloper API for Gemini models with long context, multimodal input, function calling and grounding with Google Search.APIgoogle4.1ktodayApache-2.0
16ddgsA metasearch library that aggregates results from diverse web search servicesMCP serverdeedy53.1k29d agoMIT
17tavily-mcpMCP server for advanced web search using TavilyMCP servertavily-ai2.5k3d agoMIT
18company-research-agentAn agentic company research tool powered by LangGraph and Tavily that conducts deep diligence on companies using a multi-agent framework. It leverages OpenRouter on the backend for rapid inference with any leading model.Frameworkguy-hartstein2.3k18d agoApache-2.0
19mcp-gscGoogle Search Console Insights with Claude AI for SEOsMCP serverAminForou2.3k1d agoMIT
20last30days-skill-cn给 AI Agent 的中文互联网研究 Skill:检索 8 大平台最近 30 天的讨论,追踪跨平台热点,生成附原始来源的报告,并提供每日全网热榜。支持 Claude Code、Codex、OpenClaw。Agent skillJesseovo2.2k1d ago—
21AISafetyHotAI Safety HOT: daily AI safety news, papers and incidents in one place — jailbreaks, prompt injection, alignment, evals, governance. Website, daily digest, RSS and MCP.MCP serverwuyoscar2.1ktoday—
22anysearch-mcp-serverUnified real-time search MCP server supporting general web search, vertical domain search, parallel batch search, and full-page URL content extraction.MCP serveranysearch-ai2.1k5d agoApache-2.0
23openserpSelf-hosted web search for AI agents and SEO. Google, Bing, Yandex, Baidu, DuckDuckGo & Ecosia, rendered in a real browser: ranked results and clean page Markdown. API, CLI, MCP 🎉MCP serverkarust1.6k1d agoMIT
24brave-search-mcp-serverBrave Search MCP Server: web results, images, videos, rich results, AI summaries, and more.MCP serverbrave1.6k1d agoMIT
25SearXNG SearchMCP server for SearXNG — privacy-respecting web search with pagination, URL readingMCP serverihor-sokoliuk1.4k3d agoMIT
26search2aiSelf-hosted search gateway for AI agents. Unified search, news and page extraction with provider fallback. REST API, MCP server and TypeScript library.MCP serverfatwang21.3k4d agoMIT
27CRW Web ScraperOpen-source web scraper for AI agents with scrape, crawl, and map toolsMCP serverfastcrw1.3ktodayAGPL-3.0
28CRW Web ScraperOpen-source web scraper for AI agents with scrape, crawl, and map toolsMCP serverus1.3ktodayAGPL-3.0
29fastCRWScrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.MCP serverus1.3ktodayAGPL-3.0
30enterprise-deep-researchSalesforce Enterprise Deep ResearchFrameworkSalesforceAIResearch1.2k25d agoApache-2.0
31modsearch🥇 The strongest free web search plugin for DeepSeek Harness, and the search bridge for every model without native web access. Free, no signup, no API key. Ask the web or X, get structured JSON evidence. | 🥇 全网最强的 DeepSeek Harness 免费联网搜索插件,免费免注册免 API key。为不能联网的模型补上搜索,问网页或 X,拿回结构化 JSON 证据(搜索、抓取、引用)。Agent skillliustack1.0k6d agoMIT
32xiaoyaosearch小遥搜索,听懂你的话、看懂你的图,用AI找到本地任何文件。让搜索像聊天一样简单。XiaoyaoSearch: Understands your words, reads your images, finds any local file with AI. Making search as easy as chatting.Agent skilldtsola1.0k3d ago—
33chatgpt-seoTurn a page, draft, or SEO export into a sourced fix plan inside ChatGPT.Agent skillAgriciDaniel9381mo agoMIT
34WebRouterSearch, extract, answer, research and browse the web through one interface, across many providersMCP serverNimbleway7871d agoApache-2.0
35EveryInfraStructured data from 106 platforms (RedNote, Douyin, TikTok, Amazon), web search, CAPTCHA solving.MCP serverxiaoxihexiaoyu6661d agoApache-2.0
36SEO SkillSearch Console, Google Analytics and keyword data for your AI agent.MCP serverseoskill.dev6421d agoApache-2.0
37google-searchA Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Local alternative to SERP APIs with MCP server integration.MCP serverweb-agent-master6291y ago—
38ask-searchSelf-hosted web search for AI agents: a CLI + MCP server that wraps SearxNG to aggregate Google, Bing, DuckDuckGo, Brave and more — no API key, no paid search API. Works with Claude Code, OpenClaw, Antigravity and any shell; optional Tavily backend. 给 AI Agent 用的自托管联网搜索(SearxNG)。MCP serverythx-1015379d agoMIT
39CoexistAICoexistAI is a modular, developer-friendly research assistant framework . It enables you to build, search, summarize, and automate research workflows using LLMs, web search, Reddit, YouTube, and mapping tools—all with simple MCP tool calls or API calls or Python functions. MCP serverSPThole5318mo ago—
40tavilyBuild AI applications with real-time web data using Tavily's search, extract, crawl, and research APIs.Plugintavily-ai4973d agoMIT

Most common integrations

Third-party services named by products in this node, whole catalogue.

IntegrationProducts Share
Google Analytics213.2%
Google Maps182.8%
YouTube162.4%
Reddit101.5%
GitHub71.1%
LinkedIn50.8%
Telegram40.6%
X (Twitter)40.6%
Google Cloud30.5%
Google Ads20.3%
Playwright20.3%
Shopify20.3%
WordPress20.3%
AWS10.2%
Azure10.2%

Launches per month

New Web Search products per monthSRC

Whole catalogue, by publication month, 2025-02 to 2026-11. The last month is partial; undated products are excluded.

New Web Search products per monthWhole catalogue, by publication month, 2025-02 to 2026-11. The last month is partial; undated products are excluded.. Products published: 20 points, latest 124 products in 2026-11.
Show the data as a table
New Web Search products per month. Whole catalogue, by publication month, 2025-02 to 2026-11. The last month is partial; undated products are excluded.
Products published (products)
2025-021
2025-033
2025-041
2025-061
2025-081
2025-099
2025-106
2025-114
2025-125
2026-017
2026-029
2026-0322
2026-0428
2026-0517
2026-0633
2026-0751
2026-0868
2026-0979
2026-10161
2026-11124

Related opportunities

Opportunity radar

Scored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.

No scored opportunity here

Capability gaps are only scored inside subcategories with at least 20 indexed products, and only the top 80 are kept. None falls under this node.

Limits of these numbers

  • Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
  • About half of the catalogue matches no node at all, so absolute counts understate every category.
  • Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
  • Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.

Page data last updated .