AgentSidekick

Audio & Speech

Speech synthesis, transcription, music and voice agents. As of 2026-11-21, 549 indexed products match this subcategory (130 with full profiles); 325 were published in the last 90 days, against 118 in the 90 days before, roughly in step with the catalogue as a whole. By GitHub stars, AgentScope leads, holding 13% of the stars of the 404 products here with their own repository. The most common form is MCP servers (92% of indexed products).

SubcategorySegment label: Established DER

Segment statistics

Whole catalogue (all 549 indexed products, not only profiled ones). Calculated 2026-11-21.

549DERIndexed products130 with full profiles
325DERLaunched, last 90 days118 in the 90 days before
43DERMomentum vs catalogue50 = same pace as the catalogue
13%DERLargest project's share of starsAcross 404 products with their own repository
0.058DERConcentration (HHI)About 17 equal-sized projects’ worth; unconcentrated
1SRCMedian starsPer product with its own repository
66%DEROpen sourceMarked open source; unknown counts as not

Established. Mid-sized for its level, with launches roughly in step with the catalogue. Size is ranked against the other subcategory nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).

Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.058, attention is spread as if across about 17 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is unconcentrated. Stars measure attention, not usage or quality.

Which product forms serve it

The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.

Products in Audio & Speech by product type, as of 2026-11-21
Product type IndexedShareWith a profile
MCP servers50391.6%85
Agent skills224.0%22
Frameworks122.2%12
Plugins61.1%6
Agent projects30.55%3
Infrastructure20.36%2
Rules packs10.18%0

4 capabilities

Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.

CapabilityIndexed ProfiledNew, 90 daysLabel
Speech to TextTranscribing audio into text.26661176Crowded
Text to SpeechTurning text into natural speech.21057106Crowded, slowing
Music & Sound GenerationGenerating music and sound effects.901949Lagging the catalogue
Voice AgentsRealtime voice and phone agents.472220Lagging the catalogue

Top 40 products by GitHub stars

Search the directory

Profiled products only (130 of 549), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.

Audio & Speech: top profiled products by GitHub stars, 2026-11-21
#ProductTypePublisherCapabilities GitHub stars Last push LicenceSave and compare
1AgentScopePython multi-agent framework with message-based agent communication, tool use, memory and a visual studio for debugging.FrameworkAlibaba (AgentScope)36k1d agoApache-2.0
2MastraTypeScript framework for agents, workflows, RAG, memory and evals, with a local dev playground and deploy targets for common hosts.FrameworkMastra30ktodayApache-2.0
3Douyin_TikTok_Download_API🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API,支持 AI agent 通过 MCP 调用与离线语音转文字,Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity pool, PostgreSQL archive, one docker compose up.MCP serverEvil0ctal22k1d agoApache-2.0
4ConcatBeta: The truly free, open-source, local-first, cross-platform video editor. Scriptable through a JSON-RPC API & MCP.MCP serverjub0t19k1d agoAGPL-3.0
5lemo-opuscarA toolbox of film styles made in code for Claude Code: 99 ready to use, and your own. Each style is a style prompt plus a demo film made entirely in code by Claude Opus 5.5, with no video model. By Lemomo. · 一套用代码做片的风格工具箱:99 种现成风格,也能做出你自己的Agent skilllemomo-ai19k1d ago—
6PipecatPython framework for voice and multimodal conversational agents built as pipelines of streaming speech, LLM and TTS services.FrameworkDaily17ktodayBSD-2-Clause
7LiveKit AgentsFramework for realtime voice and video agents that join LiveKit rooms, with turn detection and pluggable speech, LLM and TTS providers.FrameworkLiveKit15ktodayApache-2.0
8OpenCreatorFormerly KrillinAI, VideoTranslation and Dubbing Tool for 120+ Languages. Open-source AI workspace for creators, powered by Codex. Video downloader, video translation, create videos, images, audios, and edits with Agents in one place. For your Social Media like YouTube, TikTok, Instagram, etc.Agent skillkrillinai14k1d agoApache-2.0
9VoltAgentTypeScript agent framework with memory, workflows, supervisor/sub-agent patterns and a companion observability console.FrameworkVoltAgent11k15d agoMIT
10ffmpeg-skillLocal FFmpeg video and audio tools over stdio. Footage stays on this machine.MCP serverkajisho59.1ktodayMIT
11AgentsQuickly build text, voice and video agents. Fast, Go based Agent backend with SDKs for every language. Sensible defaults for search, knowledge, skills, telephony, sandboxes, memory and persistence. Sovereign AI. Take control of your AI.Agent projectGetStream8.2ktodayApache-2.0
12ODSODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.Agent projectOsmantic7.9k2d agoApache-2.0
13OpenScreenScreen recorder and video editor. Agents record, trim, zoom, caption, add effects and export.MCP servergetopenscreen7.7ktodayMIT
14vapi-networkBuyer-controlled client for x402 API payments in USDC on Base.MCP servervAPI-Network5.4k1d agoApache-2.0
15earshotSound effects for coding agents: ask in plain words and earshot renders the sound in code. CPU-only, no audio model, open source.Agent projectLeonxlnx5.4k1d agoMIT
16Handsy AILet AI agents see and operate a real iPhone via an ESP32-S3 USB HID + AirPlay. No jailbreak.MCP serveronehumanbeing5.2ktodayMIT
17py-xiaozhiOpen-source AI assistant ecosystem with MCP integrations, multimodal workflows, IoT support, and cross-platform voice interaction.MCP serverhuangjunsen04063.6k12d agoMIT
18anything2explainerTopic in, narrated explainer video out. A Claude Code / Codex skill that turns any topic into a black-canvas motion-graphics explainer video with TTS voiceover, subtitles and a chapter progress bar. Chinese or English; every frame drawn in code with Remotion.Agent skillVincentwei10213.5k2d ago—
19natively-cluely-ai-assistantNatively — Free open-source AI meeting assistant, interview copilot, and note taker. The best alternative to Cluely, Otter, Granola, Final Round AI, Fireflies, and Interview Coder. Real-time transcription, AI meeting notes, lecture recording, local RAG, BYOK, and stealth mode. Runs locally. No subscriptions. No data breaches.Agent skillNatively-AI-assistant3.4ktoday—
20VexaMeeting bot and transcripts for Google Meet, Teams and Zoom. Live or after, speakers labelled.MCP servervexa.ai3.0k8d agoApache-2.0
21claude-code-video-toolkitMake videos with Claude Code: script, AI voiceover, music, video clips and render, on open-source models that cost centsAgent skilldigitalsamba2.7k1d agoMIT
22claude-real-videoLet any LLM watch a video locally — and search everything it has ever watched.MCP serverHUANGCHIHHUNGLeo2.3k1d agoMIT
23pokiPoki uses your iPhone like you do. An open-source agent app that runs on your iPhone, reads the screen, and taps, types and swipes in real apps with your own model account.MCP serverJosssphZhou1.7ktodayAGPL-3.0
24ava-whatsapp-agent-courseMeet Ava, the WhatsApp AgentInfrastructureneural-maze1.7k1y agoMIT
25minutesThe private, owned conversation-memory layer for AI. Record, transcribe, and search every meeting.MCP serversilverstein1.6ktodayMIT
26MiniMax-MCPOfficial MiniMax Model Context Protocol (MCP) server that enables interaction with powerful Text to Speech, image generation and video generation APIs.MCP serverMiniMax-AI1.6k11d agoMIT
27claude-video-visionGive Claude the ability to watch and understand videos — Claude Code plugin with frame extraction and multimodal audio analysisMCP serverjordanrendric1.5k1mo agoMIT
28voicemodeNatural voice conversations for AI assistants - STT/TTS via MCPMCP servervoicemode.dev1.5k1d agoMIT
29xiaozhi-esp32-server-java小智ESP32的Java企业级管理平台,提供设备监控、音色定制、角色切换和对话记录管理的前后端及服务端一体化解决方案MCP serverjoey-zhou1.4k3d agoMIT
30chubbyskills把中文全渠道内容(抖音 / B站 / 小红书 / 公众号 / X / 播客)采集进个人知识库的 14 个 AI Skill:图文存图、视频转文字稿、字幕优先免 GPU、RSS/YouTube 订阅调度与每日情报简报,附带知识库 MCP server。| Ingest Chinese content into your personal knowledge base — image/video routing, subtitle-first transcription, feed subscriptions with daily digests, and a KB MCP server.Agent skillchubbyguan1.3k1mo agoMIT
31PhoneClawPhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.Frameworkkellyvv1.3k3mo agoApache-2.0
32ChatCutAI video editor for agents: cut footage, add captions and motion graphics, export editable edits.MCP serverchatcut.io1.1k3d agoApache-2.0
33anymdAny file → clean Markdown for AI agents: PDF, Office, EPUB, HTML, images, audio/video. Local MCP.MCP serverSylphxAI1.1ktodayMIT
34CitraCitra — PDF answers with page-level proof: structure, tables, OCR, and page citations.MCP serverSylphxAI1.1ktodayMIT
35PDF Reader MCPEvidence-first PDF MCP. Agent Document Twin with citeable page+bbox evidence.MCP serverSylphxAI1.1ktodayMIT
36BoxThe most advanced, fully offline client-side AI suite on Android today.MCP serverjegly1.0ktoday—
37ai-video-editorOpen-source, local-first video editor where creators and AI agents edit the same real timeline.Agent skillMartinDelophy1.0k3d agoMIT
38voice-aiRapida is an open-source, end-to-end voice AI orchestration platform for building real-time conversational voice agents with audio streaming, STT, TTS, VAD, multi-channel integration, agent state management, and observability.Frameworkrapidaai7602d ago—
39claudemyClaudemy: an open-source alternative to Udemy and Coursera. Give Claude a topic, it researches the web and builds a course of 2-minute audio lessons with cited sources. A free Claude Code skill.Pluginassafkip71323d agoMIT
40Audio StudioLocal AI BGM and sound effects with Stable Audio 3 (Apple Silicon MLX, NVIDIA CUDA)MCP serverkanaworksai-hue6965d agoMIT

Most common integrations

Third-party services named by products in this node, whole catalogue.

IntegrationProducts Share
YouTube244.4%
WhatsApp30.5%
Android20.4%
Solana20.4%
Stripe20.4%
Discord10.2%
Docker10.2%
GitHub10.2%
Godot10.2%
Google Ads10.2%
Google Workspace10.2%
LinkedIn10.2%
PostgreSQL10.2%
Reddit10.2%
Slack10.2%

Launches per month

New Audio & Speech products per monthSRC

Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.

New Audio & Speech products per monthWhole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.. Products published: 20 points, latest 104 products in 2026-11.
Show the data as a table
New Audio & Speech products per month. Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.
Products published (products)
2024-112
2024-122
2025-022
2025-042
2025-051
2025-082
2025-094
2025-102
2025-122
2026-016
2026-029
2026-0315
2026-0421
2026-0527
2026-0639
2026-0736
2026-0853
2026-0952
2026-10155
2026-11104

Related opportunities

Opportunity radar

Scored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.

No scored opportunity here

Capability gaps are only scored inside subcategories with at least 20 indexed products, and only the top 80 are kept. None falls under this node.

Limits of these numbers

  • Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
  • About half of the catalogue matches no node at all, so absolute counts understate every category.
  • Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
  • Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.

Page data last updated .