YouTube Control
for AI Agents

Drive YouTube experiences with Agents. Loop, seek, sequence clips, and search transcripts, all with a prompt.

Put it to work

Precise, hands-off playback for the way you actually watch.

Music practice

Loop a tricky passage and ramp the speed up pass by pass, hands-free.

Language learning

Slow a sentence down and jump to every place a phrase is spoken.

Study & notes

Summarize a lecture from its transcript and save timestamps to revisit.

Cooking & how-tos

Turn a recipe or tutorial into written steps β€” or a clip reel of the key parts.

Shorts & clips

Mine a long video for short-form ideas and pull the exact clips.

Skip the filler

Find the sponsor reads in a long podcast and jump past them to the real content.

Capabilities

A–B section loops

Repeat a passage N times, with optional per-pass speed ramps (0.5Γ— β†’ 0.75Γ— β†’ 1.0Γ—) β€” built for practicing music or language.

Clip sequences

Play a list of segments back-to-back, skipping the gaps between them. Returns instantly; the sequence runs in the browser.

Named timestamps

Save labeled positions and loopable sections per video, then jump straight to them by name later.

Saved-video library

Build and search a personal library of videos stored locally, and open any of them in a managed tab.

Transcript search

Find a word or phrase in the captions and jump straight to where it’s said β€” timestamps with context, fetched server-side.

Parallel sessions

Run several agent sessions at once β€” each drives its own YouTube tab in parallel, playing different videos side by side.

How it works

One broker owns the localhost port and routes each session to its own tab. Every server shares a single library on disk.

stdio ws :8765 shared SQLite library library.db Β· WAL AI agent MCP client one per session playback-mcp MCP server broker 127.0.0.1:8765 extension Chrome browser tab <video> one per session stdio ws :8765 SQLite library.db AI agent MCP client playback-mcp MCP server broker 127.0.0.1:8765 extension Chrome browser tab <video>

Install

Node 24 LTS and Chrome. Two minutes, no build.

  1. Install the server

    One global npm package β€” no clone, no build.

    $ npm i -g playback-mcp
  2. Add the extension

    Install Playback MCP from the Chrome Web Store β€” one click, and it stays up to date automatically.

    Running a custom YT_BRIDGE_PORT? The Web Store build bakes in port 8765, so build from source instead β€” see the README.

  3. Register it with your MCP client

    Any MCP client works. For Claude Code, for example:

    $ claude mcp add playback-mcp -- playback-mcp

    Other clients register a command the same way β€” point them at playback-mcp. Or use a project-scoped .mcp.json at your repo root β€” see the README.

  4. Open a video and ask

    Navigate to a YouTube video and ask your agent to control it β€” β€œpause it,” β€œloop the chorus twice at 0.75Γ—,” β€œfind where they mention hooks.”

Local-first & safe

Bot-safe

The extension only reads and writes the <video> element’s own properties β€” current time, rate, volume, play/pause. It never clicks UI, never scrapes, and never automates navigation beyond opening a watch URL.

Private

Everything runs on 127.0.0.1. Your saved videos and timestamps live in a local SQLite database on your own computer. This extension sends nothing to any external server.