Cue
Video answers with timestamp-level proof
Cue gives agents a local video timeline they can search and cite: streams,chapters, subtitles, scenes, frames, and exact timestamps.
npx -y @sylphx/cue
For Claude Code:
claude mcp add cue -- npx -y @sylphx/cue
The fastest useful workflow
{
"sources": [{ "path": "/absolute/path/to/demo.mp4" }],
"include_subtitles": true
}
Then ask:
“Find the moment where the presenter explains the pricing change.”
Cue returns the matching timestamp, surrounding transcript, source hash, anda route to render or crop the exact frame.
Jobs Cue is built for
| Ask your agent | Cue returns |
|---|---|
| “Find this quote.” | timestamped transcript evidence |
| “Summarize this meeting.” | chapters and subtitle-backed notes |
| “Where is the code shown?” | timestamped frame and crop evidence |
| “What changed in this demo?” | timeline and structural scene boundaries |
| “Give me the useful moments.” | compact timeline with warnings and gaps |
Tool surface
| Tool | Purpose |
|---|---|
read_video |
Build a local timeline from streams, subtitles, scenes, and keyframes |
search_video |
Search subtitles/transcripts and return timestamped matches |
video_evidence |
Render, crop, or OCR a frame at a known timestamp |
Predictable defaults
fastprobes streams and reads embedded metadata/subtitles.qualityexplicitly requests scene detection, keyframes, OCR, or local ASR.- No cloud video API or frame-by-frame vision model is required.
- Missing ffprobe, subtitles, or ASR is reported as a gap, not guessed around.
Why agents trust it
Every claim can point back to timestamp_ms, stream index, subtitle range,frame index, or source hash. Structural keyframes are preferred over samplingevery frame.
Companion MCP tools
| Product | Job |
|---|---|
| Citra | PDF answers with page-level proof |
| Iris | Image facts and pixel evidence |
| Spine | Repository architecture and impact |
| Locus | Exact code-chunk retrieval |
| Lookout | Web research with source excerpts |
Each product is independent. Install only the tools your agent needs.
Development
bun install
bun run build
bun test
cargo test
bun run benchmark:public-proof
bun run benchmark:release-gate
License
MIT