Skip to content

Audio Description for Videos

Add spoken descriptions of on-screen action to videos.

Advanced24h2–3 people17/20 fit
TL;DR

Build Audio Description for Videos for blind and low-vision viewers in ~24h with 2–3 people. Stack: Vision LLM + FFmpeg + TTS.

Why it wins: Strong accessibility with multimodal AI.

Build flow

01 · Problem
Most online videos have no audio description.
02 · Solution
Detect scene changes, describe key frames with a vision model, fit descriptions into pauses and voice them.
03 · Build
  1. 1Extract frames
  2. 2Describe
  3. 3Align to gaps
  4. 4Mix audio
04 · Demo
Play a clip with generated descriptions.

MVP checklist

  • Scene detection
  • Frame descriptions
  • Pause fitting
  • Voice track

Tech stack

TechRole
Vision LLMImage understanding
FFmpegTooling
TTSText-to-speech

Related ideas

More Social Good