Skip to content

PredictiveManish/ai-caption-generator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

14 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐ŸŽฌ AI Video Caption Generator

A simple web app that automatically generates subtitles for videos using AI.

Built with Streamlit, OpenAI Whisper, and MoviePy.


๐Ÿš€ Features

  • ๐Ÿ“ค Upload video files (MP4, MOV, AVI, MKV)
  • ๐ŸŽง Extract audio from video
  • ๐Ÿง  Transcribe speech using Whisper (multilingual support)
  • ๐Ÿ“ Generate subtitles in SRT format
  • ๐ŸŽฌ Burn subtitles directly onto video
  • ๐Ÿ“ฅ Download SRT file and final video

๐Ÿง  How It Works

  1. Upload a video
  2. Audio is extracted using MoviePy
  3. Whisper model converts speech โ†’ text
  4. Transcription is converted into SRT subtitles
  5. Subtitles are added to video
  6. Download results

๐Ÿ› ๏ธ Tech Stack

  • Python
  • Streamlit (UI)
  • Whisper (speech-to-text)
  • MoviePy (video processing)
  • SRT (subtitle formatting)
  • Pydub (audio handling)

๐Ÿ“ฆ Installation

pip install -r requirements.txt

(Better is to create a virtual environment before this command either using venv or conda)

โ–ถ๏ธ Run the App

streamlit run app.py

๐Ÿ“ Supported Formats

  • Video: MP4, MOV, AVI, MKV

  • Output:

    • .mp4 (video with subtitles)
    • .srt (subtitle file)

โš ๏ธ Notes

  • Processing time depends on video length and model size
  • Whisper runs locally (no API required)
  • Large videos may take longer to process

๐Ÿ”ฎ Future Improvements

  • Better subtitle styling (fonts, colors)
  • GPU acceleration for faster processing
  • Real-time captioning
  • Multi-language subtitle export

๐Ÿ™Œ Acknowledgements

  • OpenAI Whisper for speech recognition
  • MoviePy for video processing
  • Streamlit for UI framework

๐Ÿ“Œ Author

Manish Tiwari (predictivemanish) (Built as part of learning AI & real-world applications)

About

This project will help you in generating directly captions through a streamlit dashboard.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages