Skip to content

Python CLI App that generates subtitles for any video files using Google Cloud Speech to text and Cloud Translate API. Refactored to use with Python 3 and latest Google Cloud libraries.

License

Notifications You must be signed in to change notification settings

sukso96100/autosub

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

98 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Autosub

Auto-generated subtitles for any video

Autosub is a utility for automatic speech recognition and subtitle generation. It takes a video or an audio file as input, performs voice activity detection to find speech regions, makes parallel requests to Google Web Speech API to generate transcriptions for those regions, (optionally) translates them to a different language, and finally saves the resulting subtitles to disk. It supports a variety of input and output languages (to see which, run the utility with the argument --list-languages) and can currently produce subtitles in either the SRT format or simple JSON.

Installation

  1. Install ffmpeg.
  2. Run pip install git+https://github.com/sukso96100/autosub.

Generate Google Cloud Credential file

  • Install Google Cloud SDK
  • Run gcloud init to log in, initilize and select Google Cloud project for local environment
  • Enable required API (Speech to text, Translation API)
gcloud services enable speech.googleapis.com texttospeech.googleapis.com translate.googleapis.com 
  • Create service account
gcloud iam service-accounts create ml-dev --description="ML APIs developer access" --display-name="ML Developer Service Account"
  • Grant ML Dev and project viewer role to the service account
gcloud projects add-iam-policy-binding <your_google_cloud_project_id> --member serviceAccount:ml-dev@<your_google_cloud_project_id>.iam.gserviceaccount.com --role roles/ml.developer
gcloud projects add-iam-policy-binding <your_google_cloud_project_id> --member serviceAccount:ml-dev@<your_google_cloud_project_id>.iam.gserviceaccount.com --role roles/viewer
  • Create JSON credential file for service account
gcloud iam service-accounts keys create ./ml-dev.json --iam-account ml-dev@<your_google_cloud_project_id>.iam.gserviceaccount.com

Usage

Set GOOGLE_APPLICATION_CREDENTIALS environment variable

export GOOGLE_APPLICATION_CREDENTIALS=./credential.json
$ autosub -h
usage: autosub [-h] [-C CONCURRENCY] [-o OUTPUT] [-F FORMAT] [-S SRC_LANGUAGE] [-D DST_LANGUAGE] [-P PROJECT_ID]
               [-L LOCATION] [-M MODEL] [--list-formats] [--list-languages]
               [source_path]

positional arguments:
  source_path           Path to the video or audio file to subtitle

optional arguments:
  -h, --help            show this help message and exit
  -C CONCURRENCY, --concurrency CONCURRENCY
                        Number of concurrent API requests to make
  -o OUTPUT, --output OUTPUT
                        Output path for subtitles (by default, subtitles are saved in the same directory and name as
                        the source path)
  -F FORMAT, --format FORMAT
                        Destination subtitle format
  -S SRC_LANGUAGE, --src-language SRC_LANGUAGE
                        Language spoken in source file
  -D DST_LANGUAGE, --dst-language DST_LANGUAGE
                        Desired language for the subtitles
  -P PROJECT_ID, --project-id PROJECT_ID
                        Your Google Cloud Project ID
  -L LOCATION, --location LOCATION
                        Google Cloud region id(e.g. us-central1)
  -M MODEL, --model MODEL
                        Speech regocnition model(default, video, phone_call, command_and_search
  --list-formats        List all available subtitle formats
  --list-languages      List all available source/destination languages

Command example

autosub -F srt -S en -D ko -P my-gcp-project -L us-central1 -M default video.mp4

License

MIT

About

Python CLI App that generates subtitles for any video files using Google Cloud Speech to text and Cloud Translate API. Refactored to use with Python 3 and latest Google Cloud libraries.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%