← All repositories

chatter-box-dubbing

11 commits · main

README.md

—Screenshot 2025-06-04 132426

Screenshot 2025-06-04 132418

# 🎭 Chatterbox TTS Pro (SUP3R Edition)

**Chatterbox TTS Pro** is a high-quality, customizable text-to-speech (TTS) system enhanced with voice presets, advanced audio effects, conversation mode, and **AI video dubbing**. This is a fork of [Resemble AI's Chatterbox](https://github.com/resemble-ai/chatterbox), extended with additional audio controls, export options, and a powerful UI via Gradio.

---

## 🚀 Features

- 🎤 **Voice Presets**  
  Save and load voice settings including reference audio for fast reuse.

- 🎛️ **Advanced Audio Effects**  
  Add reverb, echo, pitch shifting, equalizer, 3D spatialization, and noise reduction.

- 🧠 **Conversation Mode**  
  Generate multi-speaker dialogues with different voice presets.

- 🎬 **AI Video Dubbing** ⭐ NEW!  
  Automatically dub videos into multiple languages with AI translation and voice synthesis.

- 📦 **Export Options**  
  Export audio in high/medium/low quality WAV formats.

- 🎚️ **Dynamic Controls**  
  Modify chunk size, temperature, seed, and more to fine-tune output.

---

## 🛠️ Installation

```bash
git clone https://github.com/SUP3RMASS1VE/chatterbox-SUP3R.git
cd chatterbox-SUP3R
python -m venv venv
venv\Scripts\activate
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128
pip install -r requirements.txt

▶️ Usage

Run the app with:

python app.py

This will launch a Gradio-based interface in your browser where you can:

  • Text-to-Speech Tab: Enter text and generate speech with advanced effects
  • Video Dubbing Tab: Upload videos and automatically dub them into multiple languages
  • Upload reference audio for voice cloning
  • Enable advanced audio effects and 3D spatialization
  • Save/load/delete voice presets
  • Generate conversations between multiple speakers

🎬 Video Dubbing Setup

For the video dubbing feature, you’ll need:

  1. Parakeet ASR Model: 
    pip install nemo_toolkit[asr]
  2. Google Gemini API Key:
    • Get a free API key from Google AI Studio
    • Add it in the “API Management” section of the Video Dubbing tab
  3. FFmpeg: For video processing (usually included with most systems)

📁 File Structure

  • app.py — Main application logic
  • voice_presets.json — Stores saved voice preset metadata
  • saved_voices/ — Stores reference audio files
  • exports/ — Output directory for exported audio

💬 Conversation Mode Format

Use this format to define dialogues:

Alice: Hey Bob, how's it going?
Bob: Doing great! Just testing Chatterbox.
Alice: Awesome, it sounds incredible.

🙏 Acknowledgments

Big thanks to the original creators of Chatterbox: 👉 Resemble AI for their groundbreaking work in controllable TTS.

📜 License

This project is provided under the original license of the upstream chatterbox. Check their repository for licensing details.


Let me know if you’d like a more developer-focused or user-focused version!

Commit history

Files

21 tracked files at main.

  • .gitignore
  • app.py
  • ENVIRONMENT
  • example_for_mac.py
  • example_tts.py
  • example_vc.py
  • gemini.md
  • icon.png
  • install.json
  • link.js
  • pinokio.js
  • pinokio_meta.json
  • README.md
  • requirements.txt
  • reset.js
  • setup.py
  • start.json
  • test_dubbing.py
  • test_parakeet.py
  • torch.js
  • update.js