Skip to content

🔉 Audio Cloning and Translation Web App

Notifications You must be signed in to change notification settings

RobCaamano/VocalAIze

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

99 Commits
 
 
 
 

Repository files navigation

VocalAIze

Sections

About

VocalAIze is a comprehensive web application that combines advanced voice cloning, translation, SMS/email integration, and audio management functionalities in one intuitive platform. Whether you're a language learner, a globetrotting traveler, or a busy professional, our app has something for everyone:

  • Voice Cloning and Translation: Instantly clone your voice and translate it into multiple languages with unparalleled accuracy. Break down language barriers and communicate effortlessly with friends, family, and colleagues around the world.

  • SMS/Email Integration: Seamlessly send voice messages via SMS or email, adding a personal touch to your digital communications. Express yourself more authentically and convey emotions and nuances that text alone cannot capture.

  • Audio Management: Easily save and organize your audio recordings for language learning, professional communication, or personal organization. Keep all your voice notes, memos, and conversations in one convenient location for easy access and reference.

Please note that VocalAIze is no longer being hosted as a web application. It was solely funded by our team and is now available as a command line script. This script allows you to leverage the original voice cloning and translation technology independently, ensuring you can still benefit from our advanced features regardless of the web application’s status.

Our Team

Rob Caamano Samin Chowdhury Zion Bolognese David Felix

WebApp Demo

demo.vid.mp4

Translation Demo

Original Audio

audio.mp4

Translated Audio (Spanish)

audio-translation.mp4

Using CMD Translation Script

Since VocalAIze is no longer being hosted, I've created a simple command line version with the original voice cloning and translation technology

How to use:

Before running the script, ensure you have Python installed on your machine. You can download Python from the official website.

  1. Clone the repository to your local machine
git clone https://github.com/RobCaamano/VocalAIze.git
  1. Navigate to the project directory and download 'requirements.txt'. It is recommended to do this in a virtual environment. For information about creating and using conda environments, visit their site.
cd '[path to dir]'
pip install -r requirements.txt
  1. Ensure you have a compatible GPU and CUDA installed. The script uses CUDA for acceleration, so you need to have a GPU with CUDA support and the appropriate CUDA toolkit installed. Follow the CUDA installation guide for details.

       Note: The time required for the script to complete depends on the computational power of your GPU.

  1. Run the script in your virtual environment
python ./translate.py
  1. Follow the on-screen prompts to select languages

  2. Select input audio file from file explorer

The file will be opened upon completion and will be saved to the "saved" folder in the project directory.

Frontend & Backend Repository Links

Frontend

Backend

Coqui Terms of Service

By using this project, you agree to the Coqui Terms of Service.