HackerReposA FIELD GUIDE TO OPEN SOURCE
ProSponsor the shelf♧ 0
← Back to top all-time
neonbjb
tortoise-tts
Jupyter Notebook2022–2025
neonbjb / tortoise-tts

tortoise-tts

A multi-voice TTS system trained with an emphasis on quality

42Distinct people
48Mentions
0Explicit recommenders
14.9KGitHub stars
REPOSITORY AT A GLANCE

What to know before exploring

What it is

A multi-voice TTS system trained with an emphasis on quality

GitHub

Where it is used

No documented product use was verified in the last source check.

What people are saying

No recommendation phrase was found in the indexed comments.

No classified warning is attached to this page. Read the discussions before treating silence as approval.

Also in these discussions

No other repository is repeatedly linked in the same discussions.

This week on Hacker News

Nov 9–Nov 16 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/16/2026, 8:59:02 AM UTC.

No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.

Mentions over time

HN mentions by year48 dated mentions

Observed mentions: 2022-04-27 16:27:43 UTC to 2025-03-16 01:29:35 UTC.

01020302022-01-01 00:00:00 UTC to 2023-01-01 00:00:00 UTC (exclusive): 12 mentions; 2 submissions, 10 comments20222023-01-01 00:00:00 UTC to 2024-01-01 00:00:00 UTC (exclusive): 26 mentions; 4 submissions, 22 comments20232024-01-01 00:00:00 UTC to 2025-01-01 00:00:00 UTC (exclusive): 9 mentions; 1 submissions, 8 comments2025-01-01 00:00:00 UTC to 2026-01-01 00:00:00 UTC (exclusive): 1 mentions; 0 submissions, 1 comments2025

Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.

View mention counts and date ranges
UTC ranges include their start and exclude their end. Select a period to filter the source evidence.
PeriodStart (UTC)End (exclusive, UTC)MentionsSubmissionsComments
20222022-01-01 00:00:00 UTC2023-01-01 00:00:00 UTC12210
20232023-01-01 00:00:00 UTC2024-01-01 00:00:00 UTC26422
20242024-01-01 00:00:00 UTC2025-01-01 00:00:00 UTC918
20252025-01-01 00:00:00 UTC2026-01-01 00:00:00 UTC101

From the project README

An excerpt from the repository, fetched Nov 13, 2026.

Read the project’s introduction
TorToiSe Tortoise is a text-to-speech program built with the following priorities: Strong multi-voice capabilities. Highly realistic prosody and intonation. This repo contains all the code needed to run Tortoise TTS in inference mode. Manuscript: https://arxiv.org/abs/2305.07243 Hugging Face space A live demo is hosted on Hugging Face Spaces. If you'd like to avoid a queue, please duplicate the Space and add a GPU. Please note that CPU-only spaces do not work for this demo. https://huggingface.co/spaces/Manmay/tortoise-tts Install via pip pip install tortoise-tts If you would like to install the latest development version, you can also install it directly from the git repository: pip install git+https://github.com/neonbjb/tortoise-tts What's in a name? I'm naming my speech-related repos after Mojave desert flora and fauna. Tortoise is a bit tongue in cheek: this model is insanely slow. It leverages both an autoregressive decoder and a diffusion decoder; both known for their low sampling rates. On a K80, expect to generate a medium sized sentence every 2 minutes. well..... not so slow anymore now we can get a 0.25-0.3 RTF on 4GB vram and with streaming we can get < 500 ms latency !!! Demos See this page for a large list of example outputs. A cool application of Tortoise + GPT-3 (not affiliated with this repository): https://twitter.com/lexman_ai. Unfortunately, this project seems no longer to be active. Usage guide Local installation If you want to use this on your own computer, you must have an NVIDIA GPU. TipOn Windows, I highly recommend using the Conda installation method. I have been told that if you do not do this, you will spend a lot of time chasing dependency problems. First, install miniconda: https://docs.conda.io/en/latest/miniconda.html Then run the following commands, using anaconda prompt as the terminal (or any other terminal configured to work with conda) This will: create conda environment with minimal dependencies specified activate the environment install pytorch with the command provided here: https://pytorch.org/get-started/locally/ clone tortoise-tts change the current directory to tortoise-tts run tortoise python setup install script conda create --name tortoise python=3.9 numba inflect conda activate tortoise conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia conda install transformers=4.29.2 git clone https://github.com/neonbjb/tortoise-tts.git cd tortoise-tts python setup.py install Optionally, pytorch can be installed in the base environment, so that other conda environments can use it too. To do this, simply send the conda install pytorch... line before activating the tortoise environment. NoteWhen you want to use tortoise-tts, you will always have to ensure the tortoise conda environment is activated. If you are on windows, you may also need to install pysoundfile: conda install -c conda-forge pysoundfile Docker An easy way to hit the ground running and a good jumping off point depending on your use case. git clone https://github.com/neonbjb/tortoise-tts.git cd tortoise-tts docker build . -t tts docker run --gpus all \ -e TORTOISE_MODELS_DIR=/models \ -v /mnt/user/data/tortoise_tts/models:/models \ -v /mnt/user/data/tortoise_tts/results:/results \ -v /mnt/user/data/.cache/huggingface:/root/.cache/huggingface \ -v /root:/work \ -it tts This gives you an interactive terminal in an environment that's ready to do some tts. Now you can explore the different interfaces that tortoise exposes for tts. For example: cd app conda activate tortoise time python tortoise/do_tts.py \ --output_path /results \ --preset ultra_fast \ --voice geralt \ --text "Time flies like an arrow; fruit flies like a bananna." Apple Silicon On macOS 13+ with M1/M2 chips you need to install the nighly version of PyTorch, as stated in the official page you can do: pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu Be sure to do that after you activate the environment. If you don't use conda the commands would look like this: python3.10 -m venv .venv source .venv/bin/activate pip install numba inflect psutil pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cpu pip install transformers git clone https://github.com/neonbjb/tortoise-tts.git cd tortoise-tts pip install . Be aware that DeepSpeed is disabled on Apple Silicon since it does not work. The flag --use_deepspeed is ignored. You may need to prepend PYTORCH_ENABLE_MPS_FALLBACK=1 to the commands below to make them work since MPS does not support all the operations in Pytorch. do_tts.py This script allows you to speak a single phrase with one or more voices. python tortoise/do_tts.py --text "I'm going to speak this" --voice random --preset fast do socket streaming python tortoise/socket_server.py will listen at port 5000 faster inference read.py This script provides tools for reading large amounts of text. python tortoise/read_fast.py --textfile <your text to be read> --voice random read.py This script provides tools for reading large amounts of text. python tortoise/read.py --textfile <your text to be read> --voice random This will break up the textfile into sentences, and then convert them to speech one at a time. It will output a series of spoken clips as they are generated. Once all the clips are generated, it will combine them into a single file and output that as well. Sometimes Tortoise screws up an output. You can re-generate any bad clips by re-running read.py with the --regenerate argument. API Tortoise can be used programmatically, like so: reference_clips = [utils.audio.load_audio(p, 22050) for p in clips_paths] tts = api.TextToSpeech() pcm_audio = tts.tts_with_preset("your text here", voice_samples=reference_clips, preset='fast') To use deepspeed: reference_clips = [utils.audio.load_audio(p, 22050) for p in clips_paths] tts = api.TextToSpeech(use_d
Read the full README on GitHub

What Hacker News says

12 sources
pjmq·Oct 12, 2022Submission

Ask HN: What is the best open source text to speech solution

I've been on the hunt for the best open TTS solution that balances quality of output with performance, for semi-realtime application in a project of mine. The absolute best project I've found thus far in terms of output is https://github.com/neonbjb/tortoise-tts but it A) requires an enormous amount of GPU horsepower and B) even with that, a single autoregressive sample, whose text input is less than the length of a tweet, takes 5-10 minutes of compute time to produce. So my question is, what projects have you all come across that strike that balance between good enough quality and fast time to result?
2 points · Open discussion
This blog is by the author of Tortoise-TTS (stylised as TorToiSe): https://github.com/neonbjb/tortoise-tts Very cool work being done in ML these days, both inside large corps, and also by independent researchers/"hobbyists" (quotation marks because there is some really expert work being produced by them). And from yesterday, an open-source version of Google's Imagen by lucidrains: https://github.com/lucidrains/imagen-pytorch
In Friends don’t let friends train small diffusion models
> I wonder if a style-transfer style algorithm could be used to map the intent of a sentence to a simulated voice. There's definitely research/proprietary software that can enable a person speaking in desired manner to have their voice control the expression of the generated speech. Here's a related issue on a Open Source text to speech project which I only learned of today: https://github.com/neonbjb/tortoise-tts/issues/34#issue-1229... > I tend to view most of these things through the perspective of what would help mod-maker's for video games Yeah, I think there's some really cool potential for indie creatives to have access to (even lower quality) voice simulation--for use in everything from the initial writing process (I find it quite interesting how engaging it is to hear one's words if that's going to be the final form--and even syn
Read the rest
thesis artifacts can prompt an emotion or thought to develop); to placeholder audio; and, even final audio in some cases. > (and I suspect various open source voice sample sets would become pretty popular). That's definitely a powerful enabler for Free/Open Source speech systems. There's a list of current data sets for speech at the "Open Speech and Language Resources" site: https://openslr.org/resources.php Encouraging people to provide their voice for Public Domain/Open Source use does come with some ethical aspects that I think people need to be made aware of so they can make informed decisions about it. Given your interest in this topic you might be interested in this (rough) tool I finally released last week: https://rancidbacon.itch.io/dialogue-tool-for-larynx-text-to...
In NaturalSpeech: End-to-end text to speech synthesis with human-level quality

MAKE YOURSELF AT HOME

A few shortcuts

/
Search the collection
?
Open this guide
Esc
Close dialogs and navigation

Your saved repositories and interests stay in this browser.