OpenVoice

I am super impressed by the quality of voice cloning offered by Eleven Labs and Play.ai. I feel like I see impressive OSS demos on social frequently, but last weekend I took a few popular ones for a spin and quality wasn't even close to the proprietary models. https://github.com/coqui-ai/tts https://github.com/serp-ai/bark-with-voice-clone https://github.com/metavoiceio/metavoice-src https://github.com/myshell-ai/OpenVoice https://github.com/collabora/WhisperSpeech https://github.com/neonbjb/tortoise-tts Has anyone else had success with these? Are there other projects I should look at?

Given the inevitability of easy voice cloning[1], it seems irresponsible to be using voice as a positive authentication signal. Unfortunately, major US financial institutions seem to be ramping up adoption of this technology[2]. Am I missing something? [1] https://github.com/myshell-ai/OpenVoice [2] https://www.schwab.com/voice-id [3] https://www.fidelity.com/security/fidelity-myvoice/overview

The quality here is good (very good if I can actually run it locally). As per github it looks like we can run it locally. https://github.com/myshell-ai/OpenVoice/blob/main/docs/USAGE...

GitHub link: https://github.com/myshell-ai/OpenVoice

In their README in the GitHub repository as well as the paper. I opened an issue [0] and it looks like they've updated their README, at least, to reflect that it's not open source. [0] https://github.com/myshell-ai/OpenVoice/issues/16

At least right now, there is a literal add_watermark function, so probably easy enough to remove that surface level. Unless they added something cute to the training data to poison the well. https://github.com/myshell-ai/OpenVoice/blob/a33963c3d764bee...

License[0]: This repository is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which prohibits commercial usage. MyShell reserves the ability to detect whether an audio is generated by OpenVoice, no matter whether the watermark is added or not. [0] https://github.com/myshell-ai/OpenVoice

Thanks for the link to the repo. It's very useful. As for the checkpoint, I'm not allergic and I don't do security theater: https://github.com/myshell-ai/OpenVoice?tab=readme-ov-file#i... links to https://myshell-public-repo-hosting.s3.amazonaws.com/checkpo...

As you say, right at the bottom https://github.com/myshell-ai/OpenVoice

Github: https://github.com/myshell-ai/OpenVoice Demo: https://research.myshell.ai/open-voice

GitHub: https://github.com/myshell-ai/OpenVoice Checkpoint: hxxps://myshell-public-repo-hosting.s3.amazonaws.com/checkpoints_1226.zip (Checkpoint link defanged because I’m allergic to direct links to zip files hosted on Amazon. Nor have I reviewed what the file contains.)