You're very welcome and thanks for the update 😊.

This is great news! :D You probably should make another video comparing the quality differences between the 6 seconds and 30 seconds input audio! (or maybe more, if you can change that max value in the local installation) ^^ @@ThorstenMueller

@@juanjesusligero391 An audio samples comparison video with different audio input length is already in the making 😉.

Does the output sound better with longer audio? I tried the Japanese version on hugging face and output sounded robotic.

​@@tsunderes_were_a_mistake In my german model i didn't encounter a change depending on the text length. But i did not exactly check this specific aspect. If you think this would be helpful i can give it a more specific try (with a german model). But i can't say anything about the Japanese model.

Thank you for your nice feedback 😊. I'm really curious to see where quality is going in near future.

Thanks a lot for your nice feedback 🥰.

I'm excited too 😊.

Thank you, happy to hear that 😊.

😂 maybe cuda is exactly my problem on windows🤷‍♂

Thanks and you're welcome 😊. I'm happy if people find my videos helpful.

Thank you for your nice comment. I wish you all the best, too 😊.

Das freut mich sehr 😊.

Wow, thanks a lot for your nice feedback 😊.

Thank you a lot for your kind feedback - this keeps me motivated 😊

Hi 👋. Thanks for your kind feedback on my content 😊. You're right, we are not alone on AI content 😆.

Pretty much 95% of youtube and the working class are against AI lmfao but keep daydreaming

Dem kann ich mich anschließen 😊.

Thanks for your comment 😊. I didn't compare the performance between XTTS and Piper TTS. I guess when you want a free and best voice clone i'd go with Piper TTS right now, but the effort is higher - as you said.

Thanks for your nice feedback 😊. This topic is already on my (growing) TODO list.

Good question. I didn't think about that - up to now.

Did you install CUDA and is it working? There are Python code sniplets available to check if CUDA is working.

I've no idea how this could work. Maybe it helps if you use audio tools to cut out your breathing from the recording you provide to XTTS. Or maybe there are audiofilters like sox or ffmpeg that can remove breathing sounds from the generated audio.

Sure, it's a code editor from Microsoft, called "Visual Studio Code".

Vielen Dank für deine tolle Rückmeldung und den Vorschlag 😊. Das Thema gefällt mir sehr gut. Wenn man sich so lange und intensiv mit einem Thema beschäftigt, dann werden diese "Grundlagen" irgendwie so normal, dass man gar nicht mehr drüber nachdenkt. Ich habe das Thema auf meine TODO Liste gesetzt. Besten Dank dafür 😊.

Did you use a python venv? Is this activated when try to run "tts" command? Does "pip list" show you an installed TTS package?

Thanks for your nice feedback 😊. Hmm, not really. Earlier we sometimes run into a "max_decoder_steps" which caused truncated audio, but i'm not sure if this applies here too.

Ei subba, freut mich', dass des Video gefällt :) According to my talk with co-founder of Coqui AI, Josh Meyer, the model is optimized for a 6 second audio input. Before trying longer audio input try using other 6 second clips.

Personally i prefer Piper. But i trained my models in piper with way more input data then the 6 seconds input to xtts.

Vielen Dank für das Lob - das freut mich sehr 😊. Eine fertige Lösung für Text/Word/PDF Input gibt es (glaube ich) nicht, aber generell kannst Du längeren Output erzeugen. Du musst den Eingabetext vielleicht aufteilen, aber sicherlich gehen deutlich mehr als 6 Sekunden.

Vielen Dank für deine tolle Rückmeldung 😃. In den Tests war in der Audioausgabe kaum ein Unterschied hörbar, dafür aber war der Rechenaufwand bei bspw. 44kHz merklich höher.

@@ThorstenMueller Danke für die Info. Elevenlabs will ja für ein Professional Voice Cloning auch nur 128kbps mp3 und meint, dass kein Nachteil feststellbar ist. Sehr interessant, wie die AI das verarbeitet.

Welchen Preis? 1$ am Tag für Unternehmen sonst ist es Kostenlos.

Normally generated output is the same samplerate as the voice dataset the model has been trained on. Maybe you can use tools like ffmpeg to adjust samplerate afterwards, but i doubt if this will increase the quality.

@@ThorstenMueller I need to train my own model in 48KHz, so the output will be more quality

I didn't heard about Applio TTS. You say it's worth giving it a try?

Does it work if you use it with "use_cuda false" in general?

I'm not sure about that. I'd recommend asking on Coqui community, but as Coqui AI (the company) has shut down i'm not sure on how fast you might get an answer.

Meinst Du die GUI von Huggingface?

@@ThorstenMueller ja, ich meinte generell irgendeine GUI

As i'm not sure, i'd recommend asking on Coqui community on github. But as Coqui AI (the company) has shut down, i'm not sure on how fast you might get a reaction.

Do you mean the Huggingface UI from the video?

@@ThorstenMueller Yes

Hard to say, as i didn't give Tortoise TTS a closer look, but it's still on my todo list.

That's strange. Maybe recreate your python venv and reinstall. Maybe there's an error in your installation.

I guess you're doing nothing wrong. Maybe the english model has been trained on a voice dataset with hours of native english speaking people and one phrase has not enough "power" to change the accent. Normally i'd recommend asking in Coqui TTS community, but as Coqui is shutting down, it might take some time to get an answer, because of other priorities maybe.

I didn't try it with such long texts. Is it faster when you split it into smaller pieces and put the chunks together in post generation?

Did you update pip to latest version first - "pip install pip setuptools wheel -U"?

No, not yet. But interesting idea. I've added it on my TODO list 😊.

No. But as Coqui (company) shut down i'm not sure on further development of their code. Maybe it's worth taking a look to Piper TTS for training an Indonesian tts model. kzfaq.info/get/bejne/mMWnmMKb0seWYmQ.html

According to the error message the XTTS container does not have enough compute power on Huggingface platform. This might be a temporary problem or might relate to the shutdown of Coqui AI as a company.

@@ThorstenMueller Thanks for your reply! I hope it's not the later, It's the only free and online option that I knew of 😓

Hehe, thanks for your suggestion. I'll keep it in mind for next videos. As a non-native english speaker i have to think a little while for the right words 😆.

IMHO this isn't supported by now. But finding a suitable solution for that is on my TODO list.

@@ThorstenMueller For some reason my reply keeps getting deleted. Anyhow, I run a local TTS that can pull from a text file. Maybe it will help you. It is by neonbjb on Github.

@john_blues You can totally read in, one or muliple files via python, transform the text as you like, and use xtts to generate a synthetic speech audiofile from it. Im using i currently to create sort of a audobook from a fanfiction. Removing points at end of sentences improved the result quite a lot.

Bei den Coqui TTS Modellen gibt es einen Kommandozeilenparameter "--use_cuda". Damit sollte die GPU genutzt werden. Zur Länge kannst Du mal versuchen die Konfigurationsdatei des Modells zu öffnen und den Wert von "max_decoder_steps" zu erhöhen (habe ich aber bei XTTS selber noch nicht versucht). Viel Erfolg 😊.

@@ThorstenMueller danke. Das werde ich heute Abend mal versuchen. Wo genau finde ich die Konfigurationsdatei? Ist das die configs.py im TTS Ordner? Gibt es auch eine Möglichkeit, die Fehler am Ende von Sätzen und in den Stellen zwischen den Sätzen zu vermeiden? Oft entstehen da auch eine Art Geisterstimmen, die echt seltsam klingen xD

@@IngridUterus Hast Du die config Datei gefunden?

@@ThorstenMueller Ja, ich habe eine bessere variante für coqui-tts gefunden, die wesentlich einfacher für Anfänger ist. Kann ich dir nur empfehlen: Alltalk_tts

This is strange. If "pip list" shows the tts package then it seems that everything is installed correctly. Are you running your python script really in the right python venv? Can you run "tts --help" in the command line successful?

@@ThorstenMueller The tts command in the console works. tts --list_models too. And yes i am running the created venv.

@@ThorstenMueller I managed to get it running briefly when I use the setup of the git repo. But it is only working in that terminal and after closing it everything is gone with it. Thats not a solution, because the setup is taking too long.

Thanks for your topic suggestion. I've added it on my TODO list but it might take some time.

Normally this is an aspect of SSML (Speech Synthesis Markup Language), which is by now not supported by Coqui and Piper. Maybe you can try a workaround and add multiple dots (....) to create a pause. But i didn't try it out myself.

@@ThorstenMueller thanks. will try that.

@@ThorstenMueller just tried it. I put dots where I wanted to pause bit it does not work. It only responds to one dot.

​@@nomadhgnis9425 Okay, then maybe it's a workaround to create multiple tts wave files and merge them together including pauses. That's not an optimal way but it could do the job.

@@ThorstenMueller I found a way. I am using debian. I had to create a 3 second silent wav file and split the paragraphs into different wav files and then merge them together with the ilent wav where I need it. I done this with a bash script. So problem solved. Do you know where I can get more voice files other then the ones listed.

Yes, but they did not just discontinue the project, but Coqui AI (the company) behind XTTS shut down.

Did you update the python dependencies in your environment? So running "pip install setuptools wheel pip -U"

I've no experience using Arabic with XTTS. Did you already try it using their Huggingface space?

Josh Meyer (co-founder of Coqui AI) mentioned in my XTTS interview that 6 seconds audio input duration should be perfect for XTTS model. kzfaq.info/get/bejne/jtl_gJSIv5bPaGg.html

This error often occurs when you use an older version of pip. Did you run "pip install pip setuptools wheel -U" before installing Coqui?

@@ThorstenMueller ​ This may have been the issue. Played around with it a bit and got it working again, but can't recall exactly which thing I did differently. Thanks for the reply though! If you're looking for content ideas, one thing I am struggling with is how this all fits together now, in June 2024. Specifically - when I start the server and hit the local webserver, I get a very different UI than what I see in other videos on XTTS. And I know there are all different UIs for XTTS - there's a fine tuning one, a web UI, RVC, etc. and some of them have bits that don't work, and it sounds like Coqui has abandoned the project now and... it's hard to catch up on it all when coming into it for the first time, and it changes so rapidly. So I guess what I'm trying to figure out is - if I want to build an AI voice clone of me, today, what's the strategy/stack you recommend?

I'm working on a video about CUDA. If you want i can post an update here when it's online 😊.

@@ThorstenMueller I've solved the problem. Torch and CUDA version should be compatible with each other

@@orcunaicovers17 Happy you could solve it 😊.

Danke für deinen Themenvorschlag 😊. Ich habe es auf meine TODO Liste gesetzt.

@@ThorstenMueller gibt inzwischen auch auf GitHub ein WebUI fürs finetunen 🙌 funktioniert ganz gut. Das einzige was noch ein Problem ist das sich die Einstellungen ändern Temperatur und Co hab da Stunden ausprobiert es werden immer Sätze übersprungen.

Could you successfully create a venv and just can't activate it or can't you create it?

@@ThorstenMueller the venv created just fine but I couldn’t open a terminal within it

@@TNMPlayer That's strange. Do you use the .bat or powershell (.ps1) file to activate the venv?

@@ThorstenMueller I used the .ps1

@@TNMPlayer Maybe try out the .bat version, this could have an effect.

According their README python 3.11 is the max supported version. As Coqui AI hat shut down i'm not sure if or when this will be adjusted to higher python version.

IMHO by now there's no support for Coqui und Piper TTS on Android. But this would be really cool 😎. Did you ask already at their communities?

Yeah, it's a shame it's not 100% open. Fortunatelly, we'll always have Tortoise tts :)

Who cares it's not like they're going to sue you if you do.

@@chryseus1331They could, though. If you have a company and want to use a software for commercial use, I wouldn't recommend ignoring its license.

Sadly, yes. I've made a short about it. kzfaq.infoQMruRTlQu7I?si=JyDY8ziFJC8omAPY

Coqui TTS has a simple web UI if you run it locally where you can synthesize audio.

Generally (not sure for XTTS in special) CPU might work but way slower than using a CUDA enabled GPU.

if i want to clone my own voice,i need to train this?how?@@ThorstenMueller

@@user-ub5cx4tw9x I'd recommend you taking a look to Piper TTS for that. kzfaq.info/get/bejne/mMWnmMKb0seWYmQ.html

thanks!@@ThorstenMueller

Ja, dann benutz doch einfach das UI! xD

Kannst Pinokio nutzen, mit automatischer Installation hat das Web UI von Huggingface

@@ratside9485 leider bekomm ich da immer ne Fehlermeldung bei der installation,

Sadly yes, at least the company, let's see what's happening with the code and community.

To learn? Or like, for fun?