Perfect Word-for-Word Subtitles Have Arrived

Рет қаралды 14,689

10 ай бұрын

Ever wanted the subtitles to just say exactly what the characters are saying? Well now you can get near-perfect word for for subtitles for any film or TV show from any language.
In the video I said 50% off, but right now (November 2023) the courses are reduced EVEN MORE because the Black Friday special has started on ELEVEN other languages:
shorturl.at/vxF13
If the above link doesn't work, this one should:
learn.storylearning.com/bf23m...
Insane 32 course bundle across 11 languages, save over $6,000!
shorturl.at/flzIJ
learn.storylearning.com/uncov...
This video is about how to get accurate transcriptions and subtitles on any movie, TV show or video in English or other languages.
Black Magic Design DaVinci Resolve is the name of the video editing and transcription software I used in this video (if you just search that you'll find the official download page).
Refold's community:
refold.la/join/?partnerId=lamont
(You can click "quickstart guide" if you want their guide to learning a language along with the newsletter that is actually very useful.
Refold also has amazingly well selected 1000 word flashcard decks that can get you started in a new language FAST:
Learn to comprehend your target language by learning the most relevant vocabulary with these fantastic customised Anki flashcard decks:
Spanish 1000 words: refold.la/spanish/deck/buy?pa...
French 1000 words: refold.la/french/deck/buy?par...
German 1000 words: refold.la/german/deck?partner...
Korean 1000 words: refold.la/korean/deck?partner...
Japanese 1000 words: refold.la/japanese/deck?partn...
JOIN the Refold community: refold.la/join/?partnerId=lamont
Videos are often released up to a week early to members of the TimTam Cartel (channel members). Membership is only $2 US a month and also comes with extended versions of some videos, members' only polls and more. Join here:
/ @daysandwords
The other channels shown in this video are:
MrAlexTech
Emil Hansius
Dreaming Spanish
Subscribe for more awesome language learning content: / @daysandwords
Let me know: Do you think you will ever use intelligent auto-transcriptions or word for word subtitles in your language learning?

Пікірлер: 140

@daysandwords 10 ай бұрын

LAST DAY FOR YOU TO GET 50% OFF in StoryLearning's Summer Sale! (I was late to upload this so there's not much time left now.) shorturl.at/gmqBL

@JohnnyUtah488 10 ай бұрын

One of the best milestones in language learning is when your listening skills outpace YT's automatic subtitles. Like you turn them on for some small part you're have trouble with and find the AI is even more confused than you are! So validating! 😃

@declangodfrey 10 ай бұрын

3 videos in the past week! You’re on fire, Lamont!

@LaurenAngela_aufDeutsch 10 ай бұрын

He is literally churning them out! I love it

@daysandwords 10 ай бұрын

I can always get them done better when I take some time to plan a few in a row, so that I'm not setting up the light and the camera every time etc etc. I'm yet to reach full perpetual motion where I can have some coming out as I'm preparing the next batch... but maybe one day.

@LaurenAngela_aufDeutsch 10 ай бұрын

@@daysandwords I feel you. I am in the process of starting a new YT channel and the lighting and the set up is really an unexpectedly huge part of production! And the editing……. 🥲

@daysandwords 10 ай бұрын

Just start with something. Get SOMETHING out for every video. No one cares if it doesn't look good; that's more for me than anyone else. No one thinks "Hey this guy must be legit" just because my light looks good. EDIT: Sorry, just had a look at your channel, great going! You didn't need that tip haha, you're already doing that! But it all looks good too, good video quality, good audio... Well done!

@LaurenAngela_aufDeutsch 10 ай бұрын

@@daysandwords no no I am starting a new one! Teaching Germans ( American )English in German 😅 so that was really necessary to hear…. Because I may or may not just have edited for 5 hours and then recorded the entire video again….. 🙃 new one will be @englischlernenmitlauren if I can ever get a dang video published!

@run2fire 10 ай бұрын

I watch all your videos 50 times and am fluent in LaMonto with an Aussie accent

@aleidius192 10 ай бұрын

This will be very useful for Italian. I've noticed a lot of very popular shows produced by Italians contain a lot of dialect. This is why I've been watching English shows dubbed in Italian instead. The problem is the Italian subbing and the Italian dubbing are clearly done by separate people because they do not match at all. I am very excited to be able to watch these shows both subbed and dubbed.

@daysandwords 10 ай бұрын

That's not just Italian, that's every language I've ever seen. Sometimes I swear they are going out of their way to make the subs and vocals different haha.

@braulioacosta6816 10 ай бұрын

Of course, they have to dub taking into account the length of the sentence, for example "Why?", a simple one word question, would translate into "¿Por qué?" in Spanish, one more word/syllable. For subs you can add all the text you want.

@daysandwords 10 ай бұрын

@braulioacosta6816 - No no, every always assumes we're talking about that level of difference. We're not. We're talking things SO UNNECESSARILY different that you would actually think they get paid to make sure it's different. And we're also NOT only talking about dubs, we're talking "VO" (version original) material as well. Like, the dialogue will say, "Hang on, why?" And the subtitles will say "Wait a minute, what did you say just then?" (Not shorter, no reason to change it, right? But they do...) You are also mistaken that for subs you can add all the text you want. Subs are actually EXTREMELY limited by their rules. You can't have more than 30 characters a second (or something like that), and each subtitle must be shown for at least two seconds, even if it's only "Yes." As professional translator David Bellos writes in his book: "Subtitles are so tightly controlled that it's amazing they can even work at all." So you would assume that THAT is the difference, but it's not even just that, because sometimes the dialogue says "Yes." and the subtitles will say "I agree." Like... it's longer than what they JUST SAID. I think subtitles teams often try to make it more like literature so that it "reads" better, because they're not for language learners, they're for deaf and hearing impaired people.

@TheShadowblast123 10 ай бұрын

@@daysandwords I remember spending 10 minutes trying to figure out where I went wrong because of this XD

@burekusakagami5653 10 ай бұрын

Oh man, the implications for research are tremendous as well. I was almost crying at the thought of having quick and accurate transcriptions that I can just double check. Thanks Lamont ❤

@Gilvan_silva 10 ай бұрын

I love you, Lamont! I was having trouble with subtitles, trying to watch the same movie over and over again, like you did.

@pushthedesign 8 ай бұрын

Thank you so very much! I have the paid version of Davinci Resolve and didn't know about this new feature. Incroyable!

@parasitius 10 ай бұрын

Dude. You're now officially the best language KZfaqr on KZfaq, thanks and have a great day.

@daysandwords 10 ай бұрын

Cheers for that! Really, comments like this mean a lot.

@russelsmithard7566 10 ай бұрын

I just found out that link introduced this feature to their import tool! It is literally the highest language learning game changer I’ve seen in a long time!

@thisisbgm 10 ай бұрын

Very cool idea! Tak!

@simon314man 3 ай бұрын

I’ve used the Resolve Studio version on 3 films, two in which French was the dubbed audio and one with original French dialogue. First two were animations - Puss in Boots 2, and The Emperor’s New Groove. Success on these was very good with the exceptions of character names. Here Resolve would try to find another word rather than the character name. The third film «The Intouchables», it seems Resolve really struggles with the fast paced, syllable swallowing French being spoken, and not just in the opening car chase, but the interview montage that follows.

@tabidots 10 ай бұрын

Thanks to the comments on this video, I learned about Whisper and have been trying it out on various podcasts, stand up comedy videos and TV show episodes since this morning. Takes some time and makes my laptop heat up like crazy but so far, pretty cool. It makes a tiny amount of mistakes (for Russian, and Vietnamese), but far fewer even than I expected, and that is perfectly acceptable for a free tool that costs only a little command-line elbow grease instead of three Benjamins. I kind of prefer having all the text in a file rather than synchronized subtitles anyway because you don’t have to constantly pause and hurriedly look up a new word.

@daysandwords 10 ай бұрын

Resolve can also do a transcript, I showed it doing that in the video. Look I'm not suggesting that Whisper is not better for specific purposes, and I wasn't actually expecting anyone to buy Resolve based on this video... my point was that that's how I do it because it makes sense for me, but on the other hand, it certainly doesn't run your CPU/GPU hot or any such thing. That's probably not worth $300, no, but there are several other advantages too.

@tabidots 10 ай бұрын

@@daysandwords yeah of course, I just meant to say I didn’t know about any of this before today and now I know about 3 new tools

@ADHDlanguages 10 ай бұрын

You're spoiling us with all this content bro

@MaxEnglishCoach 10 ай бұрын

Impressive!

@Akab 10 ай бұрын

This is actually great as I already use resolve and thought about getting the studio version anyways. Mainly for the multi gpu support, scripting support and higher resolution/framerate capabilities which, yes is pretty niche and definitely not necessary (who has more than 1 gpu in their computer nowadays?) a heads up for our video editing people here: some of their hardware also includes a key for the studio version for free👍

@daysandwords 10 ай бұрын

They actually upgraded me for free just because I was a KZfaqr doing creative things within my niche... so I've had Studio for about 6 months now but I didn't pay for it (or pirate it). But yeah the subtitles/transcription thing is awesome. You can also edit using the transcript but I find that a weird experience that doesn't really save me any time.

@hillmanntoby 10 ай бұрын

freesubtitles is a web implementation of whisper. If anyone is familiar with Python or C++, they can get it going on their computer for free in a few minutes. If that sounds interesting, but intimidating, there are some KZfaq tutorials that can take you through step-by-step. LingQ also has implemented whisper in to its service. KZfaq videos without subtitles and MP3 files can be loaded into LingQ, and LingQ will create the transcript which can be read within the app.

@Charlotte-ti2yk 10 ай бұрын

I’ve just found what I believe will be the most amazing KZfaq channel for me in Turkish (their version of National Geographic)… and annoyingly it has no subtitles. Not even automatically generated ones. Since the topics discussed are ones I know I will enjoy, and I can already hear that the narrator is speaking very clearly, I was going to try out LingQ’s new Whisper feature. I see even the studio version of DaVinci Resolve doesn’t have Turkish as a language (I would have absolutely considered paying if it did and if Whisper leaves something to be desired), but regardless, it’s just a really exciting time to be language learning. Can you even imagine trying to self-learn a language twenty years ago? Even ten years ago?! I don’t know what I would do without all the technology we have today.

@daysandwords 10 ай бұрын

My grandfather worked in intelligence in WWII, and was pretty fluent in a few relevant languages, and I still have some of his materials haha. I've been meaning to do a video about that very thing... We're talking vinyls... But not even LP sized ones, EP sized haha. 14 minutes of audio to learn French with.

@tabidots 10 ай бұрын

Imagine what it was like for foreign ambassadors in like, medieval times. Especially those who went from Europe to Asia.

@daysandwords 10 ай бұрын

Yeah but the difference was that it was completely normal to just talk to strangers for hours back then. You see in the New Testament (and I know that's longer ago, but this only changed in about 1800-1900) but in the NT it's like "And there John and James met two travellers and dined with them. It was morning and (etc etc), and by nightfall, the travellers were weary." So like, these travellers just spent a whole day with two random dudes, likewise John and James did that. It would have been much more acceptable to just make noises until you were understood.

@tabidots 10 ай бұрын

@@daysandwords the being weary after a full day of studying part sure hasn’t changed 😆

@87advil 10 ай бұрын

@@tabidots Interpretation is an ancient profession, though if they got way out maybe it would have involved chains of interpreters. Allegedly Marco Polo spoke Persian which was a lingua franca throughout much of Asia at the time

@Stephanie-gv8rh 10 ай бұрын

This is really cool!

@daysandwords 10 ай бұрын

Thanks for saying so! Hope you got something out of it. As many comments have pointed out, LingQ have also integrated WhisperAI. One thing I prefer about Da Vinci Resolve though is that it's not using your material to better itself, like whatever you load into it doesn't get stored in the AI brain anywhere, which in theory means it's "not as good", but it's pretty damn good anyway.

@andrewhagan9452 10 ай бұрын

I bought story learning French uncovered in the half price sale. Absolutely Fantastique 👌🏻👌🏻

@daysandwords 10 ай бұрын

Merci mon ami!

@NomadicVegan 10 ай бұрын

I was super excited to try this out, since I've been struggling to find beginner-level comprehensible input in Amharic. Unfortunately, freesubtitles didn't work AT ALL for me in Amharic. When playing back the video, I mostly saw no subtitles. Occasionally, random words would appear in English, Spanish or other languages written in scripts I could not identify (but I know they were not Amharic). I even bought $1 of credit to see if perhaps the paid version worked better, but got the same result. Having said that, the results when subtitling a video in German were extremely good, much better than the auto-generated YT subs for that same video. So, it's obviously a very promising tool, but it's disappointing that the company currently seems unable to deliver even a passable service in one of the languages they claim to support. But thanks anyway for the tip! I'll keep an eye on it, as I'm sure it will improve with time.

@daysandwords 10 ай бұрын

Hmm, that is strange (and disappointing). Languages are really one of those "the rich get richer" situations. English doesn't NEED any of this stuff, but it is the language that gets the most support with it... and so on down to about Norwegian and Finnish and after that, support drops fast.

@philippuhrig3681 9 ай бұрын

Is it applicable to Netflix or so aswell, or do you guys know of an extension therefor ?

@Nikita-ze8ii 10 ай бұрын

I know I'm late to the party but as for live captioning, the Windows Live Captions do a better job than I had initially anticipated. I tested it on onomappus video on compliments in japanese and turned on the subtitles on the video as well and, save for some parts where the program detected commas that werent in the video subs, it was completely accurate to the original subs. Meanwhile onomappus relatively strongly accented english was understood near perfectly. Have you tried the software out yourself? What do you think? I personally feel like it could particularly help out with people who enjoy stuff with generally calm and formal, clear speech like Star Trek or even simply documentaries.

@biuliu7157 10 ай бұрын

Sorry if this is a dumb question but I'm a bit confused, you say that Davinci doesn't have full translation out yet and I'm not sure what you mean by that. Am I able to translate any movies or videos to Chinese subtitles or would I have to wait? I have studio as I have purchased it from being a professional filmmaker long ago. Just a question I have because A.I translations will have more difficult times compared to other languages. Lastly, I really hope they release some premium GPT styled translation feature on Studio because Studio honestly needs more content and it would be really awesome help as a Mandarin student. 谢谢你！

@sevret313 10 ай бұрын

There tech to do this locally and I wouldn't be surprised if you soon can do it basically real-time on a video player on your PC with a small start-up delay. Freesubtitles is using OpenAI's whisper model and with just a "minimal" of technical know-how you can do the same on your own computer for free with the added benefit of not having to spend a lot of time uploading the video and any legal issues of uploading copyrighted material.

@daysandwords 10 ай бұрын

It's funny, everyone saying "You can do it on your computer" are talking about a difficult-ish (or "minimal technical know-how) set up, so by that measure Da Vinci Resolve is very easy. And it does a fancy thing with background noises and music too.

@sevret313 10 ай бұрын

@@daysandwords I'm just stating this as an option for people. If you have Da Vinci Resolve that is probably the easiest way for you to auto-caption your videos. If you're able to process the video to use it with the free version of freesubtitles ai then it is just one extra step to transcribe the videos locally too.

@daysandwords 10 ай бұрын

@@sevret313Sorry, my point was only that I was making this video under the assumption that no one would bother with DaVinci Resolve because of the complexity of using video editing software to do this, but actually it's kind of simple compared to the other local options people have brought up.

@ajJavellana 7 ай бұрын

How did you get a download of the movie to be able to put it in Davinci Resolve?

@witchmorrow 10 ай бұрын

Thanks for another awesome video. Okay, so something super annoying that we're faced with all the time when consuming content - is that the subtitles provided for the content do not match exactly what is said. It's jarring and annoying. For example, I'm watching 'Encanto' in Spanish on Disneyplus and the subtitles are not the same, even the CC ones. In this video, you showed that you had generated subtitles for the Spideyverse film. How did you do that? My understanding is that you have to submit the video mp4 (or whatever) file to either of these programs for it to generate the subtitles for it. Do you know if there's any for me to generate subtitles for anything I watch on disneyplus/netflix/etc or do I need to get my hands on those mp4s somehow? Cheers!

@daysandwords 10 ай бұрын

Yeah you need to get your hands on the .WAV or .mp3... you actually technically don't need an mp4. It doesn't need to watch the video, it just needs to hear it. Yeah I did the Spider-verse ones by recording the Spanish and putting it into DaVinci Resolve.

@witchmorrow 10 ай бұрын

@@daysandwords oooh recording the audio yourself, that's such a good idea!! Thanks

@daysandwords 10 ай бұрын

Yeah, so Audacity will do that. All of this is only what I WOULD do if I were not an upright, law abiding citizen, of course. I didn't actually do any of this.

@witchmorrow 10 ай бұрын

@@daysandwords Yes of course and I would never do any of this either as an upstanding member of society myself, but speaking entirely theoretically, thank you very much for the tips

@jamesmccloud7535 10 ай бұрын

I think this is great if you really want to understand something 100% or if there is no other comprehensible content for a language. Word by word subtitles doesn't always apply for every situation though because language is not always literal. I guess this is a issue with accuracy of words vs accuracy of meaning. There are some words and phrases in a language that makes zero sense when translated and there are some that just dont have anything equivalent to it. How about idiom or slang? Or the difference in meaning across various dialects? I'm curious to see how this will be dealt with as the technology progresses. Btw I like that you're incorporating the different teachers from Dreaming Spanish in your video, cool!

@daysandwords 10 ай бұрын

"Word by word subtitles doesn't always apply for every situation though because language is not always literal." The title of the video refers to subtitles in the same language the video is in, so I really do mean word for word. There's no such thing as word-for-word or literal translations. But 99% of language learners want word perfect subtitles or transcripts in the TARGET language, not in a translated language.

@jamesmccloud7535 10 ай бұрын

@@daysandwords Oh I see now. Welp I guess I misunderstood it. Thanks

@turkmusik 10 ай бұрын

DaVinci Resolve really is great. It is much easier to use than iMovie (which I hate). And the free version is quite powerful.

@daysandwords 10 ай бұрын

"Quite powerful..." Haha, it was used to edit the 2012 Oscar Best Picture winner, so yeah.

@0815Snickersboy 10 ай бұрын

Whipser AI is good and open source(free). Drawbacks are that you need to run it on your local computer and that it varies in quality across languages. 3.8% error rate in spanish to 47.1% for nepali.

@alpritt 10 ай бұрын

I've been using the Recorder app on my Pixel phone. It's a Pixel phone exclusive I think though, but if you happen to have that phone, it's worth having a look at. The text is synced with the audio so you can search through it easily as well. It seems to only have English, Japanese, Spanish, French, German and Italian though.

@daysandwords 10 ай бұрын

I don't use a Pixel as my daily phone but I actually have one that I used for the USA (an old one), I'll have a look, thanks!

@trubin12 9 ай бұрын

I just used recorder for a video last night. I'm going to use that transaction for my TV binge

@dccoulthard 10 ай бұрын

Thanks for this video. I have Davinci Resolve Studio 18 on my computer, but can't find the "add captions" option to save my life! I looked for them under "Timeline" tab like you had, but nothing. Does it need to be installed or something?

@daysandwords 10 ай бұрын

Yeah sorry, it's only in Beta at the moment, so you need the very latest version, 18.5 public beta. Sorry, I would have said this in the video if I had thought that anyone would actually do it... I was figuring it was more for when it inevitably comes to the free version.

@garyarnold3141 9 ай бұрын

Why did you learn Swedish? Do you have plans to go there?

@KrXYT 9 ай бұрын

Have you tried the premiere pro auto captioning? I find they are pretty good but i wanna know how they are against like davinci's or something

@daysandwords 9 ай бұрын

As far as I know they are probably using the same or a very similar engine. At any rate, I can't imagine it gets much better than Da Vinci Resolve's ones, which are near perfect. Also, Premiere Pro is very 2019. They're always playing catch up these days, which is pretty poor at $50 a month.

@KrXYT 9 ай бұрын

@@daysandwords Idk i guess ill have to try out davinci then. Not sure whos doing $50 a month for premiere, thats a scam LOL

@daysandwords 9 ай бұрын

I think it's $47 AU a month here in Aus ($29 US). Either way I think it's a scam.

@ChristopherBonis 10 ай бұрын

Hey Lamont, now that it seems you’ve gone all-in on Español, how do you approach language maintenance with Svenska? What ever happened to the experiment with your second son whom you were speaking to only in Swedish? Cheers.

@daysandwords 10 ай бұрын

Actually no I'm definitely not all in on Spanish, video about this coming at some point.

@HolaEspanyol 10 ай бұрын

❤

@AJ-lo5dr 10 ай бұрын

Heya Lamont, Relative to the spiderverse video I had a thought that I would appreciate your thoughts on. I will be starting to learn Portuguese soon. * CONTEXT I grew up with the following languages: English, Luxembourgish, French, and German. I have been learning Italian for a while and would estimate my level around a2. I have spent time with my partner in Portugal ( her home ) fully immersed ( BUT !! At no point during that time was I trying to learn the language - only trying to understand ). Keep in mind that with all the above, I don't feel like I understand more than 5% of what goes on around me. [EDIT: I mean to say that I didnt study Portuguese cause I was scared it would mess up the Italian I had been working on] * Would you say that watching a movie (that I have watched before ofc) 50 times is something that could be used in my context? [EDIT: I would consider myself a complete beginner even though I have many obvious advantages]

@coloradoboy1014 10 ай бұрын

Yes, you are still learning.

@-_pi_- 10 ай бұрын

Yes, But try and do some typical academic stuff in between to speed up your learning significantly. Try keeping a spreadsheet of important/New Words and translate and define them, study some basic grammar and Word order rules. You will Get to producing your own writing/speech much quicker, and you won’t burn out as quick in my opinion. Good luck! Gréiss aus Norwegen

@daysandwords 10 ай бұрын

I would say that in terms of your language skills, you're basically the perfect candidate for it. BUT... it's not actually aimed at that and wouldn't suit at least 50% of people. It's aimed at people who find the ease of just watching one thing until they've essentially memorised it appealing. It's about removing choice, not about perfecting the process. So if it sounds appealing to you, I'd do it. But if it sounds like torture, don't do it just because you think it might work (because you'll give up anyway).

@AJ-lo5dr 10 ай бұрын

@@daysandwords Im a big fan of watching cartoons repeatedly and currently have plenty of job time to use :) "I get paid to learn languages" sounds pretty good to me

@ajkbox 10 ай бұрын

Só interesting! I'm trying to learn European Portuguese as well and have a really hard time finding something worth watching 50 times. As a kid I would probably watch Disney movies and the like untill I knew them by heart but I would like something else, something witty and not madly phisicaly racing around just to show off how fast they can calculate the 3D. Any suggestions?

@alex10291 10 ай бұрын

Lingq has it built in and its crazy useful and crazy fast

@nathancasey7712 10 ай бұрын

I wish there was something like this that lets you click the word to see it in your language. Because the sentence structure might be different so the words will be in different places.

@daysandwords 10 ай бұрын

Yeah, Language Reactor (but only works for Netflix at the moment I think), and Lingo Pie... otherwise there's stuff for ebooks that will do it but yeah not as much for video.

@amstabomitdembabo5984 10 ай бұрын

I use the Whisper AI integrated into LingQ and it is a GAMECHANGER. It makes so much content accesible and enjoyable that before was just out of my reach. Now I can learn from a lot of native Polish podcasts 😎

@NomadicVegan 10 ай бұрын

Ooh, I use LingQ but I didn't know about this feature! How does it work? Do you mean you can upload audio and LingQ will create a transcript using AI?

@daysandwords 10 ай бұрын

@NomadicVegan - yes, I believe that's basically what it does, but it's just integrating Whisper, which is Open AI's model, and probably the most powerful. I'm not sure if it's only for content already on LingQ or stuff you upload yourself.

@NomadicVegan 10 ай бұрын

@@daysandwords Thanks! I just tried it today. Game-changer indeed!

@samturner6848 10 ай бұрын

These are programs where you upload a file and it adds subtitles, correct? Are there any programs you know of where you can be streaming a video on any website and the program can add subtitles in real time? That would be awesome because sometimes I find a video I want to watch in my target language but there is no way to get subtitles

@samturner6848 10 ай бұрын

Language Reactor is awesome. But only works for youtube/netflix.

@daysandwords 10 ай бұрын

Freesubtitles can download the video remotely (like, you don't download it and then re-upload it) but only if you pay. But it's still not "real time" like you say. The engines generally analyse the speech at about 20x speed, meaning that if the video is 20 minutes long, it takes at least a minute to generate the subtitles... So "real time" is not quite here yet, but I'm sure it will be.

@stevencarr4002 10 ай бұрын

I use Microsoft Azure for speech to text. It is pretty good, but not perfect. It is free unless you use an insane amount of transcribing. It is very hard to setup though. Background noise and music are problems.

@daysandwords 10 ай бұрын

It's funny, everyone saying "You can do it on your computer" are talking about a difficult-ish set up, so by that measure Da Vinci Resolve is very easy. And it does a fancy thing with background noises and music too.

@DavidWilliams-xk4eb 10 ай бұрын

aw man, i'm really excited about the potential of this, but as a transcriptionist by profession i'm a bit worried about how this technology will eventually take over my job haha.

@daysandwords 10 ай бұрын

Don't worry it's coming for us all.

@TheOpaqueWalrus 10 ай бұрын

10/10 Basketballer throwback

@zedxspecturm4698 10 ай бұрын

me getting ready to watch spider-verse 60 times in a DaVinci Resolve window while I read stories in german.

@daysandwords 10 ай бұрын

Yeah I watched it with Resolve twice. Once to chop it down and another to check the subs.

@j5679 10 ай бұрын

I wonder if this can somehow be combined with the Migaku toolchain. If I could comfortably sentence-mine from unsubbed videos, that would be a big productivity boost for me.

@daysandwords 10 ай бұрын

Probably, in some way. I mean, it would definitely be easier if you had Da Vinci Resolve just because it doesn't involve being online then, and you can batch like 10 videos if you want. I am wary of making sentence mining TOO easy though because then I tend to just get everything and then find the idea of reps too daunting.

@j5679 10 ай бұрын

@@daysandwords Fair point but I think there inevitably comes a point where you do want to mine everything unknown you come across because there's just not that much left. That's where I am with English. Will look into Da Vinci Resolve!

@daysandwords 10 ай бұрын

I figured no one would be interested but just be aware it's only in Beta at the moment, so you have to get the latest beta, not just Da Vinci Resolve 18.

@Cosmicgardening 10 ай бұрын

Funny enough a few days ago I tried running Whisper against Spiderverse and it overfits trying to make some noises into words, it gets confused when music starts, and it struggles with some multilingual sections, and it can't handle multiple people talking.

@daysandwords 10 ай бұрын

Even the almighty AI will struggle with multiple people for a while... But I got good results from putting it into DaVinci Resolve... but it has ANOTHER trick up its sleeve that I didn't go into in this video.

@simonhakansson9300 10 ай бұрын

I'm trying to find a way for me to watch a movie on netflix, dub it into my target language and then have subtitles that actually match what the characters are saying. I have spent some time today at refold app but I just got confused and it didn't seem to give me what I was looking for. Is there anyone here who are good at understanding how these apps works who might want to help me out?

@daysandwords 10 ай бұрын

I don't know what you mean by the Refold app, but I'll tell you how I did it (not necessarily the best or cheapest way but this is how I did it): Step 1: Download and install "Audacity" (free). Step 2: Set up to Audacity to be recording whatever comes through your headphones or speakers. Step 3: Let the movie play all the way through in the relevant language. Save what just got recorded through audacity as a wave file (export at .WAV). Step 4: (Pay for) then download and install Da Vinci Resolve Studio Public Beta 18.5 (it's got to be that version because it's not finalised yet). Step 5: Open it up and import that .WAV file that you made as a piece of media. You want the "EDIT" tab (third tab down the bottom). Step 6: Bring that piece of media into the timeline (the thing at the bottom). It will make a giiiiiant long ribbon, which represents the timeline of the "video" that you are making, but there will not be a video. Step 7: Click on "Timeline", then select "Create subtitles from timeline". It has to be in one of the 14 languages the program supports. Let it do its thing for a few minutes. It will create a subtitle track above that. There are a few things you can do from there, but you now have subtitles that are as accurate as can be made for whatever you've got.

@sicko_the_ew 10 ай бұрын

Now you need a "speech bubble" app - and maybe an image cartoonifier?

@daysandwords 10 ай бұрын

There is that kind of stuff already. It's kind of sad that stuff that just 6 or 7 years ago would take an artist hours will be able to done automatically soon.

@sicko_the_ew 10 ай бұрын

@@daysandwords Art might get stuck where it's at today if too many artists get replaced. (For "art" as a product instead of something human we value for its being human, rather than for how well it would work as a decoration. At the moment we mix the two things up.) AI figures out what "art" is by calculating what we like, but that's all based on the images it gets fed, I think, so if the human made images dry up, eventually some kind of "average acceptable picture" might become at least the traded part of art work.

@daysandwords 10 ай бұрын

@@sicko_the_ewNo no I agree with you. I'm of the school of thought that says AI CAN'T generate art. It can make things that look nice, but it's not art because it wasn't borne out of a human experience. But I still think it's sad that all that work that went into, say, Into the Spiderverse, will just look like the norm to a kid who is 10 in 5 years time.

@sicko_the_ew 10 ай бұрын

@@daysandwords Yes it is sad. It might mean humans end up producing less of the consumer art, even at that level, and people who make the world a more beautiful place will lose their livings. (Someone, somewhere will still make art, just because the impulse to create is so strong, but more of it will just stay in someone's notebook, now. And it's probably worse than the effect photography had on the portrait painters, and then the book illustrators, back in the day, just because there's already so much "feedstock" to prime the AI with that it can reach into everything.)

@cadian101st 10 ай бұрын

Standard German is NOT Berlin German, nor is Roman Italian standard Italian lol, but that is besides the point. My worry is with tonal and semi tonal languages, where tonality varies heavily, that these would get confused very easily. The Kansai pitch paradigm is fundamentally different from the Tokyo paradigm which is fundamentally different from the Kagoshima paradigm

@daysandwords 10 ай бұрын

AI works better with more samples. That's it. There is no "standard". There's just "what it can understand, and what it can't". And if it can understand Emil from Piteå which is basically the North Pole, it can definitely understand German from Berlin.

@panfernerzockt3029 10 ай бұрын

To the "German from Berlin" the shown people are Rezo and JuliaBeautx, who come from and live in the Rhineland which is not from Berlin. Apart from that, nice Video

@daysandwords 10 ай бұрын

I never said they were from Berlin, I just showed them on the screen at the same time as saying "imagine it with a German from Berlin". Everyone knows I don't speak or learn German, so I just typed in "auf tiktok reagieren" and clicked on the first one that had some decent footage to show.

@panfernerzockt3029 10 ай бұрын

@@daysandwords alright, I am just very quick to point out something that doesn't seem right to me

@daysandwords 10 ай бұрын

Yeah, and to be honest, I was also, until a few years ago, and then I realised how unpleasantly it comes across, epsecially on the internet.

@straytonox1492 8 ай бұрын

bro if this was on youtube i could have all the subtitles for Russian movies, beacause the youtube generated are not so good

@daysandwords 8 ай бұрын

Yeah to get it you'd have to add the videos to opensubtitles or something, or download them via an app and put them into a program. It will be on KZfaq soon, I'm positive of that.

@whereisthemessiah 10 ай бұрын

Tik tok does this with a lot of languages for free. You're welcome.

@daysandwords 10 ай бұрын

TikTok also rots your brain. So, no thanks.

@boffy2648 3 ай бұрын

Just letting you guys know before anyone pays for this like I did. The website is dead now and using the paid version is just giving them free money. I wish I new that before wasting my money.

@daysandwords 3 ай бұрын

Sorry, which program are you talking about?

@boffy2648 3 ай бұрын

@@daysandwordsThe FreeSubtitles website. From what I've heard from other users, it's been down for a couple of months now. It doesn't have a warning on the site to not purchase the paid version either. I probably should have specified that 😅

@daysandwords 3 ай бұрын

Ah right - yeah, it always struck me as a bit sketchy, so I do feel vindicated in indicating my reservations, especially against the people in this comments section who were like "You stupid freesubtitles.ai is way good and awesome bro".

@ItsLyndon 10 ай бұрын

heyyy :) first

@daysandwords 10 ай бұрын

He was first to SAY first though haha.

@adriantepesut 10 ай бұрын

Bruh I will love language learning no matter what but I don’t think we should celebrate or support the technological advances which may eliminate any practical use to language learning so that you can’t even afford a better wagie pod in the future to study languages in despite speaking 4 or 5

@daysandwords 10 ай бұрын

But in theory anything can with make everything obsolete. The wheel was the first step towards making walking obsolete. It was also one step towards AI, albeit a very early step. Should we not have celebrated its invention?

@JohnnyLynnLee 10 ай бұрын

Unfortunately it's almost useless to me in the languages I'm perfecting, learning or even intend to learn in the future. It's a great tool but I think that the LANAGUE use of AI shows that AI isn't REALLY AI (or at least STRONG AI) yet- meaning, it's not real intelligence - and all that talk of it being dangerous and taking away jobs IS a thing that WILL happen but it's over exaggerated NOW and it will only be a atter of worry for our GRANSON, not us. why I jokingly say it's not "artificial intelligence" it's an artificial murica. Because only knows English (or a few other major languages. It goes to show it, yet, DOES NOT "learn", in the real, human sense of learn by any stretch of the meaning of 'learning". It PROCESS information, meaning COMPUTES it. Because it DOES NOT matter if there is less content of, say, Vietnamese or Thai on the internet for it to sample. Because SURE ENOUGH it has at least enough for a mind of any kind to LEARN those languages. Any human being CAN learn Vietnamese or Thai with the content over the internet to FLUENCY. What's not enough is for an AI to COMPUTE and process the way it does. which, again, is not intelligence at all. Every time someone who worked on it "leave" and talk about the "dangers' of Ai to me is pretty clear he is being PAID to do so. what I see people failing to realize is that a company doing this has MUCH MORE to gain, in profits, propagating that Ai is ALREADY this world changing thing than admitting it's only in it's first step where it's only a useful tool and that will take DECADES for it to be the menace it's said to be. AI can't (yet) learn a language at all, because it CAN'T (yet) LEARN at all. It mimics learning, it's not real learning. It's only in the decades ahead.

@daysandwords 10 ай бұрын

"and all that talk of it being dangerous and taking away jobs IS a thing that WILL happen but it's over exaggerated NOW and it will only be a atter of worry for our GRANDSONS" Ummm, no my dude. People are not worried about what it can do TODAY, but we've reached the point of exponential acceleration. Humans are not designed to intrinsically understand exponential growth, so many many people do not see it as being a threat until the year 2100... But when you do the sums, you realise that it might be more like 2030... or 2028... or 2025. Or October 2023. Check out the lecture "The AI Dilemma."

@lotus6165 10 ай бұрын

"And at least if you don't pay anything, you can't do anything with the subtitles once they're on the video. You can't save them, copy them or get a transcript." What a weird thing to lie about. During your seemly short testing, did you at all scroll down once the transcript was complete and loaded in the video?? Right under the video are options to download the transcripts in file types srt, vtt and txt...

@daysandwords 10 ай бұрын

I actually didn't see anywhere that you could, and when I clicked "Get transcript", it came up with "Buy credit". So I'm absolutely prepared to admit that I made a mistake. But assuming someone is lying just because they missed something is a character flaw that you need to address.