Suggestion: place your avatar in thumbnails - its very recognisable and catch attention

Okay that's the greatest thing I've ever seen in my entire life.

you got mine and mine respect

cause* and i subscribe to every youtuber i watch!

You know Google never releases there ai to puplic pretty sure this music one is no different than those other ai

It's a Galaxy brain idea

I typed "Farts and burps" into riffusion with the negative prompt "Guitar" and those hellish sounds will haunt me for weeks.. also try "Monkey screams" if you need some nightmare fuel

@@legendaryra3590 I did, thanks... I will not sleep tonight

​@@legendaryra3590 I also typed "Dog screams" and got some crazy weird vocals.

Is there a way to convert pre-existing audio files into the spectrograms SR uses?

Fix some of those crappy mp3s we burnt from cds back in the day!

This already exist, people even remastered Half-Life audio.

Not sure how this video’s content relates to that, everything in this video has sounded like so-so vinyl or a somewhat worn Tape…so unless you’ve got some **really** bad MP3s idk where you got that idea

@@The_CGA yeah but these sound like that because all the ‘vocals’ are robot made. It would be much clearer over actual vocals

audio upscaler... throw it through a fourier transform, take the mag bins as a series and extend that series. haven't done it but i figure a cepstral transform may be used to "advance" the fft frame and double the bandwidth.

Totally. Like trying to read a book or even just a clock in your dreams. Superficially represents some information, but it is meaningless.

Aping art. Aping Intelligence. AI.

Sounds like K-pop to me lol

Am I the only one who feels it sounds like chinese? Like that the training sample had too many chinese music in it and it all ended up sounding chinese.

@@videodaniel8945 yeah to me the vocals sound pretty authentic like a human could be singing it. i don’t get any creepy or dream like feeling from it tbh, it just sounds like someone singing in a foreign language to me.

Eventually it will imitate so well that you can't tell the difference.

@@Miranox2 That's already the case. There are a lot of AI TTS papers where you can't tell.

@@laupoke There's a big difference between a research paper and a commercial product. TTS software still has a ways to go.

@@Miranox2 wym bro? there's literally multiple voice gen AIs lol

You say that now because you're human still.

agreed, this would be a fantastic tool!

There are already some audio tools that do something similar - with audio to MIDI convertors - but that example was strikingly good and serves as an example of something that will become commonplace. It will be unnecessary to have guitar lessons when you can just hum a tune and then get a computer to play it back and sound realistic.

Melodyne is great for this

That has been in Logic DAW for a while. Audio to midi

Theres a vst plugin called Vochlea that does this already, although I imagine AI would do it much better

I think the opposite may happen: lots of false flagging.

New technologies always threaten the hegemony, so it will be interesting to see how the Big 3 record companies react to the destabilisation of the industry that AI can cause. I could imagine the big record companies doing things like threatening to pull their songs off Spotify or KZfaq if the streaming services allowed people to upload AI-created "fakes" of real artists. Any "democratic" technology that puts creative power in the hands of consumers scares the hell out of existing rights holders. I wonder whether Universal and Sony will see AI as an enabler that it can harness for its own profit, or as a potential destroyer of the industry. (Years ago, the record industry of America basically prevented minidiscs taking off as a recording medium, and it also tried to shut down online piracy via napster, so it will be interesting to see how it reacts to random people being able to produce and share "good" music without paying a record company for it).

I doubt that was the sole reason, but likely a considered use case. A good idea none the less.

Nah man there's enough people who make music and enough free music on the internet to not be flagged

*Good. Those companies need to finally burn in hell.*

no, it's less. sincerely,

Scary

wtf

WAIT WHAT? Just 5k songs?

Actually apparently (copy-pasted from comment on Fireship's video on the topic): the 5.5k music samples are only the *evaluation* dataset, which they've published along with the paper, but the paper states that "the semantic and acoustic modeling stages are trained on a dataset containing five million audio clips, amounting to 280k hours of music"

Some of the tracks are straight out of tune or just use wrong accord that makes it unmelodic sometimes

@@joemama-bu5ue What's a bit ironic with that comment is that these are often the songs that sticks the most. It's often tracks that what feels off on the first couple sets of listening that get addictive and can be listened to over and over again. As a meddling guitar player, playing in key with scales is easy; it's what you learn when you start off. Not saying the AI is genius-level composer, but don't dismiss such creations so fast, what seems worse to you at first might be something you're just not 'getting' on the first couple of plays.

@@joemama-bu5ue Or just take jazz...... But yeah I don't mean that your comment is wrong, I'm sure there's going to be a lot of garbage generated, if it's like image AI, what is it, maybe one out of 10 is usable? 50? 100? You'd expect music to be similar... Can't all be homeruns all the time! But a bit of off-key off-scale might be a great thing; not a bad thing.

The jazz examples are an interesting contrast. They're completely incoherent even though the superficial elements that might make something "sound jazzy" are present. Jazz is often called "musician's music" because of its technical complexity and the level of music theory involved. Maybe that makes it particularly challenging to recreate convincingly. If you're not into jazz, the best way I can describe it is it kind of sounds like a non-musician with a really superficial understanding tried to imagine some jazz in their head. The overall vibe's right, there's drums and electric piano playing chords and a solo guitarist noodling away. But the harmony and changes are confused, the melodic lines are incoherent random notes, there's no groove to speak of and no real structure or idiomatic jazz vocabulary.

what? that sounds like trash :D i would say any newbe can do it better in one week, with the right teacher in one day

No wonder

And it is still lightyears behind real music, and it will never ever catch up

@@isaacnewtech nah

@@Milk_Delivery yes, because you're unable to discern what is missing, unlike millions of people who can.

@@isaacnewtech you won't be able to distinguish ai music from real music in 5-10 years mark my word

Perfect comment. My thoughts exactly.

SAME

Stan(ley) Pine's dad: I'm not impressed and impressed at the same time.

a lot of people aren't even impressed by marvel movies so.. it's a scale. we saw how good ai images got in

Warning. I would not dismiss this technology based on your personal biases. AI learns at an exponential rate and only gets better over time. It seems like AI developers are hell-bent on cutting people out of the art and music they consume.

»The book of the generation of Jesus Christ, the son of David, the son of Abraham. Abraham begat Isaac; and Isaac begat Jacob; and Jacob begat Judas and his brethren; And Judas begat Phares and Zara of Thamar; and Phares begat Esrom; and Esrom begat Aram; And Aram begat Aminadab; and Aminadab begat Naasson; and Naasson begat Salmon; And Salmon begat Booz of Rachab; and Booz begat Obed of Ruth; and Obed begat Jesse; And Jesse begat David the king; and David the king begat Solomon of her that had been the wife of Urias; And Solomon begat Roboam; and Roboam begat Abia; and Abia begat Asa; And Asa begat Josaphat; and Josaphat begat Joram; and Joram begat Ozias; And Ozias begat Joatham; and Joatham begat Achaz; and Achaz begat Ezekias; And Ezekias begat Manasses; and Manasses begat Amon; and Amon begat Josias; And Josias begat Jechonias and his brethren, about the time they were carried away to Babylon: And after they were brought to Babylon, Jechonias begat Salathiel; and Salathiel begat Zorobabel; And Zorobabel begat Abiud; and Abiud begat Eliakim; and Eliakim begat Azor; And Azor begat Sadoc; and Sadoc begat Achim; and Achim begat Eliud; And Eliud begat Eleazar; and Eleazar begat Matthan; and Matthan begat Jacob; And Jacob begat Joseph the husband of Mary, of whom was born Jesus, who is called Christ. So all the generations from Abraham to David are fourteen generations; and from David until the carrying away into Babylon are fourteen generations; and from the carrying away into Babylon unto Christ are fourteen generations. Now the birth of Jesus Christ was on this wise: When as his mother Mary was espoused to Joseph, before they came together, she was found with child of The Holy Ghost. Then Joseph her husband, being a just man, and not willing to make her a publick example, was minded to put her away privily. But while he thought on these things, behold, the angel of the Lord appeared unto him in a dream, saying, Joseph, thou son of David, fear not to take unto thee Mary thy wife: for that which is conceived in her is of The Holy Ghost. And she shall bring forth a son, and thou shalt call his name JESUS: for he shall save his people from their sins. Now all this was done, that it might be fulfilled which was spoken of the Lord by the prophet, saying, Behold, a virgin shall be with child, and shall bring forth a son, and they shall call his name Emmanuel, which being interpreted is, God with us. Then Joseph being raised from sleep did as the angel of the Lord had bidden him, and took unto him his wife: And knew her not till she had brought forth her firstborn son: and he called his name JESUS.« The Gospel of Jesus Christ - Matthew - Chapter 1

It won't change much. When tools are available, they are available for everyone, music producers as well. Who do you think is going to make the best out of it? The same people who are making the best out of the billions tolls that already exist today. The AI revolution will have a huge impact, that's true, but I would be much more concerned if I was delivering stuff in a van, moving box in a warehouse on answering the phone for a company. Musicians will be fine, you won't go to a concert to see an empty stage with a laptop in the middle, randomizing notes.

@@ChristianIce Disagree. There are a lot of talented people who just dont have the equipment to do it. That AI provides this opens it up to numerous people. Same for AI pictures. Its more accessible and removes a lot of barriers. It will change a lot.

@@TheH1st0ry You must be unaware of the infinity of tools available to make music for free. Anybody with a computer and a microphone can, for decades. Yes, this tool will add to that, but you could produce loops and songs without knowing anything about music since the Amiga Tracker. To think that the effect would be the same in music industry compared to visual art means not knowing either.

@@ChristianIce but it is going to place where you even do not need microphone - soon AI will sing for you with your voice, and after that it will be able to create any song in any style, e.g. "play me new Elvis song" - you still think it will not change anything and there is no danger for artists who will lost their audience?

@@bzdr lol i guess the truth is that people not only listen to the music of other people but also they follow the personality, how them act, look etc. AI will make a revolution but only in production making, like any already existing VST. you’re not gonna listen to robot lol because it can do billions of GoOd songs and blah blah blah the perception of art will change

This! At that point we're basically reverse-reverse-engineering music, which is sort of meaningless by itself, but still interesting.

That sort of thing was done at least thirty years ago (and possibly earlier) when primitive AIs were fed the manuscripts of Beethoven and Mozart and prompted to take bits and create new tunes. According to taste, some of the pieces were "quite good", but lacked the emotional qualities of the human-created pieces (and in parts sounded "weird") when played by orchestral musicians. With today's deep learning, the bots can create music that would be indistinguishable from the work of the all-time greats, but humans just don't want to accept it. They will though. The market will dictate that "Beethoven" should release a new symphony. The AI that creates the best one will be top of the classical charts.

You could just make the AI run the midi through a plugin like Kontakt where it'll play real sounding violins, bass, piano etc etc it'll sound much more convincing that what we have so far. Something like classical music or Jazz will sound very convincing soon.

@@LAFELIXMUSIC @AutPen38 This is a different technology, it does not work with "notes", this thing analyzes spectrograms and does not work with melodies and harmony in any comparable way to that. It does not generate midi nor can it be fed with manuscripts. It goes from finished sound wave to finished new sound wave, without ever going trough writing parts or anything like that.

@@koraamis5568 ableton can already do audio to midi. if its one simple instrument it converts it very well and accurately. soo all you need to do is take the audio generated and convert to midi then run that midi through a good sounding plug in.

There are several music creation tools that already use AI, but nothing quite as comprehensive as this. There was a lot of hate for "Autotuned" vocals, but the record sales spoke for themselves. (Young) people like hearing new sounds and they don't care if a computer was used. In Korea they have pop bands that exist in virtual avatar form, and there are "vocaloid" plugin instruments that are virtual singers that you can program to sing your own lyrics. There's bound to me more and more of this over time, as listeners want to hear exciting new sounds and the best way to get them is to use the latest technology.

Have it generate music based on your heart rate, body temp, and brainwave frequency. Spend your life living in 'the zone' of perfectly appropriate music set to every life experience you have.

And you’ll get so tiered and bored of it

@@vmusatov I don't mean just the same beat and melody, but like everchanging, possibly with mood or whatever. I doubt it'll ever get boring if done correct.

@@astrovation3281 Itll def get boring

​@@snakeyeslp How though? The entire point of this imaginary thing is to make an indefinitely ongoing song (maybe based on some you already like?) that keeps it interesting. Neither you or me know what will be possible, but I know that if it becomes a commercial product there will be a lot of effort to make it not boring.

did you manage? i'm trying to do the same

@@NPJGlobal never tried

Google is doing what Google does best, make something great and then bury it.

@@GamingDad lol, I remember calling Google about 10 years ago trying to see if we could pay them to license use of Google Maps and got what sounded like an intern who said wow, we aren’t really set up for that, you see we’ve got this advertising model and we don’t have a mechanism to sell things, so when our license with Delorme ended, we switched to Microsoft maps, then Google finally woke up and figured out how to sell things and we switched to them, was such a big deal the CFO got them to throw in a Google Glass kit. We gave it to a colleague as a going away present when he left to work for Indeed.

Yes this exactly this. I especially worry about the implications of using these models in the medical industry, manufacturing, and to write software, for exactly the reason you are describing. They accuracy is bad as it is. I expect it will get a lot better over the next couple of years, but then they will have exhausted the relevant/usable datasets and AI-generated content will start to feed into the training data, at which point the results will likely start degrading. I just hope society hasn't become too dependent on the technology by the time that happens!

Training data will become unbelievably critical and valuable. All of the massive public repositories of information and art will become locked behind paywalls at best, if not privatized and locked down entirely. Hackers might even started breaking into corporate networks to secretly insert data INTO their databases in order to influence the results generated by their AI models. Google has already acknowledged the potential for models like ChatGPT to replace traditional search engines. And we all know that companies are willing to pay good money to ensure their sites appear at the top of search results.

Interesting! Never heard about that.

Been thinking about that for a while now. Glad others have, too.

AlphaGo used AI vs AI games to train itself to top level play. There's nothing wrong with AI training on AI generated content, as long as the training data is curated for good results (in this case, good sounding music).

the same reason image ai's haven't been trained to make use of separate layers for cohesion/motion that would work well with an adobe/gimp/krita-based workflow answer: that tech leans closer to proceduralism & well-tuned algorithms, the sort of boring yet effective work that won't get the same "ai" marketing label

That workflow is quicker using midi packs, you don't need AI to reinvent the wheel. But I agree that in this way you can just use some loop, which again, you can make for yourself quicker through libraries. Let's get back to it next year and see if they managed to double the bitrate, at least :)

for starters musical notation completely fails to capture what's necessary to recreate the complexity of the human voice or rap flow. but also popular music is increasingly moving away from things that can be expressed in western musical notation and the creative focus is more on tone/timbre and subtle unquantizeable rhythms/grooves. so it'd be completely inadequate for that as well as international/ethnic music that never used it in the first place.

Well that's actually been done by openAI a few years ago, it is called MuseNet

This is exactly what the company AIVA did. Imo as a musician/ producer, it was the most compelling one of all the music generation AI that I've looked into. Some genres come out terrible but a lot of them are pretty impressive. This Google MusicLM is one of the first ones that piqued my interest since AIVA tho. Way more impressive than Riffusion.

Couldn't have said it better myself! I'm a professional music producer, it's my main source of income. But it's also my main source of joy. Without creating I fear I might be nothing. Hope people still care about human made stuff in the future.

Exactly!

Because tech bros don’t have any clue about art and its process. The same goes for the lazy people who worship these new toys. If they are satisfied with these results, good for them. Just another market niche.

I require it

Unless you're a researcher working on this model, as far as I know no-one else has access to this. Were you using some other AI-Music-Generating site? There's a whole bunch of them now, but none of them seem to work the way MusicLM (THIS video's AI) does. A lot of them generate midi songs from building blocks it's given; not making songs from scratch. They both have their pros and cons, but the ones available to the public are often much simpler and same-y sounding.

Check frettable

just learn how to do it yourself jesus christ

not on this training data it wont and the thing about music that's different to visual art which is actually rendered as data in the form of pixels is the training data at present they have access to is comps, not stems, not to mention they can only deal with comps that have already been written or melody lines and harmony's, they cannot come up with new ones because every individual is different and makes different choices, can probably write a pop song eventually about the limits of it.

@@123Andersonev I was mostly exaggerating on the time-frame, and I don’t imagine this specific AI picking off like you said. But I will disagree when it comes to the ceiling of AI music. I do think it’ll get to a point where you really have to break down the music in order to tell if its AI or not. Let’s be honest, AI is already getting insanely impressive, music isn’t going to be its hurdle. Even if it takes a decade to get to human level. But just like AI art, a talented human touch will always stand out from something that’s a product of previous work

@@RealityRogue that's not the problem, the problem is in how AI works, it can never be original, it can only work on what it's been taught, it cannot go beyond the realms of convention if that makes sense, so it's actually artless, it only knows how to replicate what already exists because people affirm the output as what they expect, in order for it to go outside convention you need someone sat there telling it no.

What people say: I don't want algorithms and AI dictating how to live my life. What the data says: Oh yes you do, you predictable humans.

Yeah that shit was hard

I think at this stage it can be a great way to get ideas for tracks

@@TracksWithDax I think that's how it will be used. Quickly iterating on ideas.

yes, because the best way to teach some creativity is to give them access to a machine that will literally do everything for them. It's why our teachers teach our students by doing all of their work for them isn't it?

I think it'll be really cool as a tool for making new sounds and really weird shit, but that most people will still prefer royalty free human stuff because it'll be a bit more reliable (and is already soulless).

​@@johncasey9544 So true, lol. From what I've seen following AI stuff for the past few years, I think it'll be a long while before we see AI music reach the heights that image generation is at... It's so hard for them to legally get huge amounts of training data (music) because of the huge labels that have an iron grip on stuff they own That said, I also feel like the nuances of human-created music are going to be hard for an AI to capture

Matrix was more than an artistic metaphor.

Humans will be equivalent to hamsters in wheels, but with headphones on.

Counterpoint: how do u even know what kind of media ur into without exposing urself to it? What abt genres that grow on u with time? Ud just get bored otherwise

how do you know thats not what you're already experience just on a much much larger scale?

​​@@nicf1555 Using feedback from a brainscan? Ai is already able to take brain scans of people that are seeing certain pictures, and then accurately guessing what objects the pictures contain. It's absolutely possible that an AI could estimate how much you like a song, (and also what emotions and mental imagery comes along with it) and then generate music according to that input. You could have it make music that makes you sad or angry, energizer you or make you calm down. The possibilities are endless.

I dunno, the music industry is so awful, this won’t be the worst thing you see!

@@TheCALMInstitute The awful part about the music industry is its robotic repetitiveness and regurgitation of whatever gets streams. Having an algorithm that's literally programmed to do just that would only make the situation worse. What we need is more creativity.

@@TheCALMInstitute Though you're right, that is not the only awful part of the music industry, of course. 😅

These musical snippits remind me of AI Art a year ago, not quite there yet but showing dramatic improvement. And now with Dalle2 and Stable-diffusion, human artists are reduced to this kzfaq.info/get/bejne/sN5jhbJ8ntSziXk.html. If you are in the music industry, this is your 1 year warning to prepare accordingly and get out while you still can!

Pretty much my thoughts as well.

Why do you say that music is the thing AI devs value the least?

I'm still fairly optimistic that not much would be worse from today's industry, partly since I still believe human artistry will always be superior. Similar to the digital art community, in the end they will still have their following. People follow artists for their art and no amount of 'good quality' AI works will change that. If anything, there will be less tedious souless corporate music jobs since they'll just use AI for their corporate music. This will probably apply to Top 40 stuff as well. On the bright side, maybe we'll see a rise of a counterculture dedicated to subvert 'good AI music', and the whole world of AI art by extension. Kinda' like the Dadaists.

The "best" or most successful musicians are those that harness the latest technologies, whether it's Bach with the harpsichord, the Beatles with the electric guitar and the four-track recorder, or some rapper or other with Autotune in 2010. The general public (and old people that grew up with older technology) won't like the "new music" ("It's just noise", they'll say) but technology is completely unstoppable. Just as the folk musicians couldn't stop Dylan going electric, and the "Keep Music Live" members of the Musicians Union in the 1980s couldn't hold back the tide of synths, drum machines, and samplers, no one around today will be able to stop AI. The future of music belongs to the kids that will use and love this new technology, even if it means that every human musician goes extinct.

​@@AutPen38 AI is gonna be your new idea buddy, just like a little creative spark to get your musical juices flowing. With its help, you can bring your musical dreams to reality in no time. No more struggling with certain parts of the production process, AI's got your back. It's gonna level the playing field and let everyone share their ideas. But let's not forget the important role of the music producer. They still have turn those generated ideas into a killer song, add their own touch with effects like reverb, delays, and chorus, and make it sound exactly how they want it to with mixing and mastering. In the end, music producers are selling their ideas and their own personal style, that's what makes their music unique

Low budget indie games will likely be using this tool, but the ones with a bigger audience/revenue will still keep paying musicians to do better.

They won't. And in 15 years, nearly every single "creative" or "artistic" endeavor will be monetized via AI. Photography, painting, drawing, singing, sculpting, etc... All of these will be replaced by AI (ironically, more than likely by the same creative-types that enjoy these passions, LOL). Heck, we're about the same time away from most labor being replaced too, IMO. The only reason it hasn't yet is due to the "old guard" that literally cannot process that it is cheaper to buy a maintain a machine than to keep hiring humans, or are threatened by tech they don't understand... And they aren't going to be around much longer, LOL. So... Yeah. :P

For now

@@spydaboiii You mean you think that in time the music generated will be more complex and full of life? I hope that's true but I feel like , just with generated imagery, its easy to get the details but much harder for these machines to get the overall concept down just right. With any artform, the entire thing tells a story. That overarching theme is hard, if not impossible for this kind of AI to accomplish because it requires a higher level of understanding. perhaps they can combine these generators with another AI who's purpose is a higher level of concept?

> I think they're finally on the right track. Badumtss.

Maybe, again, with AI, there needs to be a balance of how much power it can use until it gets into privacy and morality issues with machine learning Artificial programs versus human rights.

I've seen so many people bash on this technology which i feel is a little undeserved imo.

That almost sounds like it's a thing to look forward to... Do you want your music to be made by a soulless computer?

​@@tomasviane3844 Isn't every computer soulless? So much of music is already made and automated by computers, why not finish the job and let the computer do the entire thing? Or at least a lot more. If it means more music I see that as a win.

Anyone wants to see listen to this? This is worse enough for music, surprised so many people want it to improve

@@astrovation3281 respectively, you must not have made music before, at least real music, not sounds/audio

Just a heads up that audio to MIDI has been available for many years now using software like Melodyne or Ableton Live. You might want to check those out!

Like a drummer that follow me even in not perfectly in tempo

I like how you said that

They tried something similar with Doom IIRC, but this could probably do it even better.

Games mostly use wwise, which is a middleware that let's developers provide the changing context (in combat, new area, dungeon, etc) and the musician can create stems (snippets or layers of music) that take that context into account and will be combined together on the fly. Games have been doing essentially this since LucasArt's iMuse system, used in Monkey Island and Dark Forces.

@@SimonBuchanNz Woah

You mean you can’t wait to get replaced and go into oblivion? No matter how good your ideas are?

@@biomuseum6645 no that’s not what i meant, i don’t think ai will replace anyone doing something because they enjoy it, but it will probably replace a lot of generic music

@@morgan0 but that crappy music is still a job, i hate reggeaton but i don't wish replacement even for them, even if they make generic music, and if we put the bar higher it will be more and more difficult for begginers to climb their carreers or learning curve, if you pay attention you'll see that many musicians first sound generic and a mockery of their masters, then they achieve their real potential

Yeah true but I think at least in Italy the people on the top make generic music and barely can play any instrument , let's say we are at 50÷ to be generous. So i would not mind a replacement of those. The live music than would be left for professionist. In reality what I expect is this shitty musician/ singer getting the job done and being even more lazy, but hopefully with better music

@@morgan0 There needs to be a balance between machine mechanical objects and programs and natural human made creations...If we focus too much on the machine side, then we loose thought and presence of what made human creations so valuable. In other words, if we focus too much on AI, we'll never be able to recover the more human emotional, creation, and natural side of life.

it will obviously get miles better in not much time at all. then what. start rioting. this is enough to be terrified of, assuming ANY rate of improvement. we're entering a horrific future & there seems to be no stopping it

U could just learn music too

it would be good if it could be used

@Andrew Wingstrong Uncreatives will think along these lines

Not really

@@TheLemonKiller I agree. I'm not creative anymore.

@@gRIO904 18 people agreed with me. Nobody upvoted your comment.