me 5 years in the future seeing "video evidence" of me committing a horrible crime that i know i didnt do

I still remember 10 years ago people predicted ai would help replace hard labor so more people can explore their inner creativity; but instead we're in the complete opposite lane where ai is taking jobs away from artists

“your scientist were so preoccupied with whether or not they could didn’t you stop to think if they should?” -Ian Malcolm

Little did I know 13 years ago watching captian sparkles Minecraft playthroguhs as a kid would I be watching him talk about Ai generative tech advancements and its moral ramifications in a video Watching as a man. Whilst him not aging much at all.

Does anyone want to start a new Amish sect where we have technology but capped at 2010 level? 😅

“A lie is halfway around the world before the truth has tied its shoelaces.” That goes so unbelievably hard.

I’m in my last semester as a Creative Media major. I have dreams of producing my own stories or shows one day. The fact that I could spend days making a well-written script just for someone else to do that in a single click feels so wrong! What’s even sadder is that 10 years ago, I was told that anyone in a creative field wouldn’t have to worry about technology taking jobs because “robots can never replicate human creativity.”

This feels like the prelude of the atom bomb. We knew the outcome of the atom bomb, it allowed humanity to destroy itself completely. What will be the outcome of A.I? It's a little too optimistic to think that it will benefit humanity, because humanity could've used nuclear energy for good, but to this day it is used to hold our existence hostage. If Matrix has taught me anything, it's that there is a fate worse than death, and that is never having known the truth.

Captainsparklez talking about the advancements in AI generated video. He wears a black Quality Content sweater and a black headset. He sits in front of a greenscreen and speaks into a microphone. Vlog format. Photorealistic.

Soon, we will see the next version of Will Smith eating pasta when the AI is handed out for general use.

If there is something that can make a teenager feel old, it's the progress of ai. This is just horrifying. Edit: how the heck did i get 100 likes?!

the scariest part imo, is that most footage in security/body cams is not gonna be this high quality, which will make it easier to make stuff that is convincing with few noticable errors that could be used to cause trouble

A lot of smartphone cameras nowadays are using AI to improve image and video quality. So, I guess phones should start saving the original footage as well, in case someone wants to use it as evidence, since it could be dismissed as 'AI altered'.

"This is very human" is gonna be a phrase people are gonna start using more often very soon

The scariest thing about the speed at which AI developed is that it DID happen progressively over time. It just so happened that it exponentially progressed faster and faster. It squirmed its way into everyday life like a worm while morbidly growing overnight and before we knew it, fiction had become reality.

there should be a big watermark/text that says "THIS VIDEO IS GENERATED BY AI AND NOT A REAL FOOTAGE" even if you pay for premium

In the end, you should have put up a text like: "Prompt: CaptainSparklez talks about AI controversies for 21 minutes"

“finally, we have created the Torment Nexus, from world-famous novel Don’t Create the Torment Nexus”

Writing and making art are the only things that truly bring joy to me. And I know many people feel the same. The world seems to be very eager to take that away from us.

7:50 Was literally an episode of Law and Order, the prosecution ended up using an AI generated murder scene to convict a guy they knew was guilty but didn't have enough evidence to convict. (AI footage was given to them by the former coowner of a massive AI company, he gave the state that 'evidence' to become sole owner)

Syndromes quote from the Incredibles is so accurate “If everyone’s super… no one is…”

One thing for sure, the days of canceling youtubers over texts they sent or things they said in videos is gonna either get worse and attack innocent youtubers, or create so much doubt that the guilty ones will get off scott free.

When I was in highschool I wanted to be a freelance photographer. I decided to go a different route and I'm glad I did. I bet some photographers are shitting their pants right about now.

Something that brings me comfort when it comes to ai advancement is that there will always be people against it, we can never be completely overwhelmed by big companies if we still have each other and people that don't want it.

The amount of NSFW content that will create will be mind boggling. There will be so many lawsuits

Every day, the dead internet theory is slowly becoming truer than ever before

I can't even finish watching this, it's making me feel too hopeless

"But rarely are you gonna be analyzing footage-" Well funny you should mention that, as you were saying this, her legs swapped sides. 2:27

Haha, love being a student in a creative digital field and watching as aspects of my field potentially become pointless. Like, we’re already being taught to use midjourney to generate moodboards, things are gonna get wonky real fast and i’m not sure how long my job is gonna last if i’m even ever getting a job in my field.

There will be that one random girl/guy that hates you, downloads your photos, feeds them to the AI in order to make some embarrassing videos just to ruin you

The centralization of advanced AI technologies by a few Big Tech companies is deeply disturbing... Also, OpenAI which was originally a non profit company and all their original software was open source went for profit in 2019. Their last open source entry being ChatGPT-3 was in September 18th, 2020

I will make *3* easy predictions here: *1. More than 90 percent of consumers will not care if something is AI generated or not as long as they find it entertaining.* *2. Companies will not care about replacing human employees, and they will use AI to save a huge amount of money and also be able to release products much faster, which ultimately means earning more money in less time.* *3. There will soon be a point where AI generated content will be indistinguishable from that "human element" that we always talk about.*

04:18 This here is my sentiment towards AI: The technology is incredibly mind blowing, but it has absolutely terrifying implications for all of us.

on the plus side, if the internet dies we’ll have to touch grass on a mass scale

I will NEVER actively consume A.I content. I will live off the grid before i adopt A.I into my daily life.

ChatGPT: I can see how it is useful, and in fact, I use it myself for a lot of things, such as ideas on how to structure essays, topics I could write about, improve and explain code, discuss alternative ideas and solutions, and the list goes on. MidJourney: AI images have a weak wow factor once you figure out it's AI, I still use it for inspiration when I'm really struggling to make something good, mainly recommend V3 for general inspiration for colour or shapes, and V5 and V6 for detail ideas, they are also not too bad for game textures, especially if you nail the lighting and volumetrics. Sora: Its cool, but damn I'm struggling to find a positive use case here, all I can come up with is messing around with it, or placeholders for video, but even then it's not much. It's good that they aren't releasing it yet, Sora is by far the most likely AI to have a serious negative impact.

So basically... the entire world will reenact the salem witch trials. Oh boy.

As someone currently studying to work in film & TV, who is incredibly passionate about storytelling, screenwriting, cinematography, and everything that goes into the making of a film, this is terrifying. I'm a digital artist too, so I've already felt the impact of AI on one of my crafts - commission frequency has gone completely down the drain over the past year. I thought my other dream was safe. It feels so incredibly hopeless. When I enter the film industry, how much of my passion and manual work will be denied? How soulless will my stories become once they get churned through the AI meatgrinder? Will I ever even get to hold the camera? Direct a team of actual people on set? It feels like I'm fighting an uphill battle against a piece of technology that wants to crush my dreams, just so that the billionaires can make more billions.

Anyone remember the Matrix Awakens demo 2/3 years ago? Keanu told us this was coming

I don't know how many times an artist I follow on twitter has posted about someone uploading their art style into AI prompts, it pisses me off cause they worked years and years on their art style just for someone to be able to take their images, train an AI, then steal their art style at the push of a button.

Someone on tiktok made a funny point as to the Sora software-- the SECOND it is released to the general public, someone is going to use it to create defamatory video content of a politician saying/doing something bad, and it will be swiftly regulated to oblivion right after that. Gives me a little bit of hope in these otherwise dark times.

Its scary. There are a very very large ammount of people who dont give a second thought to what they see online and lack a critical bone. So this kinda thing is really going to cause a mass of problems. Imagine if you didnt like a streamer or youtuber, you could make a video of them seing nude videos and post that online and there would be so so little that the person could do. I hope youtube and other platforms step in to provide something to help, something similar to the music identifier.

Feels like we're living out the beginning of a black mirror episode

Absolutely LOVE these conversations you have with us. The genie is indeed out of the bottle. My really big, big worry is about those of us who are aging, and kinda losing our marbles. It's going to be really, really difficult for many of us not to be 'fooled' (I'm in my sixth decade). My students, however, in Middle School seem far more adept at, or rather 'sus' about what they see and read. That in itself is a huge issue! But also a bit of a relief. It's going to be much harder to fool them. But again, thank you for these videos, love your perspective, and your insight. Momibelle

“OpenAI was so preoccupied with whether or not they could, they didn’t stop to think if they should.”

i wish one of Sora's demo videos was Will Smith eating pasta so we can REALLY understand how much the tech has improved

My Paranoia is literally getting worse with each second

As someone in cybersecurity, we are having some real trouble keeping up and I'm terrified.

As someone interested in tech, the technology behind it is fascinating. But as someone who also understands how these are trained and will eventually be used, im terrified for what this means for all creators once it’s available for public consumption.

The more news and developments I hear about the more I think we are speed running towards a dystopian future. I really don’t see any way the benefits outweigh the damage this tech could cause, I mean we are barely able to use the tech we have now responsibly. Video evidence will not be able to be used in trials , the end of art as an expression of humanity, our grip on reality itself could be little to none. I really hope I’m wrong but I can’t shake this feeling of dread .😔 I just hope that the right regulations are put in place to keep us from completely disaster. P.S. I think a quote that applies perfectly to this situation is one from Jeff Goldblum in the first Jurassic Park Film “ Your Scientist were so preoccupied with wether or not they could, They didn’t stop to think if they should.”

My honest hope is that Ai will only be used as a creative assistant tool, and that the audience will view that for of content. I don’t want only Ai generated videos or images, but I would love to see it as an assistant in the creative process.

We have like a million stories about ai being bad, and yet here we are trying to advance it to crazy standards

I truly believe that generative AI should be forced to have a watermark on it, so that everyone who sees it knows it is fake.

6:20 You pretty much took the words out of my own mouth as to my main problem with Sora. I have no doubts that OpenAI is fully aware of how this technology could be abused, and will do everything they can to prevent that. But that won't stop other tech companies from replicating the code and creating their own version that removes these restrictions. The same thing happened when they made the Dall-E image generator. It started with just that, with safeguards in place to prevent the creation of NSFW material and copyrighted characters, among other things. But then other programs like Stable Diffusion, MidJourney, and NovelAI Diffusion come along and remove most/all of those restrictions. I have no doubt in my mind that at least one of them are already in the process of making their own version, and when that happens, there's nothing OpenAI can really do to stop it.

It was actually my dream to START a KZfaq channel and just have fun with it, see where it goes, of course the idea of it being my job in the future was very exciting as well, but for a while now I've been reconsidering, actually terrified of so many things that could go SO wrong explicitly because of AI generated video and audio, and I was pleasantly surprised you mentioned it as well, that you don't envy people starting their channel now. In the past people like Markiplier for example, (him being an extremely "person" content creator, instead of "celebrity") said that they'd never discourage someone from starting a channel, CREATING something and sharing the passion, which became a dream of so many young people, myself including. Now, could someone experienced, who started their CC days long ago, having good intensions, encourage a fan to start their own journey, and shoot for the stars, pursue their dreams? Whilst being aware of all the AI dangers coming with it? Does that automatically mean broken dreams before even starting, for so many people? That makes me very sad, both for myself and for everyone with a similar conundrum, now and in the future. Thank you to whoever decided to read this frickin essay I wrote in a yt comment section, I appreciate it.

I’m an art student studying 3D modeling and FX for media, we’re all now horribly worried because our entire career is in jeopardy.

I have realized that I don’t like watching these videos because they cause me to worry so much about everything, but I also need them to stay updated on the world in a simple and educational way. So thank you Jordan.

this makes me want to go buy a cabin in the middle of nowhere

7:18-8:20 Perfectly said... All the possibilities to use this nefariously scares me

they are gonna make the mission impossible 23 with this one

I'm genuinely terrified of sora possibly becoming public use This is technology that feels like it shouldn't be available for the next some decades like sparklez mentioned I'm scared if art or videos will ever be touched by a human again, I know that's over the top to think but we just witnissed sora while literally only a year ago we had will smith eating pasta the future is scary I hope sora never becomes a public commodity

As someone who has been doing art for 23 years, professionally 12. This stuff frustrates me to no end, I’ve spent my life molding my skills into what I can accomplish today. My usual time taken with each art piece is generally a few days all the way to an entire month, the fact that these people using this software could essentially render me obsolete being they can generate a nearly perfect art piece within the time it takes to type a prompt is infuriating to put it lightly. The last thing I want is people to start commenting on my digital works things like “wow that’s some pretty ai art”, or even having the thought cross their minds that it might be ai art. It took me 23 of my 26 years to get to where I am today and I’m still improving. Don’t take that away from me.

Maybe sometime this year a solar flare will wipe out our main computer systems and we won’t have to worry about ai for a while

Ithink everyone will just give up social media.

I can see this going one way with AI video. Crime

We're living in a 1984 prequel

this is a scary door that should've stayed closed

I just wanted to say, it brings me endless joy that you, someone I watched in my childhood, is still active and making videos. I actually really like these types of videos, as I've grown older now and am vastly more capable of enjoying "mature" content, so to speak. Keep up the good work, Jordan!

The fact this happened in February. April fools day is GOING TO BE A DISASTER

I think that, no matter what side you're on for the AI debate, two things are true: 1. Objectively, this is impressive technology. 2. We need to slow down on public releases of these tech capabilities. Not slow down on the advancements themselves but give ourselves more time to grasp the tech as well as how we can both use and protect ourselves from it. Watermarks simply don't cut it for the general public.

If your product causes more people to feel dread rather than excitement, you shouldn't be allowed to make it. This stuff has no reason to exist and causes more harm than good

Crazy to still be watching your channel after like 10 years, I appreciate how you've evolved your content & I appreciate your take here!! I hate AI so bad & it scares me

The actor and writer strikes last year have a clause about banning AI and never being able to replace actors.

7:51 - This was already depicted with Lincoln Burrows in 'Prison Break', except it was still on tape. - Yes, fictional, but now that stuff is easily doctored and even generated, everyone is generally screwed.

It’s like being impressed at the technical feat of the invention of nuclear weapons

Completely off topic, but I can't believe that a guy who did Minecraft videos I watched as a kid is still around over a decade later. It's a strange kind of feeling.

It needs to be said, people have investigated this and OpenAI has several partnerships with companies such as Shutterstock, which seem to be providing the brunt of the "generation" here. We're still far off from "enter prompt > completely new thing generated". This is why all the released videos look like stock footage, for the most part. OpenAI is still limited by using copyright free footage as it's training data it seems for now.

artists have been fighting this for at least 3 years now. yall never listened to us

Your way of thinking and understanding of this topic is brilliant. I've rarely seen any good and thorough brainstorming analysis on the internet like you did.

My only idea they could do similiar to a watermark to identify when a video is ai generated, is to have incredibly tiny digital imprints in the frames of the videos that aren't noticeable my human vision, but can be detected by technology intended to look for them I'm not sure if that came across the way I wanted, but hoping that's close to something they'll do to seperate the videos from reality, at least in a court case and so on

I genuinely cannot think of a SINGLE good effect this has on anything and I can think of way too many horrendous things that it WILL and IS ALREADY causing. fantastic world we live in.

One day we will be looking for that crazy will smith eating pasta even when we have perfect sora footage. Gonna be a new video style, first.

Will Smith eating pasta is legit the funniest thing I've seen this year so far.

Sounds like a somewhat related set of arguments to the effect of social media platforms, giving everyone a voice removing the level of moat that was around media before.

The "adult entertainment" industry will be all over this.

I think, at this point, it should be the responsibility of OpenAI and similar companies to place something in the meta data for anything made by AI to be easily identifiable. This could still be misused but the layman wouldn't doing anything to obfuscate that meta data. This would at least smooth over a lot of potential misuses of generative ai.

The games you can make from this is amazing and super happy for how this could be used

GTA6 leaked footage is going to be wild

Speaking of AI generated videos, all those science channels with the pfp that has a symbol and black background are all AI generated, the video, the voice, the text, everything.

Mass psychosis entered the chat

I remember watching a lot of your videos back around 2014. I would never have believed KZfaq and Technology would be were it's at now. I was born in 92 and still remember what it's like to live without the internet. It feels like we're literally on the verge of a "Skynet" taking over and no one wants to stop because its from a movie, there's no one cause, money to be made and lost, and wars.

The dystopia is WAY TOO OBVIOUS but no one is making any restriction on it.

This type of AI scares me tbh! You mentioned around 5:50 and 6:00 about nefarious circumstances and i also have to mention about water and environmental concerns! Along with that, AI also steals from artists(all kinds, this includes music artists, fanfic artists and drawing artists) and AI voices have also been frowned apon by voice actors such as thoae who work in video games, shows or movies. Many now have a "NO AI" rule for their work in their contract or website.

I think one of the easiest ways to make it so that AI content is recognizable is to just require all AI generated products, be it text, images, or videos, to have a specific mark in them, not necessarily visible, but there could be some form of serial number in the code of the product, or even just something like a "made by ____" so that people, or even just other AI tools, like what you touch on around the 6 minute mark, can tell easily what it is.

I actually love Jordan commenting on current events. Please do more!

11:09 this is a really important point to consider. The unfortunate thing is that massive corporations will absolutely capitalize on the margins that generative AI can produce. If only there was a way to regulate it so that peoples hours working on stuff reduces, but their pay increases to compensate. that way, the output stays the same (or even increases), people have less hours of work without losing money, and people will actually have time for personal projects and life goals. I wish this technology wasn't starting out in the hands of the massive corporations who will exploit anything to increase their profit margins, because that is the quickest way to crush creativity.

As someone who wants to go into computer science, specifically programming this REALLY scares me.

One day we will see another CaptainSparklez's LP series - The only way we know it's AI, will be when Jardon changes from armor to elytra and doesn'T open the inventory to do that.

Im so fucking screwed man. Ive never been smart for many reasons and I have genuinely harmful anxiety. I cant remember anything cause my mind has been constantly muddled for years and I cant even stay awake without blacking out randomly. Im pretty dam sure I have a fuck ton of learning disabilities, disorders and family problems. All ive ever wanted was to do something in the creative arts because thats really the only job I can work that would work for me and my mental health that would also bring me joy. I sure as hell hope that the law catches up quickly cause I dont know what im gonna do in life if it doesnt.

I will give credit to *Illumination,* at least it's CEO, for taking a stance against using AI, and only using people to make their movies. I *really* hope more animation companies take that stance. (Note: The CEO made that stance a while before sora was even talked about. So hopefully he doesn't change his mind...)