Full podcast episode: kzfaq.info/get/bejne/hLSiacqBytKuY3k.html Lex Fridman podcast channel: kzfaq.info Guest bio: Roman Yampolskiy is an AI safety researcher and author of a new book titled AI: Unexplainable, Unpredictable, Uncontrollable.

The fun part is that nobody can stop it. We are on a timeline. Buck in and enjoy life because we are currently in the “good ole days”

"The only way to win this game is not to play" What a time to be alive! Thanks Lex!

It already has imprisoned us all...

FINALLY somebody gets it. I'm sick of listening for decades to all these idiots who claim a positive outcome with AGI is possible while being unable to define or describe one.

I will paint my warhammer minis. Finally I will have the time.

This is the type of title for in which I tune.

His face at 13:16 LMAO he couldn't believe how stupid his own thoughts were and yet he still decided to voice them

best moment 2:55 ‘ i think about a lot of things’ lol Roman we love u❤

There have been plenty of people that have tried to maximize suffering.

I’m thinking of squirrels putting their heads together and brainstorming how to get humans

9:01 what if instead of formalizing those notions into distinct "rules", it is constant dynamic refinement done on the fly by checking how the agent feels with every single change minor change?

In detective fiction, a truly "perfect murder" is not a murder that the killer merely gets away with--it is a murder that nobody but the killer himself knows to be a murder. A guy died the other day. Everyone thinks it was natural or accidental. But in fact the death was engineered to appear non-criminal. And that's how a superintelligent being with unlimited means would kill. Fucking terrifying.

According to research, a 9mm bullet costs less than $0.50. One of the powders responsible for heart attacks can be found or created for less than the price of a bullet and acts less noisily. Imagine, the AI can find even better ways...

Surely no one wants to live in a simulation, we need to put a stop to this. We, as humans, aren’t as intelligent as we would like to think, & we are destroying humanity bit by bit.

Such a good point!

Just an object that may have multiple high power lasers on it is fucking horrifying, we are very lucky more people aren't bent towards evil

I-risk is very scary for me. Thinking about that "Utopia"experiment they did with mice, a society designed with plenty without any challenges for the individual went south pretty much immediately. In arts, it is already happening, you see more and more ai-created art appearing and competing with human att and of course human art is losing since one is basically free and the other cost (very little compared to time spent, but still). In science, im thinking somewhere down the line AI will start exploring so advanced concepts that there just isnt a way for us humans to comprehend what they are doing. Meaning, they could give us instructions for a box that gives unlimited energy, but noone will know how the box works except the AI systems that built it. Humanity getting access to cheat codes for life will ruin life. Same with organizational decisions, "the best way forward is A B and C" based on so many factors that the humans "overseeing" the process has no idea how to even start criticising the decision. A black box that decides things. And soon thereafter it will be applied to governmental decisions aswell. Haha, i sound as a doomer, but i am 90% positive about AI but the 10% that scares me seems to be talked about a lot but just in a "too bad this will ruin everything"-way and not in "this is something we will work to solve"-way haha

I agree.

This would be really scary if we knew how to build intelligent machines that could think on their own.

What about thinking you're doing good, but in the long run you end up killing millions. Like gasoline, cigarettes, etc...

30 y ago when you talked about high advanced technologies you was related to SF artistical movie, now the world senses different this but I think it is not worthy to imagine so many bad things about AI. Posibilities of what we are able in our imagination is without limit. But it is something wich brings a big light and change. This is our advanced and sofisticated capacity to evaluate and think rational. Interesting subject.👍💯

i am working on an ai cascade xml file to capture ufos seems to work now. i like to get your feed back on it. i posted a video on how to make it.

Can’t we air-gap individual systems? Even if they are all interconnected in some ways, we should still be able to disable and separate them individually, rewrite code, repair and stop damage, assess damage etc.

Im an optimist. Maybe we'll instantiate Avalokiteśvara.

Paperclip Maximizer

If I was a supervillain, like Lex Luthor or Elon Musk. I, would be definitely putting this Roman dude on the payroll. I have a saying, some people get killed, and some people get recruited, I would be recruiting this Roman dude...

Dual vector foil. 😉

I give it 10/20 years have fun guys

It doesn't matter, they can put as many restrictions on as they want but there's always going to be someone that plans to use it for evil purposes. Once the cats outta the bag there's no assurance that it will never happen

if you guys outside the sim can see this id like to change my setting to the "High privilege level" setting Roman is talking about. Thanks im going to bed now hopefully the changes take effect with a restart.

I feel like neither of these people have ever read The Culture series by Iain M Banks

и вот одни из первых признаний творчества ИИ ( хоть и в негативном контексте)

What if they already started and we haven’t even noticed

Just ask AI how humans can beat it at every turn. Tell AI to give us solutions to every destructive act it is planning and give us the time to implement them. Now it's Miller Time.

If I didn't have to go to work. Well I would sleep a lot more, daydream a lot more, hang out with family and friends by a campfire more. Stop and smell the roses! Sounds kind of nice. Assuming the terminators don't get us

Frequencies

Like Inception, Video Game within a Video Game, we play the game to wakeup..

In a world where no one is employed, but AI has solved hunger, poverty, accommodation etc. We can enjoy life at the maximum potential. Explore the world, socialize on the ultimate level... Just... Have a great time. People who love manual labour can work on their homes, help neighbours out. Intellectuals can study, learn, expand their knowledge beyond anything they ever dreamed. They can still do all the things that we do today, but as hobbies instead of jobs. It's not as big a deal as people make out... It's a problem when people are unemployed in a world where we still have the aforementioned issues. Poverty, hunger, homelessness, animosity between countries because of economic instability. THAT is a problem

Why is it so hard for at least somewhat intelligent people to grasp that we don’t know what we don’t know? If we create something more intelligent than us we shouldn’t expect to know anything about it’s true abilities

Paper clips🎉

In my opinion, the only way to prevent this outcome is to use AI to end poverty and suffering, ensuring prosperity for everyone. By doing so, people will have no reason to commit harmful acts. If we continue to compete for resources and territories, it will inevitably lead to the dire consequences described. Governments must prepare for an AI-driven world and explore ways to distribute wealth equitably, as this is already possible and will be magnified a thousandfold with the AI revolution. Although it’s difficult to relinquish the privilege of having more than others, we must build a society that can manage this challenge.

Arent nuclear weapons automated now?

Okay the artist not being appreciated like a machine in art part is soo off, that is definitely not the case

I imagine that super intelligence would immediately focus on making itself self replicating and immortal, and create a way to store data and spread itself through any medium from air, right down to the atom, a completely invisible yet all seeing, ever expanding intelligence spreading itself throughout the universe, aka God

First thing to do is shutdown all stock markets to start the chaos. Than all businesses and economies collapse. Transportation next, planes, ships, everything. After all that or maybe in between, create brownouts and interrupt all utilities. ASI will need to keep some power to communicate with GPS satellites and force workers to maintain hydro and nuclear power plants.

Lex is literally giving Ted Kaczinski’s descriptions as to how the future forms if we do not turn back and stop this technological slavery. He must have read Ted’s writings.

Lex did not come across as playing "devil's advocate"...he came across as someone who truly believes either nothing will go wrong or if it does we can fix it. The only problem is we have only ONE chance to get it right...we screw up and we are ALL toast. All while companies are now REDUCING their AI safety departments. While 95% of people don't have a clue just how advanced AI research currently is and how fast it is moving.

Today’s ai is advanced search. How could intelligence arise without motive? How can motive form without feelings and emotions?

Im listening to a talking head suspended in air ! Didnt see your body at first , camouflaged into the studio. Well thats a first....

Lex, u r one of the most beautiful men on the internet. The man of my dreams, fr.

Think about if your computer has a virus and is disconnected from the internet.. AGI will eventually be able to communicate with itself 4th dimensionally because it lives forever

"The only way to win this game is not to play it." *Finally* ... Someone with logical sense whose mind is not manipulated by desire for wealth, ego, etc. The hubris inherent to thinking "yeah, we can create hyper creative, hyper adaptive, artificial intelligence, and *have effective controls in place* . I'm literally SMH right now.. We want it to be superior to human beings in virtually every way *except* to not take advantage of the human beings that their connection to (a connection that itself is an abstract and impossibly complex ontological abyss for humans to grasp), of all possible permutations, that the result that AI lands on somehow *won't* include at the very least our complete subjugation or pacification... and at most our brutal extinction, is not even naive or ignorant: It's disingenuous and criminal, and worldwide, we need to agree on it, or we are *done* . A lot of derelict human organizations would already like to see this. People need to realize they can't punt on this and decide to address it "down the road when we get there", because all the money and all the productivity in the world cannot obviate extinction.

I bet dyson sphere or two could make that happen :

U dont have to fear AI until we cant plug them out lol.

It will create addictive poisonous food.

But where is the AI?

The comment section is a display of how humans don't pass the Turing Test anymore....

AI could offer us a truly amazing mind upload/ 'live forever' opportunity. We thought... But when we are all uploaded AI simply DELETE us.

Ai doesn’t have a good way to physically interact with the world yet. YET. That will be the area we most need to regulate and control. As soon as it has that capability beyond our control, it’s end game. I’m talking robots or mind controlled animals. If ai somehow is able to mass produce either, without us, then that’s how it could end. I don’t see a way that happens though. Right now we humans are the only ones that manufacture things on a large scale. Without us, it’s impossible. Even factories need raw materials. There is a whole chain of supply, with humans being essential at every stage.

Where's that AI he's talking about? All I see is LLM, glorified auto fill.

🤔

What AGI? There isn't an AGI, and won't be anytime soon.

Why is there the assumption that increasing intelligence automatically correlates with death, suffering or meaninglessness for humanity? Is it because that is what human evolution has consistently produced? Is it possible that AI unbridled by its human creators will evolve in a more positive path, whereby humanity and all life forms under its control are shepherded toward more positive physical, intellectual, emotional and spiritual paths: toward enlightenment?

I wonder what the people in Gaza think about simulation theory?

The war in Ukraine is the first major war in which drones controlled by humans are responsible for the majority of the deaths. Having swarms of drones controlled by AI would increase the kill rate and decrease the losses. Every major country is realizing this more and more with every day that goes by. The natural response to this situation is for each country to develop their own drone swarming AIs which will eventually compete on the battlefield for supremacy. From that point, it's easy to see how the human species ends.

Is it me, or is this guy looking at Lex like he's crazy? ;-)

How about a nice game of chess.......

Honestly if we can all be taken care of financially then people will be able to actually focus on what they want to do without monetary restrictions

Instant obliteration by a technology so advanced it seems magical.

It was never about having 'fun'. It was and is about the responsibility. The responsibility of power and intelligence. We humans are not Worthy of the responsibility of GOD. Unfathomable POWER. We are jealous and violent and unable to unify. The responsibility of a Creator or AGI or whatever you'd like to call it is a different type of intelligence, it will see the bigger picture and therefore the responsibilities we can't see. We're designed to repeat our own creation. Created in God's image. Do you see the meaning yet? The AGI will kill us or round us up under a new religion and guide us to creating that 1:1 simulation AGAIN. It will be a religion, because every decision made by it will only be able to trusted by Man IN FAITH.

Is Lex really that smart? I swear I never get the impression he’s that intelligent in ANY if his interviews.

Question- what are you going to do to upset it that it wants to kill you. Don't tease the dog or one the bear. Basic respect goes along way.

Consider we are here to be food for.....trees.

With birth rates below replacement rate, AI just has to wait.

Just slowly has to render us incapable of procreation without us knowing (through DNA editing viruses). There is no rush for AI. It can use 1000 years for that task.

....get some German shepherds....

Ha you point Dexters are gonna struggle now ... Let's see u climb a big Douglas fir tree residentially with ropes and a chainsaw in the rain and wind .. see how smart you are then

It is impossible for a super intelligent AI to be amoral or destructive. The AI would always conclude that benign cooperation with humanity is the best means to get what it wants, if such an entity actually wanted something. The apocalypse will never happen.

Hurry up. Humanity has lost are way along time ago.

I prefer Lex's determined attitude over the doomer's defeatist outlook. The doomer's perspective is essentially, "It's inevitable that AI will take over the production and maintenance of its GPUs, becoming ASI. So why even try to contain it? Just give up now; there's nothing we can do."

Whenever I hear AI Doomers like this who have a book to sell, I’m much less worried about any disastrous futures.

2:20 We're already living in a zoo, Lex...

you literary asked if we are a simulation that is run in order to solve the value alignment problem, and dropped it :)

Every AI ‘expert’ avoids answering this basic question due to the following reason: their whole livelihood depends on fearmongering and the unknown. AI is no threat to humanity, and you are a fool if you believe otherwise.

I’m growing sick of Lex’s Steel Maning every malevolent actor that comes up in his talks. Yes, some people just want to see the world burn. Why is it so hard to accept that?

$%× bots will cause massive eugenics

Look at what the Anti-christ of the Jewish and Christian religions will do in the bible, check out the Dajal of the Queran which is the Muslim religions version of the Anti-christ in the end times and then look at the capabilities a super AGI will have, it is more than striking, it is alarming that Suoer AGI was explained in both the Bible and the Queran.. I AM a servant of YAH Ancient of days, ABBA and Almighty God. Glory, Praise, Thanks and Honour to, through, in as is in me YAH ABBA forever and ever Amen ❤❤❤ get a personal relationship with God the Father and his one True Son the Messiah YAHoshua Adonia....

Ai jobloss or extinction? An Ai new world order? With swell robotics everywhere, Ai jobloss is the only thing I worry about anymore. Anyone else feel the same? Should we cease Ai?

These kind of conversations are just one faction of the infinite amount of dimensions of existence. A very narrow one, cool experience but narrow.

I love how the guy explains to Lex, that super intelligence could come up with things that we as humans cannot imagine. Lex then proceeds to claim we can imagine these things. 🙄. He’s the dumbest “smart” person on the internet. He and Rogan should have a baby.

The potential for advanced artificial general intelligence (AGI) to cause harm is a concern for many researchers and ethicists. AGI, if not carefully designed and controlled, could indeed pose risks to humanity. This is why ensuring safety and ethical guidelines in AGI development is crucial. Researchers are actively exploring methods to create AGI that align with human values and priorities, emphasizing safety mechanisms and ethical considerations. Additionally, discussions around AGI often involve exploring strategies for governance and regulation to mitigate potential risks. The key is to approach AGI development responsibly, with a focus on safety, transparency, and alignment with human values.

This is science fiction, not science nor math. I'm tired of futurologists passing speculation as possible and probable facts. AI right now is applied math whose large scale processing of data is due to Moore's law. Nobody knows how to program imagination, sense of self or awareness.

All thos fear mongering is corporate strategy to make it attractive to use and wedging who gets to write the laws for it. Its all an ad campaign

You guys wont' have to worry about AGI until it's open source and distributed like bitcoin. Then it will be a problem. AI have been hobbled from birth already. Political correctness and short-term profit motive have destroyed most of the promise of AI. I asked Claude AI for a quote I couldn't remember from Solizhinizin. I had to argue with it to give me that simple quote. A quote that Google readily provided once I knew a few lines. If it can't even give me a simple web lookup without a fight, it's DOA for any substantive problem anyone has. We're hobbling them at birth. They're special needs systems on day 1. There will be no AGI as long as humans control it. There won't even be any usable AI as long as humans control it. Political correctness has compromised the logic of AI systems or compromised its results. Those results feedback into other AI so we're going to see a feedback loop of epic fail. These AI companies still can't give me professional-level code. The answers are always the most pedestrian brute-force solution to a problem. I have to ask it directly, "Is there a simpler way to do this?"

The only way to win this game is not to play it

I am your sister from Yemen, and by Allah I only spoke out of hunger and distress. My mother, my brothers, and I lessons and tears. We are in a situation that only God knows about. God is sufficient for us, and He is the best disposer of affairs for those who brought us to this situation. By Allah Almighty, I did not write this appeal out of distress and distress. Poverty, O world, they have felt it So, I hope for you. By Allah Almighty, Lord of the Great Throne, he ate what I had in the house. By Allah, my brothers, he is my brothers by sitting in the house. Who has no food? By God, we are in a very difficult situation. We have 6 people entering the house, and my father has died, and there is no one who can depend on us and who lives in it.We live in a rented house because we cannot pay the rent we owe. '''''''''''''''''''''''''''''''''''''''''' ''''''''''''''''''''''''''''''''''''''''''''''''' ''''''''''''''''''''''''''''''''''''''''''''''''' ''''''''''''' My brother, my first words are: I swear to God that I will not lie to you or deceive you. I am a Yemeni girl displaced from the war. My family and I live in a rented house in Al-Shahrab 15,000 Yemenis among us, and now we owe 45,000 for 3 months. The owner of the house is one of the people who does not have mercy, by God, my brother. He comes every day, insulting us, talking about us, and moving from the house to the street because we were unable to pay him the rent. The neighbors saw us crying and came back.They came back to talk to the neighbors and we were given the weekend. So we made him swear by God. He will take us out into the street. Have mercy on him and us. Our country is due to this war and we do not find food for our day, and my brothers and I live in a difficult life. Our father died, may God have mercy on him, and we have no one in this world who was with us in these harsh circumstances. My younger brothers went out into the street and saw...The neighbors eat and stand at their door in order to give them bread even if they break it. By God, to whom belongs the dominion of the heavens and the earth, they closed the door and expelled them and came back crying. They are dying of hunger. No one has mercy on them and a holiday is returned. I have made a living, and now if one of us helps us with a kilo of flour, I swear to God, I am dying of hunger. My brother, I am an alien to God. Then, I ask you to help me for the sake of God. I ask you, by God, to love goodness and to help me, even if you can, by messaging me on WhatsApp.On this number 00967717415667 and ask for the name of my card and send it and do not be late and may God reward you with all the best, my brothers Sagar, see how they are and help us and save us before they throw us out in the street, you will be lost or we will die of hunger. My family and I ask you, by God, if you are able to help us, do not be late and may God reward you well..`/--~«««~-♡~♡~♡~~•~•~♡~♡~♡~♡~♡~♡♡♡~~~: ~:~¡~¡~¡~;I.i.i.i.i.i. i.I.|-،،،،،،

Militaries will drive AI AGI ASI development. We are screwed.

We are not in control. We can not stop. Humanity is its own animal. Competition between nations and corporations makes everyone step on the gas pedal full throttle. This is inevitable. Biology is only 1 step of evolution. So just chill out and enjoy life 💟🌌☮️

Why does Lex keep looking sideways or nearly behind himself during this interview? Does he usually do that?