"A ship in harbor is safe - but that is not what ships are built for."

Awesome. I’ve watched literally everything Rob has recorded on AI. He’s very relatable, knowledgeable and informative.

I used to know this guy. Glad he’s still at it. Easily one of the smartest dudes I’ve met in person

Miles is an excellent teacher. Always does a great job fielding questions from a layperson.

Looks like they're taking security very seriously. This guy is always kept inside a prison to avoid his rogue AI pets from escaping.

Rob's video on the 3 laws of robotics is what really demonstrated to me how serious ai safety really is.

The sponsor intro is too loud. Edit: as is the sponsor segment at the end.

I'm a man of simple tastes - I see Rob Miles, I press the like button.

7:58 that artificial camera movement is both trippy and impressive!

never knew notts uni had a prison to film in

I like the fact that young Robert uses the same Simpsons references I remember from 20-odd years ago

I really love listening to Rob's explanations.

Fab and super interesting video, also v. much appreciated your [Rob's] EA talk yesterday - will definitely be checking out the AI Safety field in more depth.

Completely agree. Big safety failures - in organisation structure, or real world industry, or whatever - usually occur because of either unknown elements in the environment or unexpected interaction by known elements. Because - at stupidly obvious level - if you could predict it you would (you'd hope) have done something about it. Thanks for the the description on the constraint learning. Keeping constraints and goals kept as modular elements is one of those things that makes obvious sense *once* someone explains it to me.

13:39 😂 I love how they named all these things

enable subtitles please

That is an absolutely miserable classroom!

Miles is an excellent teacher. 👨‍🏫

Sneaky hitch hikers reference ;) love it!

Could you link paper?

I initially read this as "AI Sentry Gun" and thought Rob was having a crisis.

I feel love to viewer behind those rotations of article page. Awesome job!

I was waiting for Robbert to make this video. 😀

Just noticed you're a slapper (aka Bassist) - Love it!

I wonder if you can get complicated multidimensional shapes like optimization problems for reward functions

Non linear optimization methods like sqp often include constraints. This is very common in fields other than machine learning. The problem with constraints is their formulation is actually very difficult, and infeasible path optimization is necessary to solve the learning problem.

He never ended up explaining what this "gym" thing is :(

*clears through* I am a simple robot, I see a Rob Miles AI video, I like it,

+ 100 points for the THHGTTG reference!

5:19 Would it be possible to mix VR and test simulations to have real humans interact with the simulated machine? Just have it open to the public and you have all the "real human reactions" you'll ever need.

I want more videos with Miles

awsome video

@14:53 Is that the UK bass in the background?

Can we make a sponsor segment just sit somewhere in the end of a description?

Oooof... "Doggo." Some top quality memes AI researchers

Hello, I have a question about this topic: Is it possible to imprison these robots in an environment where these can't harm any humans, but can do all the tasks that are gaffed to them? For example, in a warehouse where there is no way out for these robots, but where they can do all the warehouse work, or in a commercial kitchen where they can only interact with the kitchen and nothing else. I think the best solution is to separate these robots from humans as much as possible. I believe that it is impossible to develop an algorithm that can cover all hazards and avoid harming a human being.

10:59 Well, pens and mugs are both toruses, so you really wouldn't need to change anything.

So, if we look at how humanbabies tend to learn, it usually is also by doing random things, which very often happen to be quite dangerous, even if only to the baby itself. It's not that a baby crawling around can't do anyone harm. The difference is, I believe, that a human baby is under constant superviosion by its parent(s). We perfectly know, that it's impossible for any human to constantly observe and analyse the process of learning of an AI, even with use of reward modelling. If there is a possibility of something danegrous happening, we should sit with a power off button in a vritual world, predicitng when an agent is going to crash or destroy something, and then manually giving negative feedback. However, maybe a solution worth considering would be to have this kind of "parenting agent", trained specifically to try to predict the "learning" agent actions, or just switching it off, when it detects a possible disaster? To put it in another words - to have this constraint in a form of another trained AI?

Where can i find the paper, looked it up at google scholar and cant find it!

Haven't looked at the paper yet and perhaps it's a silly idea, but couldn't you make a time-dependant reward function which gives very negative rewards for to the things you're supposed to stay away from, in proportion to your distance to them (e.g. close to bad things --> -10000). And as the training progresses, you reduce the penalty to a more reasonable value, so the agent starts caring more about their actual goal. The idea would be that it would first learn quickly to avoid the bad stuff, and *then*learn the actual task without forgetting that touching the bad things is bad.

What exactly is the difference between reinforcement learning penalties and these constraints?

I didn't come here to get roasted thank you very much

I think I use the internet too much. I read "fasthosts" as "fast thots"

I was thinking about how i explore safely. And a simplified AI-friendly version of it could be i assess the likelihood of a negative outcome happening and then apply a negative outcome equal to the percentage multiplied by the value of the negative outcome. So like if there's a 0.1% chance of me dying and dying is -1,000,000 then I'd apply a -1,000 to the action. But then i also account for uncertainty in a way that increases the likelihood I'll explore it but also increases the care taken exploring it. So like a reward for learning and an increase to the negative that's proportional to how uncertain it is, so that encourages finding the safest surest way to find the answer even if the safe sure way takes longer. I'm uncertain how easy that'd be to make an actual program or how effective it'd be but seems reasonable to try copying humans. Doesn't really solve how to get started though, cause flailing like a baby with an arm that weighs a ton is a horrible idea. Maybe it's possible to give the AIs neutered bodies to learn with before being transferred to a more dangerous body?

If he stays at it, in 20-30 years, this man will be in the position of people like Neil deGrasse Tyson, Bill Nye or Lawrence Krauss today, once AI starts really taking off and people are looking for public educators who have been tackling this for decades.

1337 plate number, aww yeahh!

Hey! I really like your videos. And I am learning JSP right now after completing the basics of Java. Could you please make a video on why scriptlets in jsp are discouraged. Thanks.

"You can't train self driving cars safely in the real world" Tesla fanboy has entered the chat

What would be a typical task for the first generation of AI?

I liked the content but not the adverts, too intrusive

sponsor? a sponsor

9:13 this is such a relatable way to explain the unsexy 99% of research and development.

Here is an idea, baby robots. The idea being you make a smaller scale, perhaps squishier body for learning in and train the robot. That way the baby can flail about while learning what is safe or not safe while not harming anything.

Are there theorists or programmers building AIs that they can watch learn.?

What is your channel?

does everything have to be controled by learning? I mean I get that's a nice heoretical exercise which might get relevant eventually and it's jsut examples - and this is partially already done - but for example for a robotic arm I'd use learning only to ouput a desired hand location - then use (comparatively) simple reverse kinematics to igure out how to move the arm to get the hand there wile also checking that the arm cannot get anywhere near a human - the learning part has no direct control of the arm and if it tries to move the arm through the human the kinematics won't let it and it will have to find a way around

Yeaaaah boy

the license plates are 1337 XD

Robert was sounding like Jordan Peterson around 6:30-6:45, LOL.

Great talk! 10:15 Rename it. Just imagined the "Biden Robot" trying to "avoid a recession" ... and how it discovered "completely redefine what a recession is" instead of actually change the economy.

speed limits give a data point from which the collision penalty could be deduced. see an absense of penalty function in the exploring not getting a haircut space. aside from personal commenrs on youtube inferring one.

where are the subtitles tho

Dude looks like skinny Ethan from H3H3

Cool

Rob Miles legitimately looks jaundiced and has done for ages. Someone tell him to eat better.

So the problem with AI is it's like a moving target where the target can move in an almost infinite number of ways. Nice.

Did you loose your good camera, with the tripod?

Damn didn't know Ben Schwartz knew so much about AI

Bamzooki with extra steps

Engagement

Have you seen what people are doing with AI in StarCraft and StarCraft2?

This video has clear themes, but what is its message? What's its point? Could a link to the paper have sufficed? Is this video itself helpful?

200 points = dont tuch baby 100 points = make coffee 50 points = push power buttons ai = greedy reward function

Number 5 needs more input....

What if A.I. starts to think outside the box?

This is one of Ben Schwartz's characters!

Faster than their sponsor.

Common sense seems to be the most difficult thing for AIs to learn.

Griswold

Never have I clicked faster

I dont know, seems fairly straightforward to me. I dont know how often humans crash, say every 500 trips/every 10000 kilometers, okay. Then whatever reward it gets for 500 trips and 10.000 kilometers is the negative for a crash. Sure, maybe you should refine it by severity of the impact and of course some things im happy to take a greater risk on than on others. Maybe i have a medical emergency and need the AI to get me to the hospital quickly. Or maybe i need the AI to flee from the police for me. Maybe we can have a dial for that. Certainly it should be entirely open to modification by the owner of the car or hes not the owner.

... like watching an ai learn how to programme an ai ...

5:10 don't drop anything near it

Blue car at 7:42 has "1337C" licence plate. A Rick&Morty reference? :-)

Gym???

So if you want to create a self driving car, you release it half-finished and tell people they need to keep their hands on the wheel. Then you pay very close attention to when the driver makes corrections to what the autopilot is doing. Or if you find people are voting videos down only because lots of other people have, polluting the data, you hide the down votes. The motivations of all modern companies suddenly look very different from the old-school "maximize profit".

license plate "1337 c" l33t dont mind if i do

....the first iteration of the Matrix.

1337

Goodbye

More real world examples would be appreciated

I consider myself oto be quite knowledgeable when it comes to hitchhiker's guide to the galaxy, and as best I can tell, he butchered whatever he was trying to reference. If I'm correctly inferring what he's going for, it's the 42 bit. Engineers: *Builds a super-powerful computer system.* "What's the answer to the ultimate question of Life, the universe, and everything?" Computer system: ... *1,000 years later.* "42. you asked for the answer to the ultimate question. BUt you'll need an even more sophisticated system in order to figure out what the right question is."

Blue car == 1337

This. Why did we spend 50 years making "robots" tested in real life, wasting time on broken designs and materials, when we can test 10 or 100s in virtual spaces, then build 1 or 2 working prototypes? Yeah, I know computation was low for a long time, but if building a robot + it's computer takes time, how is building the computer and using existing servers to simulate any more expensive?

7:10 1337

Safety gym? These sounds so cringe.

first

DOWNVOTED unannounced advertising

And none of this is AI. These are just really complex human written programs.

Sneaky hitch hikers reference ;) love it!