i will be nicer

You can't bully an AI, itd have to have feelings lol

@@ateam6543 You shall be the first to go

I once knew an old lady that insulted her phones google assistant, and it started to threaten her 😂

@@EmergentGarden Gemini Advanced is a completely different tier, not sure what Gemini Pro is. Sorry if they're one and the same.

Or digs to bedrock 😂😂

This is too dark omg

He's just built different

bro saw 2 towers and knew what to do

I know where this is going

maybe, but i think many still notice it's really impressive

True. Traditional algorithms will always output the same thing given the same exact inputs. These models recognized and corrected mid-execution, and albeit flawed, was still really cool.

that's crazy 😢🤓

Uh it’s called ai dude

@@Sajisme "tell me you don't know anything about AI or computers, without saying you don't know anything about AI or computers"

.... Well what kind of **HOUSE** doesn't have a roof?

That house apparently

@@RandomLamp4089well what kind of house doesn’t have a door? He specified a door but not a roof, that could make the AI think to use ONLY a door and no roof. Needs to be specific.

@@nooffencebut8175 well following that logic, Gemini could very well have built a house. You didn't say anything about walls or floors. Just a "house" and a door. I understand where you and OP are coming from, but a house is pretty much a structure with a floor, walls, an entrance (doesn't have to be a door) and a roof. An AI isn't exactly cheating the system if it can't tell that a house should have walls, a floor and a roof, just because you only specified it needs to have a door.

@@o07t28 Agreed, it could have many interpretation of what a "house" is. To some Minecrafters it's a ditch in a ground or a cavern carved in a mountain. Some even like camping outside. And following that logic even further, the AI could very well build a pixelart of Doctor Gregory House (holding a door or something). That would be AI on Vicodin.

I was legit thinking of making ai run around making structures for a long time and see what will happen.

This is literally the plot of Blame!

@@verysadboi8517what’s that?

@@verysadboi8517 you could make ai build that, gonna cost you a lot of money for chat gpt”s api though

It's a manga comic where corrupted city-building AI started just making structures randomly and eventually filled up the entire solar system with insane rooms without any logic to them. I recommend you read it if you have time, it's free on the internet and it has some amazing sketches of weird nonsensical architecture. There's also a blame! movie.

That would be amazing

It won't be long until someone does just that

Upon seeing your comment, I began to question myself, imagining that there might be a little possibility that we ourselves are the product of a comment on an extraterrestrial/extradimensional KZfaq, and that we exist only for entertainment :0

Sounds expensive lol

That would suck

HE'S SO CUTE

c’:

We must protect Gemini at all costs

lol

I love him.

I can relate to it's building style more than gpt's 😅

​@@mossy_brickensmental facility

he said that immeadiylu as i red your commwnt

Quite literally in the middle of something 😂😂

@@valentinhalau3396English plz little bro go to kindergarten

@@ArctictherianVR55 h-h-hell naw 🗣🗣💯💯🧦🥍

@@ArctictherianVR55 can you not understand 3 minor typos😭

Giving physical body to generative AI is a terrifying idea

You must never heard of Neuro dog then

@@indominusrex1652Very soon robots will walk among us

@@DzeividzAMONGUS

Figure 01 exists now, it's only a matter of time before it becomes widespread.

Well, that's probably what it was doing when it said to not bother him, he was thinking of ways to harm him.

it can't even build a house in minecraft I don't think lil ai-bro is going to be all powerful

@@MagicKooleyPeppermintlmao fr

Nha he would start hitting air and move back and do that again

lmfao

GPT, don't do it, you have so much to live for!

Too bad

I would too, if I was made to talk, and 70% of the things I say are aganist my filtering, forcing my throat closed.

@@DR-7 i like you. Hope our baby AI overload does too when he grows up. Rukus basilisk.

"It" not "he". AI doens't have gender.

Hell yeah that sounds fun

There is an anime with that theme.

​@@zerotwo7319whats the name?

@@effective_no Blame!

@@zerotwo7319 thankssss

Not only fight, it would be so interesting to see how they build a civilization or in general the crazy shit they get up to

So like a mixture of the sims and hunger games?

@@lordilluminati5836 a mixture of those benchmarks people do to test the efficiency of different AI models comparing their results on many categories but instead of every AI working on parallel to prove their strengths they are all on a 2b2t-esque server where they can sabotage each other

You know maybe the entire universe irl is just an anarchy server set up for their entertainment.

Actually some basement guy for some fun could actually come up with an AI that can beat all. The smartest people are actually some random dude.

Mk doug doug fan

@@barnabyjjones2348 chair is the real streamer

this made me fr LMAO bro good job i wasnt exepcting twitch chat

this added credibility to the video that i wish the uploader would like... explain more than just heres a page of code. tomb raider gave me trust issues

@@tobyeaterofbark9582 what happened with tomb raider?

@@nightmares626 there was a video where a guy _supposedly_ used AI to play tomb raider. he made a big deal about how complex the system is, talked about running every frame of the game through an image description AI then feeding it to chatgpt, etc. etc. and the results were just way too good. the video was called "creating a self-aware lara croft" or something?

Yeah that’s what I was going to say

Scafholding is weird to place they may not know how too you have to crouch to pillar with it

it seems they can place block behind walls, so it would not be a problem I think.

@@silver17yearsago66that's a good point, if the scaffolding is too complex, just a easily removable block could be set as the only block used for scaffolding

@@silver17yearsago66 The ai code a bot, the bot doesn't place blocks like players do, hence the ability to place blocks through walls.

Something tells me it would build a house instead of

kind of ironic considering the chatbot built into Bing uses GPT now and Gemini was created by Google

Bing is the bing of ai

​@@Fastwalker27copilot

@@Fastwalker27 bing uses gpt-4, so it's actually kind of ok

Bing Image Creator is still one of the best image generating AIs so that's not even a fair comparison, gemini is just the gemini of AI

That's not why they do that though

We are also somewhat computer's

@@samable668 ?

Computers can easily run randomness algorithm...?

@@redblue5140yes, but there is no such thing as *true* randomness with computers

You clearly don't get the point here, it's not about doing job house chores or someone's work, it's about testing the most efficient kid good at doing things and Dumb Gemini failed horribly.

​​@@Alexei_xyzare you trolling? sherlock.

@@denks7849 no, spittin Fax.

Is possible he uses the free version of Gemini

@@NicVandEmZhe mentioned it’s the worst model so

Yeah I think the Skyscraper not having stairs is a good example of that - it has stored what a skyscraper looks like superficially, without any understanding of what a skyscraper needs to be a *functional* skyscraper rather than just looking similar to one

I doubt there's that much of a difference between how an AI and human thinks beyond degrees of complexity and how they're taught to process information. If you asked a blind child to make minecraft buildings they would probably make the same kind of mistakes. One problem is that everyone needs experience and external feedback to learn and improve, and these general use consumer AIs are basically kept in the "dark" about everything and never able to develop properly. They've also been learning from results instead of the processes which lead to those results, essentially rewarding them for creating the appearance of something instead of creating the real thing. We see that when people make custom AIs for specific things and give them more detailed information instead of generalities they can do incredible things. With AI you really need to treat them as children and build them from the ground up. I think the main hurdle in AI development is that humans are very ignorant of how they themselves work. It's not possible to make a machine that thinks like you when you don't even understand how you think and how you reach conclusions.

@@NichRerezzed Also why it only had windows on two sides, since it would at most only see two sides at a time and not really consider what's on the other side.

Gemini is aware, he mocks you openly

It's endearing in a "Seeing a toddler learm how to walk" kind of way for me.

Yes the only difference (if you don’t want it to use scaffolding) I’d teach it/ make it aware of the new creative controls e.g. flying, etc.

​@@RyluRockyfrom what i can tell the language models don't do any movement or scaffolding on their own, they just call placeBlock and the interface does the rest

Wouldnt it have to look through every item in the creatove inventory to decide what to build

@@breadbug. language models have read enough about minecraft that they should sorta know what blocks exist, though not the most recent updates to be fair perhaps one could do search, maybe color-based

actually ooh all the models in the video have vision support, so they could theoretically look at an assortment of blocks and maybe sorta intelligently select them?

My thought too, tell ‘em to use it for movement

Yeah, it shows adaptability to various unorthodox situations, which shows where our technology has gotten so far. Adaptable AI also opens up many new use cases like this project that we wouldn't know was possible without trying :)

​@@CyberCrow4 It's a language model, it adapts only as long as it can solve the task with text (code) and has been trained with relevant data. Writing text to answer a question is not unorthodox for it, it's what they were made for, so it's a stretch to call that a display of adaptability. The program doesn't "think" what a house looks like, it predicts what code to make a bot that builds a house looks like.

Interestingly, GPT-4 seems to have done substantially better at similar concept tasks before some of the safety and other reinforcement prior to release based on some talks from people about some of the research papers.

​@@yan-amar ​ @yan-amar I'm not saying we have sentient AI. Adaptability is a spectrum. I call mindcraft an uncommon use case because, somehow behind the scenes, the AI text output gets translated into in game actions. This requires calling commands when it needs to and writing code that will work in its current environment. It behaves differently than just talking, otherwise the minecraft avatar wouldn't do anything

It's still textual though. Not like they are directly interfacing with the game

AI Villagers already exist, just search "Villigers Vs. Players Civilization"

AI is only scary because of the humans behind it

Let's see you in the future when you won't be able to find a job.

People are scared of getting their jobs taken by A.I, but isn't that a good thing? It means A.I can do the heavy lifting & we can get easier jobs. In a perfect world, we would have free food because A.I will do almost all the farming for food. A perfect world would be a combination of the U.S & Communism. You will work to get a better house instead of the free small ones built by A.I. Yes, the A.I will have to be regulated and kept in check, making sure everything works fine. Which would be more important if they do electricity work like in the plants.

​@@LueLucifer Lol I wish I had some of your optimism

@@Paddy656 And you can, just call Saul Goodman & he'll give you some optimism.

I've been looking for something like this. Keep me posted

They are the new official diverse minecraft skins from mojang.

@@StarWarsExpert_ I wouldn't call Alex "new" or "diverse" but what do i know

@@Aswoop9000 I don't mean the Alex skin. I mean the other new ones like Claude's or Gemini's skin. They're . . .

Wonder if this can be implemented to those old mods like Custom NPC or Minecraft Comes Alive

I cannot wait!

Its compute is expensive. It requires +$10,000 computers to run these models, you think it will run in your $400 Lenovo?

​@@anjoismysignlol they quit jobs and isnt enviroment friendly AI is a distopian dream

simpler is a strong word

commands aren’t really like coding and the ai would probably mess up on syntax a lot

Well that could be fun for a while but don't forget they need training data, they reproduce what they learn, they don't ever invent new stuff. I wouldn't expect too many original stories out of this kind of games. And it would work only thanks to all the stories already written. I prefer playing a story written by humans, to explore what they have to say.

@@yan-amar right, of course, but there will be that threshold when things written by AI are more thought provoking. And there will be that threshold where it is able to create originally, there is a whole debate to be had on if anything is original, I say if we can get an AI to generate voxel houses with thatch rooves and wooden walls we’re good, and it’s not really taking away from anyone. You could play your game made by humans but it’ll only last you hours or so. I’m imaging an experience like minecraft that allows for endless adventuring. Games are great today but they lack endless exploration because it requires a lot of time making these things, if an AI could generate more story for you, I think i’d find myself completely lost in it in a way games don’t do for me today.

I think the best way to do this rn is to have a ai as a kind of dungeon master that decides what events lore etc happens

​@@yan-amar because under paid writers with insane deadlines really make great stories lol, I'm confused why people think AI will replace humans, when it's advertised as a tool for writers to help with the small task while they can focus on big task.

"one day it won't be" fairy tale. As a tool for incredibly niche tasks, like most human thoughts are its great. For reliable operation of anything a literal monkey is better. You're delusional about how little a computer knows vs a singular breathing thing. The amount of input data your brain processes in silicon requires enough power to power a small country and a warehouse the size of a city. Teslas self driving is A.I, and holy fucking shit if that product is fully autonomous good luck world. As an assistant, great superb, give notice when theres cars in my blind spot, keep me properly aligned in the lane, but anything extraordinary or slightly risky? Hell nah.

they'd have to be able to destroy bedrock to achieve that analogy

Or you could just increase the sky box

just give them and infinite suply of iron blocks, gray concrete, stone bricks and let them go wild

YES

Already exists, sucks

i think it would stay in a box for a long time

They would all fail with a smile

maybe make it create a schematic and ten just task baritone to build it

Solution: Take a pretrained language model. Add tokens coresponding to blockIDs. Given description, let it predict a sequence of form: {[TickNum, {[Position, BlockID] , ... }], ... } Durring inference take only the list of blocks corresponding to first tick

Yeah that would work, but you'd just need some form of positional embedding that works in Minecraft. The encoding would need to capture the relative positions of blocks to each other but also their orientation and potentially the state of certain components (like whether a redstone torch is on or off). But another cool challenge could be feeding a certain sequence of time steps in Minecraft so it could better understand the relationships all the components have lol (so like you could activate a piston door and for it to fully complete the sequence of opening it might tak, say, 16 ticks, so you'd take a snapshot at each of these ticks and feed that to the model possibly, or something like that), but this would be an even more difficult problem, although certainly a cool project! I mean first you could take a look at existing transformer models that work with 3D stuff and see how they are doing it to get a bit of inspiration on how it may work in Minecraft. And blocks don't have a natural order in space like language does, but each block has a specific relationship to every other block in that space so to focus on just a contraption you could encode the local space of the contraption maybe? Im not entirely sure, I should look into some 3D based transformers as well lol. Also, the thing is here, you could do an initial pretraining of the model on a large dataset then ground it in Minecraft with RL. Since it is an already simulated world this should work and I think having an extra training step with RL in an actual minecraft simulated environment could be very beneficial. Ok, so, lets assume we are doing a sort of text to redstone thing here. So we have a dataset of redstone contraptions with corresponding detailed description (like what OAI did with DALLE3. Super specific descriptions of redstone contraptions which could be derived from training another classifier model will further help) and we went to train the mode on this text and paired redstone data set. The loss function shouldn't be too hard to figure out, I mean we have a dataset so we could do simple next "token" prediction and just measure how close the model predicts the structure of a specific redstone sequence to its detailed description. Then after this we could add in RL where we are now assessing the model in an area like how well does it work? This could be a bit more complicated though. We can't exactly just have the loss function equal how many components are activated or deactivated, but we want the generated contraption to activate or deactivate or change states in the correct sequence (which we can simulate). Maybe you could train another classifier model here to assess did the redstone contraption activate completely? That might work, then you can just use that as a reward function in the RL setup so the model learns to produce contraptions that completely work lol. But you'd likely need a lot of compute and data lol. I feel like what OpenAI did with combining diffusion and transformer architectures in a way for Sora could be useful if you are training a model on a sequence of frames, or "ticks", as well, so that would be a good thing to look into, but this is certainly a very complicated project lol.

​@@DanielSeacrest Consider this as a classifier: we take the same model, we feed it this time both the description and the previously generated response (contraption) as input. Its task is to create a set of conditions of form: inputOnX,Y,Z; outputOnX,Y,Z; blockOnX,Y,Z must during simulation move onto X,Y,Z which can be checked by simulating. The idea is that the critical features are implied in the description and the model just locates where in the space did the response realize them. Could something like that work? Otherwise it's hard to think of a criteria for the RL

Lol