Playing Minecraft Inside Terraria

Playing Minecraft Inside Terraria | Project Showcase 4

Рет қаралды 94,681

Күн бұрын

Fairly quick project I cooked up using Terraria as a digital display for anything you want including images, videos, and games. Took me about 3 days to fully implement in code and another week or so to edit.
This project was tons of fun, thanks for watching! I hope you all enjoyed.
Quick note: the code for the Terraria mod is super spaghetti, I didn't program it very structured at all. I might clean it up in the future and update the github but for the time being it'll be pretty messy and convoluted. Also all the file paths in the mod/python files are removed since they were for my local machine so you'll have to put those in and recompile the mod yourself but it's pretty straight forward. If you want to get it up and running just create a template mod in tmod loader then replace testsword.cs with mine.
GitHub - github.com/Brendan-Kirtlan/Te...
Music Used (in order)
Scott Lloyd Shelly - Overworld Day
Scott Lloyd Shelly - Alternate Day
Scott Lloyd Shelly - Corruption
jin601 - underwater potion ( / underwater-potion )
jin601 - magic pixel ( / magic-pixel )
jin601 - cafescene ( / cafescene )
jin601 - SOMeONE!! ( / someone )
jin601 - explanation ( / explanation )
jin601 - phlegm ( / phlegm )
jin601 - / jin601
Video Chapters
0:00 - Intro
0:24 - Background
0:53 - Converting pictures to blocks
3:21 - Playing videos with blocks
3:40 - Displaying games
4:00 - Huge problem
6:48 - Attempting to find diamonds in MC in Terraria
23:17 - Outro
obligatory forsen reference

Пікірлер: 323

@cephelos1098 3 ай бұрын

>no identification header >no checksum >no blocks Absolutely based, best image format

@BKBinary 3 ай бұрын

Will probably become the industry standard for storing images I’d imagine

@pictotalk Ай бұрын

i prefer it this way

@Console.Log01 Ай бұрын

does away with a couple extra bytes for maximum compression

@bobosaurus331 Ай бұрын

It has no checksum, but does it have .chumseck?

@Because-Linux Ай бұрын

Chum actually isnt a bad idea if you wanna have something really computationally innexpensive to export with. Not practical after that tho.

@Roxas90250 Ай бұрын

You know, when Terraria first came out, a lot of people were calling it 2D Minecraft. Now I can safely deny those claims, because Terraria is apparently just 3D Minecraft.

@That1Knife Ай бұрын

You mean minecraft is just 3D terraria 😂

@SertWasAName Ай бұрын

huh?

@TetsucabraLover Ай бұрын

Minecraft is 3D forager, and even forager has more content.

@katiehill7552 27 күн бұрын

terraria actually released before minecraft

@thesurvivor6430 23 күн бұрын

Out of 4 replies how did no one understand the comment 💀

@xrayessay 3 ай бұрын

For someone’s first terraria mod this is insane.

@droko9 3 ай бұрын

The problem you are trying to solve is called real time color quantization, and there are a number of cool ways to optimize it. If you represent RGB as 3D space, you could store your pallet in an octree which would drastically reduce search times

@BKBinary 3 ай бұрын

Never heard of these, thanks! Will definitely look into these

@jambosuss 19 күн бұрын

@@BKBinary Would be cool to have a follow up where you optimize it, maybe have the computation shared on more cores(if possible) and try and win a CS go bot match

@pierwszywolnynick Ай бұрын

1:50 Congratulations, you just invented .BMP format

@johnsherfey3675 Ай бұрын

*ppm It's literally just a ppm.

@quedtion_marks_kirby_modding Ай бұрын

Bmp doesn't has alpha?

@WAWA-yo4dg Ай бұрын

@@quedtion_marks_kirby_modding bmp has a secret hidden third half assed 32 bit export option in gimp

@johnsherfey3675 Ай бұрын

@@quedtion_marks_kirby_modding He made a binary-ppm it's physically the same.

@realyunggranny Ай бұрын

@@quedtion_marks_kirby_moddingit does but according to the Wiki it requires compression to support the alpha channel, so default bitmap is just a header with RGB bytes repeating until EOF

@Ghi102 3 ай бұрын

For more accurate colors, maybe you could have considered converting RGB to YCbCr and calculating according to the distance of the Y (luminance or relative brightness) component. You could consider CbCr slightly in your calculations, but matching to Y first will get much better results since humans see differences in relative brightness much more than differences in chroma (the Cb and Cr) This is a principle used in image compression algorithms if you are curious, where most of the Cb and Cr information is thrown away with very little loss in perceived image quality

@BKBinary 3 ай бұрын

Very interesting I didn’t know this, thanks for the comment! My first version of picture conversion used luminance with seemingly random scalars (but didn’t take account for color so it was grayscale). I didn’t know you could combine luminance as well as the colors to make it more accurate.

@JamesTDG Ай бұрын

This is often seen in the JPEG format if I am not mistaken

@aleksaaleksic4353 Ай бұрын

Using a picture of ray william johnson for the word "until" is hilarious

@wilkal. Ай бұрын

what my cs teammates are playing on:

@user-fc3cz6nh5j Ай бұрын

My guy did something so unthinkable, so undone before to such a degree that people thought he was trolling.

@jerem33bdx 3 ай бұрын

The association of RGB color to terraria block is called color quantization. The way you are quantizing RGB color pixel wise is, while simple, suboptimal in term of result quality. The problem with this algorithm can be seen with the following example. Let say you want to quantize an image full of the same purple pixel but you only have red and blue color in your quantization set (no purple). The result of your algorithm would be an image full of red or full of blue (depending on the distance between the purple color and the red and blue color). A better result would have been to place blue and red pixel next to each other to obtain an image that, for the human eye, would look purple ! This process is called dithering, you can check the Floyd-Steinberg dithering algorithm that does exactly that. Great video nonetheless, looking forward for the next one !

@user-on4if5jw6s 2 ай бұрын

I also think it would be possible to use a kd-tree with 3-dimensional coordinates (rgb values) and find the closest euclidean distance in logN time, instead of the linear search he was preforming

@JoBot__ Ай бұрын

Dithering would result in better image quality, but it would also take more processing power.

@xNezrx 3 ай бұрын

this video is infact epic

@BKBinary 3 ай бұрын

You are epic sir

@DonnaPinciot Ай бұрын

Most controller mods specifically disable Minecraft's pausing and keep registering inputs when unfocused, because a primary use for them is running multiple games on the same computer for a 'split screen' experience.

@blu3260 Ай бұрын

_Primary_ use? I thought the primary use was to play it with a controller.

@DonnaPinciot Ай бұрын

@@blu3260 _A_ primary use. Obviously the _main_ purpose is to just have the game with a controller, but doing it split-screen has been a big thing for these controller mods since 1.7.10 at least, and that tradition has carried on.

@Falkov Ай бұрын

OMG, your mining luck seemed terrible - which adds to the reward for sticking to it until achieving it. Cool project!

@the_red_gamer 27 күн бұрын

No way checking his channel was the person who also created the "file storage on KZfaq" video time ago when I wasn't even interested in Terraria and this video wasn't created. You for sure deserve my sub

@BKBinary 27 күн бұрын

Thank you! Really appreciate you sticking around since day one :)

@LeatherCap 3 ай бұрын

excuse me it's not a leather helmet, it's a leather cap

@BKBinary 3 ай бұрын

Leather helmet til the day I die baby

@FireNLightnin Ай бұрын

Instead of calculating the euclidean distance for each vector, you could take the dot product. The largest dot product will signify the most similar vector. For vectors x and y, rather than calculating dist(x, y) = sqrt( (r_x - r_y)^2 + (g_x - g_y)^2 + (b_x - b_y)^2 ) for the euclidean distance (or even calculating the squared distance to avoid computing square roots every check), you can save computation time by instead calculating dot(x, y) = ( r_x*r_y + g_x*g_y + b_x*b_y ) this has the same number of additions and multiplications, but saves on 3 subtractions and potentially a square root per calculation. Though, this is probably a micro-optimization and you won't see too much benefit. Love chum btw, never change it.

@raphaelcardoso7927 22 сағат бұрын

Thought the same. Hidden advantage is that you can batch many dot products in a vector matrix multiplication

@user-fc3cz6nh5j Ай бұрын

Bro decided to do the opposite of the computer in Minecraft where you can play terraria on 💀, this madlad

@larryisdead429 2 ай бұрын

im so happy i found this channel, just binged watched all your uploads and excited for whats tuned keep it up bro💪💪

@JamesTDG Ай бұрын

I think if you wanted to improve performance, you could use a custom texture pack that limits MC's colors to what your screen supports, and then apply fullbright.

@CocoTheTortie 3 ай бұрын

We appreciate the torture you put yourself through to make this ❤😂

@underscore95 Ай бұрын

You could have premade a lookup table for each colour, if you used 2 bytes per colour and excluded the alpha value then it'd only be around 35mb of ram, then you can store the block to map each rgb pixel to in a massive array and then you can look up the colour in constant time. great video though!

@PaulPlay Ай бұрын

Your image format is cool, but why didn't you just use the Bitmap image format? 🤔

@thething.2635 Ай бұрын

bump

@fujiwaraofmokou Ай бұрын

I think part of the horrid frame rate is due to the fact that you’re making screenshots, converting them to CHUM, picking up the file in Terraria, then converting that to Terraria blocks. I think you could cut the first png to CHUM conversion entirely by instead of screenshotting, individually taking each pixel of the screen and writing it into a CHUM file. I’d personally do it in C (or at least Cython) to make it faster as well.

@john.darksoul Ай бұрын

Also writing and reading files is really slow, some form of in-memory IPC would help i think

@ronanru 3 ай бұрын

Ok, this is crazy

@aleksandarzahariev9886 2 ай бұрын

Not sure if you check but terraria has 32 paint which can be applied to almost every block which will provide you with a very broad spectrum of colors, also not 100% sure but I believe in the configs file you can also change the render distance as I believe resolution is somewhat of a limiting factor in this.

@v2sauce Күн бұрын

pretty sure paints only show the paint color in the map， without regards for the original map appearance。

@A_Aphid Ай бұрын

Loved the video! I just wanted to share a couple of tips that might be useful to you or others from my experiences with topics close to this. For reading the window without obs showing up above it or if other windows are dragged over the window I like to use win32 and PrintScreen from that module as it allows you to read the windows image even if other windows are above it or the window is inactive. I also like to use win32 for sending keypresses and cursor movement (tho that's a bit buggy) as it also allows you to control the game from inside other games with something like a custom item. Instead of like in your case having to plug in a seperate controller and changing config files, however this can restrict some movement as it isn't as easy to control. Also I don't fully know if you in counted this issue with minecraft opening the pause menu every time you tabed out but if you did you can press F3+P to stop auto pausing from happening when minecraft goes out of focus. Anyways sorry for such a long paragraph. Hope that is helpful to someone atleast.

@user-cy7ny2db6s Ай бұрын

next video be like: "playing minecraft inside terraria inside minecraft inside terraria"

@BrunoValadaoCunha Ай бұрын

The palette looks amazing, i'd definitely play that (in Minecraft, full speed and resolution)

@memetech- Ай бұрын

1:45 it also lets you store an image with a width or height of 0, even if the other dimension is not 0

@lordedmundblackadder9321 Ай бұрын

the graphics are certainly something but my god the aesthetic is unparalleled.

@Xavus-137 3 ай бұрын

I'm impressed.

@itromacoder3088 Ай бұрын

I REALLY, REALlY want him to see this, so please, like this comment. alr, so if you wanna fake focus a window and restrain xinput on terarria, u can use neucleus coop by getting the terraria handler and making it your own, the doc is shit, but it works, so if u wanna play another game in another game, this will be your friend

@JeremyFinch42 17 күн бұрын

Terraria: Try Minecraft! Minecraft: Also try Terraria! * Static sound. * Terraria: WAIT- Minecraft: NOT LIKE THIS- * Demon core sounds. *

@FarbrorBarbro 3 ай бұрын

4:07 forsenE

@elementalwoof Күн бұрын

Here is a silly idea, you could precompute all of the tile IDs as an array and use the RGB color as an index into the array. With RGB color 8 bits per channel there are only 2^24 different options, in other words about 16 megabytes worth of memory usage assuming the tile IDs are 1 byte. Another way to potentially speed it up or save memory is to discard every other bit, that way your 24 bit RGB color becomes a 12 bit RGB color.

@naygoats955 25 күн бұрын

This is ludicrously cool

@LOL_MANN 3 ай бұрын

Lil bro really said lets add 3D dimension to Terraria 💀

@proxmbeats Ай бұрын

You know what? I’m done. (unpapers your minecraft)

@abdullaheta Ай бұрын

🤓☝️Umm..Actually D in 3D means dimension so you don't have to write it again 🤓☝️

@LOL_MANN Ай бұрын

@@abdullaheta It was supposed to be 3rd but lazy to ad r

@KatzRool Ай бұрын

as a bro im shitting and farting a lil too much

@Isakovsck Ай бұрын

@@LOL_MANNthats crazy

@frossy365 Ай бұрын

You’re a friggin legend wtf

@bagel-the-fox 5 күн бұрын

I can't wait to see .chum used everywhere

@ValeRay2 Ай бұрын

"playing" minecraft inside terraria. Honestly thought any kind of game like this would likely come through to be able to display something, using some way to do it. Cool.

@raphaelcardoso7927 22 сағат бұрын

Instrad of doing euclidian distances to find the best block, you could do a dot product and pick the greatest value. Performing dot product by many vectors at the same time is a matrix multiplication and it would be very efficient to do thzt in numpy. At least more so than looping xD

@SadNathan Ай бұрын

Bro actually played it pretty awesome

@TheOfficialXaMi 20 күн бұрын

An idea: Instead of streaming the image from Minecraft - create a mod for Minecraft, which streams a slice of world from player into the -Z +Z direction. Stream that straight into the terraria worldgen class. Terraria's worldgen is not multithreaded (unlike Minecraft) so it should be easy to just suspend the thread to wait for the connection with Minecraft and just stream blocks right into the Terraria worldgen and map the blocks from one game to another (you could default to stone if a block is "exotic"). Then make the games communicate such that a move forward in terraria - moves your player in Minecraft forward. If you also handled destroying blocks - you technically can PLAY Minecraft from inside of Terraria. Crafting could also be theoretically possible as Terraria has similar items as Minecraft - you would just need to map them. And Minecraft's Mobs could be spawned inside of terraria, but that would require overriding AI and a lot of work in general. But the simple concept of walking on Minecraft's world in terraria is very possible. If you're considering this - hit me up, I can help.

@NiceHyper01 Ай бұрын

this is pretty cool

@webbergaming1873 16 күн бұрын

It would be cool if you gave this tech to Luke The Notable , i am sure he is notable enough to survive 100 days in it , maybe even beat the game .

@ponali.mememaker 9 күн бұрын

1:29 HOLY SHIT A DEV JUST REFUSED LITTLE ENDIAN LETS GOOOOOOOOOOO

@user-dx3zm3no8v 17 күн бұрын

You are a genius

@onlysenta Ай бұрын

MAKE BAD APPLE :) in terraria for sure

@Lodestone8 Ай бұрын

Now there’re the caveats of the paint colours which can radically change the colours of the blocks and possibly improve image clarity significantly

@Einhamer Ай бұрын

As an alternative to play minecraft with a controller, you could've used a small local Minecarft server. You play minecraft in another computer that opens it's world in LAN. Then, connect to that world in the computer you're gonna be recording and make the player spectate the server's host player, so you'll be seeing all of that player's actions and then, just stream that directly into terraria, while being able to play MC with no problems in the other computer.

@Deltaderg Ай бұрын

One thing you could try for a larger color palette (other than dot products as people have mentioned) is divide the 256x256x256 RGB cube into equally-sized cubes (ex. 64x64x64) with 1 Terraria block per cube, then integer divide each Minecraft pixel's rgb values by the cube size (ex. 64) and use them to refer to a 3D array of Terraria blocks. Basically constant-time lookup at that point, and 64x64x64 would allow for a 64-block palette I think

@NStripleseven 3 ай бұрын

Isn’t your .chum file just a slightly simplified .bmp?

@BKBinary 3 ай бұрын

I’m not sure, I looked into using BMPs to use but there was a lot of junk I didn’t need for my use case so I quickly abandoned the idea

@damnthisisabadname 2 ай бұрын

Great video

@CobaltSpace Ай бұрын

Qoi may have been an image format worth considering.

@HerobrineTVv 20 күн бұрын

Funny Project, I might have a idea to adjust the color rendering speeds, which would also make it possible to add more variations Did u try to split your big table of colors into smaller ones? Idk if it is doable to sort the coloring to sub tables, but if yes u could safe like alot of time for each pixel, so you search like a equal thing on the colors or like a range or smth and then u can check if the desired color for this pixel is inside of this sub table if the sub tables still have like alot objects, u could try to put them in another table etc Only a Conceptional Idea, cant promise its doable, but might be in my opinion

@EuanRipper Ай бұрын

Very cool! for future reference your chum file exists and is the .BMP format

@bushidoben 3 ай бұрын

Warzone in viva pinata next pls

@BKBinary 3 ай бұрын

I love you Benjamin

@andreivoinescu9364 Ай бұрын

you could cache the block palette in a lookup table so it would have to do it 16 milion times and after the entire lookup table it should run pretty smooth. it would be nice if you had access to the minecraft frame buffer but i don't know how hard that would be but it would be more efficient than taking a screenshot then encoding it in a different format

@user-gb8jp8ew6z 3 ай бұрын

Your work is amazig!

@BKBinary 3 ай бұрын

Appreciate it!

@gaimnbro9337 22 күн бұрын

Perfect

@CarolineIsMe 3 ай бұрын

Real neat!

@bgoldpanda7265 10 күн бұрын

The quicker way to do the mapping is to use the dot product of the terrarira vector and the rgb. Then take the maximum of the dot products. I used this technique for mapping analog controls to WADS controls for a game I’m working on.

@bgoldpanda7265 10 күн бұрын

It’s faster because you avoid doing the sqrt in the distance functions since dot product is just multiply and add

@tbot3459 Ай бұрын

Now I can’t wait to play terraria in minecraft

@froge4300 Ай бұрын

you could try using the dot product for the palette, less expensive to compute afaik and maybe even more accurate

@timothycalco8089 20 күн бұрын

very cool

@Jenthura 2 ай бұрын

I'm so sorry, but if you had been mining about 50 blocks upwards you would have increased your chances of finding diamonds significantly. Mining right above bedrock is not great for diamonds.

@doginboat Ай бұрын

Great pfp

@matthewrease2376 Ай бұрын

False

@monke4044 Ай бұрын

Terraria in minecraft is one thing, but this is just mad

@paddingtono3823 Ай бұрын

now he just needs to play terraria in minecraft, and then use terraria to play minecraft to complete the loop

@feathersm7966 Ай бұрын

have you considered threading haha. sick project

@HmmmmmLemmeThinkNo 4 күн бұрын

This was awesome! And also why would you do this to yourself x.x

@shoGUNwithGUN Ай бұрын

Hell yeah someone has finally fixed terarria

@Nicehat- Ай бұрын

Now we need minecraft in minecraft in Terrarien

@SomnicC Ай бұрын

The fact that ive seen a playing Terraria inside minecraft and seeing this the day after

@splatplays Ай бұрын

yay

@realdiardopro 18 күн бұрын

Soon enough we will have terraria inside terraria inside minecraft terraria

@zanderthelegend8225 Ай бұрын

i feel like to make it less laggy (the frame delay in terraria) you could 1: change the map code or in game timer to a much higher tick or update speed, and most importantly 2: ONLY pass a chum if the current frame has a significant (determined by threshold) difference from the last one.

@scratchbeginner2954 Ай бұрын

11:37 "Deepslate stuff? I don't remember how it's called". Yes, it's called deepslate and it was introduced in 1.17 with cave biomes and new ore textures. You are in 1.20.

@DiamondWolfX Ай бұрын

Chum sounds like a fancy bmp

@deltara2106 22 күн бұрын

Maybe adding caching to the euclidean distance calculations could improve speed?

@Kraxel-North Ай бұрын

Finally, actually 2D Minecraft

@pro_beanz Ай бұрын

Have you considered using your GPU to speed up the conversion of RGB values to terraria blocks in parallel? You could also try disabling smooth lighting in Minecraft to dumb down the colors and improve visibility in Terraria

@quedtion_marks_kirby_modding Ай бұрын

Wouldn't it be easier for the image ti have the pallet colours before saving it? Like do the transfortion to the pallet colours directly and then load it into terraria.

@gaebreeuhl Ай бұрын

now we need playing terraria in minecraft!

@decoy3418 21 күн бұрын

Been done before.

@AwakenedHero227 Ай бұрын

Now you should make Terraria playable in Terraria

@user-qp3qj2jv6f Ай бұрын

That format is basically PPM. Also, you have mentioned that adding palette colors would make the rendering slower because of the euclidean distance calculations. How about cutting out the square root? That would probably still work and is by far the slowest calculation in that formula. Edit: just checked the source code, you did that already

@nonetrix3066 Ай бұрын

>Have to calculate block for each pixel Feels like something you could use threading for, are you doing them one by one I'm assuming?

@blu3260 Ай бұрын

What about trading resolution for palette/performance? Would that help?

@Solesteam Ай бұрын

Yeah, the Tmod discord usually just directs people asking for help to either a long essay on the history and function of C# or the Terraria source code... Edit: Nevermind, this seems to just be a me problem.

@j0hnr3x 15 күн бұрын

I don't get why you are switching to the map view when playing Minecraft. You basically see the same screen but the quality is just worse?

@ZILOGz80VIDEOS Ай бұрын

Bmps might also have been able to accomplish your image file needs

@Beniblach 2 ай бұрын

So if i see correctly, you have a lot of knowledge when it comes to coding and encrypting. I am writing this because i have a question to ask. So the story first: I have a playstation 3 with a 500gb harddrive in it. I wanted to use the safe files on it to be used for the PS3 Emulator. I did the stupidest thing however. I accidentally formatted the drive when going through the disk management. I didn't use the drive and never put anything on it afterwards. Later i tried using TONS of recovery software to recover those files. One of those programs was actually succesful and recovered some weird and interesting data. It found several .DTA files and most of them have a file size either equal to a gamefile or a savefile for the playstation3. Now for the question: Since PS3 Data is usually encrypted i want to know if it is possible in ANY WAY to get those files back to their original state and to be readable again by the PS3?

@arnifenrenso2940 Ай бұрын

One creeper and this guys computer explodes

@bard_roul Ай бұрын

Now we just have to wait for somebody to make Minecraft in Terraria, in Minecraft.

@user-zj4zd9on4v Ай бұрын

congrats you are playing minecraft in 16 colors in terria

@Skullkid16945 Ай бұрын

I am still in the beginning part of this video, but already wondering if you could use Terraria as a graphical shell for Linux lol.

@saycrain 3 ай бұрын

wasn't a .bmp file possible to be used aswell for this instead of making a custom file format?

@duynguyenkhuong2043 Ай бұрын

Just now need some how to play terraria in minecraft

@Live-Paradox Ай бұрын

a way you could have made the colour system better was since your using the map, you check the colour of the block from the maps perspective

@fry_fr Ай бұрын

every block does have a color it displays on the map coded into the game, i assume those colors would be better to use if you were to upgrade this display