Web in Native Assembly (Linux x86

Web in Native Assembly (Linux x86_64)

Рет қаралды 54,386

Күн бұрын

Playlist: • Web in Assembly
Chapters:
- 0:00:00 - Announcement
- 0:00:56 - flat assembler
- 0:02:36 - Hello, World in fasm
- 0:12:10 - fasm is Self-Hosted
- 0:14:07 - fasm Macros
- 0:20:23 - bm
- 0:21:49 - fasm community
- 0:24:25 - Plans for the Session
- 0:26:32 - Starting the Web Server
- 0:29:10 - Creating the Socket
- 0:38:08 - Stealing Constants from C
- 0:39:22 - Inspecting with strace
- 0:42:10 - Inspecting with gdb
- 0:49:19 - Storing the Socket in Memory
- 0:55:19 - Handling Socket Error
- 1:00:40 - Log Tracing
- 1:05:23 - The Difficulty of Binding the Socket
- 1:07:26 - Allocating sockaddr Structure
- 1:19:46 - Populating sockaddr Structure
- 1:25:52 - Binding the Socket Address
- 1:32:06 - Closing the Socket
- 1:35:45 - Listening to the Socket
- 1:39:55 - Accepting the Connection
- 1:53:32 - Responding with Plan Text
- 1:55:05 - Responding with HTTP Response
- 1:59:59 - Request Processing Loop
- 2:03:22 - Outro
References:
- flat assembler - flatassembler.net/
- Chromium OS - Linux Syscalls - chromium.googlesource.com/chr...
- tgrysztar - fasm - github.com/tgrysztar/fasm
- Tsoding - bm - github.com/tsoding/bm
- MenuetOS - www.menuetos.net/
- nakst - gf - github.com/nakst/gf
- musl - libc - musl.libc.org/
Socials:
- Twitch: / tsoding
- Twitter: / tsoding
Support:
- BTC: bc1qj820dmeazpeq5pjn89mlh9lhws7ghs9v34x9v9

Пікірлер: 198

@garakchy 8 ай бұрын

Protect this geek at all costs. He is a gem in modern world where people find even python a difficult language.

@snk-js 8 ай бұрын

yesss, I am so grateful to find deep content in the surface of the web

@aziskgarion378 8 ай бұрын

Sadly, his government will snatch him and force him to be a part of their military programs.

@varshneydevansh 8 ай бұрын

Python is difficult as it hides so many things behind the wrapper 😫

@shedontlove8490 8 ай бұрын

He said it quite clearly on his last Twitch stream: "There's no magical book or course that will make you a programmer. Just endure the pain." That's the only way you can learn programming.

@axelkoster 8 ай бұрын

@@shedontlove84901:02:38

@cobbcoding 8 ай бұрын

oh my gosh he did webdev in the language the memes tell me not to learn because it is hard oh my.

@ocaly 8 ай бұрын

But what a beautiful video he assembled here today for you!

@nikkehtine 6 ай бұрын

The best way to do web dev is without the tools that have been made specifically for web dev

@angelcaru Ай бұрын

too true@@nikkehtine

@helidrones 8 ай бұрын

For me as a late boomer / early gen X this feels like coming home from a long journey. No dependency hell, can be debugged with pen and paper. Thank you!

@rkdeshdeepak4131 8 ай бұрын

Best Web Dev Tutorial for beginners.

@davidebiondani3062 7 ай бұрын

Hahaahah

@bitmanagent67 8 ай бұрын

Tsoding is a freaking genius!!! I love the way he decomposed problems and solves them one by one. He is a real OG programmer.

@DivineDarknesss 8 ай бұрын

the cubicle bound webdev fears the recreational assembler

@brunopena3710 8 ай бұрын

this is what i thought WebAssembly was at first.

@bbq1423 8 ай бұрын

1:32:20 You can use the `goto out` pattern used in the linux kernel here, as in for each error branch you'd do `jl out_x` where x is an incrementing number, then at the end of the function you have the labels in reverse.

@yyvan5125 8 ай бұрын

Watching this taught me a lot, on top of you explaining how things work, reading some docs and following along in c is super fun. Thank you mr Tsoding

@im-anomalies 7 ай бұрын

Dude, I really appreciate what you are doing, it is rare to have such of deep content (at least to me who is a junior myself) but yet entertaining. I really love to see and learn how things work under the hood, not just using them, and most of your video just fit that.

@sortof3337 8 ай бұрын

I watched and followed everything in the entire video. Oh man, it was so satisfying to see hello world. I even parsed the name myself. Thank you thank you.

$@nefrace$

@nefrace 8 ай бұрын

This is the first video that I've fully watched on your channel, and now I want to try fasm in gamedev

@konstantinsotov6251 8 ай бұрын

That's what I thought of when I first heard the word "Webassembly"

@gnorts_mr_alien 7 ай бұрын

That was really fun you made me watch the whole thing!

@victornikolov537 8 ай бұрын

I like you find all that fun. That is the way to learn. If one can't enjoy learning it is torture.

@JannisAdmek 4 ай бұрын

If you ever feel neglected, just remember the EXIT_SUCCESS and EXIT_FAILURE he defined at 59:40 and then ignored for the rest of the stream.

@paoloose 8 ай бұрын

i can literally watch you coding for hours

@tonym5857 8 ай бұрын

Great video ... took my attention from the beginin..

@disoversity 8 ай бұрын

This channel is amazing.

@Arniores 8 ай бұрын

watched the whole thing, actually cool

@legendrags 6 ай бұрын

Yesterday, I didn't even know this guy. Now, he is one of the best ppl I know.

@grenadier4702 8 ай бұрын

Sockets automatically close on program exit Backlog defines the queue of waiting-to-connect sockets and already-connected sockets. If your backlog is 100, you have at maximum 50 connected sockets and 50 awaiting sockets

@varshneydevansh 8 ай бұрын

I watched this stream and it was amazing 💪🏻

@kompocik5195 8 ай бұрын

I love how you explained syscalls so fast. I do know that you don't make tutorials but maybe you would like to do one about Assembly etc. because you're explaining everything in very easy way without unnecessary theory while doing real-life examples :P.

@iamdozerq 8 ай бұрын

this IS a tutorial for everyone who wants to learn

@pokefreak2112 8 ай бұрын

all his videos are already tutorials, you can follow along and learn exactly what he's doing by googling the parts you don't understand I've been watching since 2019 and learned a ton anything more trimmed down than this would lose a bunch of important information

@rebokfleetfoot 8 ай бұрын

i've done my share of assembly, but never thought about it as a web app, wild and cool idea :)N

@akashkarnatak6581 8 ай бұрын

What a madlad!!

@Tepigers 8 ай бұрын

cant wait for the cobol web development video 🙏

@remrevo3944 8 ай бұрын

1:56:35 In my experience you can also always just open the network tools and capture one request. That already shows enough about http to be useful.

@JamesSjaalman 8 ай бұрын

The size argument to bind() is also needed for copy_from_user to know how much to copy, without knowing the exact subspecies of the polymorphism. (BTW: the overlaid "struct sockaddr" construct is often named a "smart union")

@Tawre007 8 ай бұрын

"struct sockaddr" hopefully doesn't want to get raised pay

@shipitko 8 ай бұрын

wow, the development screencast by anyone who is not indian on youtube in 2023! instant subscription

@JakobKenda 8 ай бұрын

13:15 I downloaded the fasm executable directly from their website and it is, in fact, statically linked

@TurtleKwitty 8 ай бұрын

It's so fucking funny that tiny assembly shit takes 3 passes when C refuses to have more than 1 haha

@TsodingDaily 8 ай бұрын

Oh yeah! That's the most interesting aspect of fasm! Your meta-program may keep shifting the address of the labels so fasm may do as many passes as necessary. It has some upper limit tho.

$@nefrace$

@nefrace 8 ай бұрын

1:02:49 -- now that's my favorite way to tell user that everything is ok "Oking service"

@bbq1423 8 ай бұрын

There is a pretty neat clang built in that lets you dump structs in a formatted way (__builtin_dump_struct)

@billwall267 8 ай бұрын

Tremendous. Please do more fasm vids.

@whoopsimsorry2546 8 ай бұрын

Well, x86_64 has it, however if you were dealing with x86 amd and intel have different ways of calling syscalls and you'd have to use the vDSO. That's the original reason vDSO was created so you don't have to different syscalls for the different architecture. However, nowadays the vDSO also contains stuff that just shouldn't require kernel access like get_time() and stuff like that.

@__christopher__ 8 ай бұрын

On x86 you can just use INT 0x80, that works on both architectures.

@f1refa11 8 ай бұрын

это слишком офигенно

@bbq1423 8 ай бұрын

1:45:20 The size field is calculated the wrong way around

@julesl2087 8 ай бұрын

yeah it's "$ - .sin_family"

@remrevo3944 8 ай бұрын

@@julesl2087 Or as written in the documentation also just $ - .

@hughdavenport1 8 ай бұрын

I had a similar issue with not having names in the debugger. I looked into the specs needed. In the end I used porth (yes porth!!) to read the custom debug file fasm to create some more asm (and maybe C?) files so that the debugger knew the names!

@jamesnewman9547 8 ай бұрын

Starcraft used IPX by default for networking

@rt1517 5 ай бұрын

1:23:43 It is really easy to implement htons in assembly using XCHG instruction. And for htonl, there is the BSWAP instruction. And for information, in C, you can use __builtin_bswap16/__builtin_bswap32 under gcc and _byteswap_ushort/_byteswap_ulong under msvc.

@HPMuwa 8 ай бұрын

You forgot close connfd, maybe if browser get close or content-length, it would be faster because browser will know that content is over

@HPMuwa 8 ай бұрын

And will not wait new content

@orizach01 8 ай бұрын

this whole video reminded me of the time you did basically the same thing but in porth

@orizach01 8 ай бұрын

1:28:20 this made me smile

@ichigo_nyanko 8 ай бұрын

Hello, 'not a low level person', nice to meet you.

@alexandrohdez3982 8 ай бұрын

Great 👏👏👏

@Tigregalis 8 ай бұрын

since i am learning technology from tsoding, and tsoding is a meme lord, does that not mean i am learning technology from memes?

@cold_ultra 8 ай бұрын

So when can we expect a developer bootcamp for beginners using this stack?

@lnlnxlnx3685 8 ай бұрын

Very interesting

@telnobynoyator_6183 8 ай бұрын

> interpreter that outputs binary No way I had a similar idea a couple days ago for my own programming language and now I'm seeing an example of that x)

@tomaspecl1082 8 ай бұрын

This is cool. And btw I also had a similar idea before. Basically its not an assembler. Its all macros. Even the "instructions" are just macros. That way you should be able to use different instruction sets with it by only changing the definitions.

@huistelefoon5375 8 ай бұрын

it's called a compiler

@oracuda 8 ай бұрын

more like LLVM IR@@huistelefoon5375

@andy_lamax 8 ай бұрын

I just had a crash course on syscals and I am mad how I understood them in under 12 mins

@krenilraj4180 8 ай бұрын

Bro which course can you tell me ?

@SaifKhan-lq1sp 8 ай бұрын

@@krenilraj4180this video lol

@ProtossOP 8 ай бұрын

@@krenilraj4180I assume he meant this video

@andy_lamax 8 ай бұрын

this video 😂

@krenilraj4180 8 ай бұрын

@@andy_lamaxLOL

@wisnoskij 8 ай бұрын

This language seems so cool. For me, It is weird thinking about code being OS dependent. The OS they built for example in in theory either be written in Windows fasm or Linux fasm or possibly even written in fasmOS fasm and only compile-able on itself a different kind of self hosting.

@jamesnewman9547 8 ай бұрын

I also did a very similar thing back in the oughts by writing go functions that when called, looked like G-Code and output gcode to stdout. So then I have all the power of golang, but then my main was this go-gcode hybrid that output gcode when run. Yeah.

@rationalityfirst 8 ай бұрын

On my Arch install fasm is static. I use Arch, btw.

@__christopher__ 8 ай бұрын

Your second sentence is redundant. Well, technically I guess you could have an Arch install without using it ...

@ce5983 8 ай бұрын

@@__christopher__bro was invoking the "arch, btw" meme so people wouldn't think he was just saying that to highlight his use of arch. I'm using Arch rn, btw

@ukuluhamaa5908 8 ай бұрын

It does seem that fasm not being static is a debian thing, in the arch repos it's static.

@keremardicli4013 8 ай бұрын

Visual studio is on the market since 97!

@huistelefoon5375 8 ай бұрын

And it still keeps getting worse!

@KitsuneAlex 8 ай бұрын

Does bind really determine the type based on the size? Looks more like a validation thing to me, the actual type is probably deduced using a union-type approach where they check the address family, since that's always the first field of the struct. At least that's what i'd expect. Good video :3

@anon_y_mousse 8 ай бұрын

This might be why I used nasm instead, but I've been trying to figure out if you can do variadic macros and none of the examples from the fasm website are working with fasm itself. So supposedly you can do variadic macros, but either the examples are out of date or my copy of fasm is. Maybe I'll write my own assembler so it's not annoying.

@ce5983 8 ай бұрын

fasm: I'm a bit of a webdev myself

@StevenMartinGuitar 8 ай бұрын

Next up, "Implementing our own C in fasm" 😅

@huistelefoon5375 8 ай бұрын

Ah, so this is the Web Assembly my colleagues have been talking about..

@dennis-heinri-ch 8 ай бұрын

First of all: A really great video! I learned a few basics about fasm. But one more thing: What desktop environment is here in use? I never had seen something like this before. But i like it :)

@MatiByte 7 ай бұрын

I think it's i3wm🙂

@rationalityfirst 8 ай бұрын

Gdb has a command that starts and automatically stops at the entry, it's 'starti'.

@ecosta 7 ай бұрын

ASM is "hard" because people treat CS like the "how to draw an owl" joke: we have machine code, then we have assembly, then we have React. What is in-between? Who cares! I just LOVED the concept of "fasm" - I might try it sometime on my old asm repos.

@uuu12343 8 ай бұрын

1:08:57 This is the art of grepping

@shrddr 6 ай бұрын

pretty sure I learned more in 2 hours than 2 years of university

@ayoubbelatrous9914 8 ай бұрын

in my opinion fasm competes with food

@patto2k358 8 ай бұрын

26:31 writing a simple TCP server in fasm

@rogo7330 8 ай бұрын

IPX is dead. I remembering fixing aircrack-ng's driver for TP-Link USB WiFi dongle and it would not compile because there was some shit in code about IPX, and at the time IPX was already purged from Linux code base. I least I remember it when I was searching for it in git logs in kernel sources.

@rogo7330 8 ай бұрын

words are hard bruh

@flamendless 8 ай бұрын

I think I'll prefer to code in fasm over cpp

@freezingcicada6852 8 ай бұрын

1:56:29 This whole bit has been my experience whenever I'm searching for answers/ examples and makes me question the legitimacy of "I just google the answers, bro" memes.

@rationalityfirst 8 ай бұрын

1:45:00 it didn't work because you switched the operators for computing size.

@cobbcoding 8 ай бұрын

Chromium syscall table 🗿

@ivanjermakov 8 ай бұрын

It's webdev after all...

@user-ko5yr9mo6d 8 ай бұрын

Are you john_found who wrote article on habr about this?

@SolathPrime 8 ай бұрын

This evil :fear:

@ChaoticNeutral6 8 ай бұрын

Huh, when I use fasm locally the output elf files are executable by default. Weird

@samnit. 7 ай бұрын

I need programming classes from you

@7KeHek 8 ай бұрын

There was int 80h for syscalls in 32bit Linux.

@LivingInLowLevel 8 ай бұрын

Try nasm assembly too please 🙏

@LivingInLowLevel 8 ай бұрын

Nasm 32 bits

@juniordataengineer 6 ай бұрын

And what is this guys real name . He is soo good

@fareltek4111 8 ай бұрын

Hi.Can you implement Eventbus Publish/Subscribe system in c please.Thank you for videos

@FireDragon91245 8 ай бұрын

lol it reminds my of my own assembly transpiler it also has compile time generatoed code but mine does not have compiler directives like %for or something you can write you own compile time generators in the language itself

@farpurple 8 ай бұрын

Why do i need stdlib if syscall(1, 1, "Hello world", 14) ?

@kgarrison343 8 ай бұрын

How long until you're writing your own os in fasm?

@andy_lamax 8 ай бұрын

tsoding after explaining something for like 10 mins. Then says "I don't fully understand it"

@alicewyan 8 ай бұрын

What is the pretty font in your emacs?

@someever2 6 ай бұрын

Iosevka

@curoviyxru 8 ай бұрын

why I have read the title as dev in webassembly...

@TsodingDaily 8 ай бұрын

I changed the title. Hopefully it's easier to read now.

@PopescuAlexandruCristian 8 ай бұрын

From what I remember fasm has wasm as a target so future stream where the response payload is fasm compiled to wasm from fasm is the next logical step :)

@Rakkoonn 8 ай бұрын

@@PopescuAlexandruCristian So you could have a fullstack framework in assemby. Finally gone full circle from javascript.

@masoud1128 8 ай бұрын

Please do zig crash course

@mmmmm1438 8 ай бұрын

bro i will make celebrate if you respond i want your opinion about problem solving website

@nathanfranck5822 8 ай бұрын

Next tcp/ip in qbasic

@grawlixes 8 ай бұрын

I would nonironically love this

@yaksher 8 ай бұрын

Only like an hour in, but it kinda feels like using an assembler with such powerful macros ends up sorta defeating the point, because if you're generating the bulk of your code through macros like this... well, it's basically serving as a compiler that does no optimization. You lose out on the ability to skip unnecessary operations and very tightly pack things and whatever. At that point it's just like... why not write C?

@TsodingDaily 8 ай бұрын

twitter.com/tsoding/status/1704206555594264984

@yaksher 8 ай бұрын

@@TsodingDaily I don't think it's cheating, and I think it's a very neat. Obviously the objective of this video was not to create the best or easiest website and it's not a criticism of the video. I'm just wondering if assembly with this many macros serves any practical purpose or if using so many macros ends up defeating what limited practical function assembly still has with compilers as smart as they are.

@TsodingDaily 8 ай бұрын

> I'm just wondering if assembly with this many macros serves any practical purpose urmom said it does

@Winnetou17 8 ай бұрын

@@yaksher Whenever you want/need to optimize or do crazy stuff, you can simply not use macros or whatever.

@yaksher 8 ай бұрын

@@Winnetou17 Okay but by that token, you may as well just write C and inline assembly the parts you need to super-duper optimize. Optimizing or doing crazy stuff is the only practical purpose assembly really _has._ Outside that, it's just a fun gimmick. Or perhaps I'm missing something, which is what I was asking about.

@suryaprakash-sh5bf 8 ай бұрын

What's that emacs theme anyone 😅

@paulzupan3732 8 ай бұрын

Do you use evil mode

@konkitoman 8 ай бұрын

Why in ASM takes 30-50ms to load, from binary content and in Rust (tokio + axum + tower-http) loading a file then presenting takes only 1-2ms to load Why ASM binary that is 1KB is slower then 60MB Rust binary Please explain why is that slow and how you can make-it faster!

@Joorin4711 8 ай бұрын

@@aqfj5zy There is no compiler involved when generating the *binary* that is serving the data to the browser in the video. I know that tsoding says "And it compiles!" but that is not actually what is happening. The time it takes from the browser making its request to the page being counted as loaded is pretty much bounded by the browser in this case.

@Stroopwafe1 8 ай бұрын

Because Tsoding didn't include any of the optimisations you can do to make it serve responses as quickly as possible. You're comparing the most basic webserver to a well developed framework. Also, webservers aren't CPU bound, IO is the thing that takes the most time. If webservers were CPU bound, then this most basic example would outspeed every framework

@TsodingDaily 8 ай бұрын

Because I forgot to close the connection

@konkitoman 8 ай бұрын

Now i realizate that you need to flush or close the connection!

@sams6889 8 ай бұрын

Just following along for fun, my gf2 does not show the instructions after i try `run` even though the program runs fine (at 47:00)... anyone know why? Btw thanks for this great video. +1 sub