Building a container from scratch in Go - Liz Rice (Microscaling Systems)

  Рет қаралды 177,933

Container Camp

Container Camp

7 жыл бұрын

Everyone has heard of Docker, but what is a container? Is it really "a lightweight VM"? In this talk we'll dispel the magic by writing a container in about 100 lines of Go.
Liz Rice has a wealth of software development, team, and product management experience from her years working on network protocols and distributed systems as well as in digital technology sectors including VOD, music, and VoIP. When not building startups and writing code, Liz loves riding bikes in places with better weather than her native London.

Пікірлер: 101
@RichardBuckerCodes
@RichardBuckerCodes 3 жыл бұрын
The best part of this demo is that it makes containers more like jail and addresses the trust issue.
@jonbv2434
@jonbv2434 3 жыл бұрын
this is by far very short and well explained how the container can expand the possibilities how GO can do it.
@shahmiBro1
@shahmiBro1 4 жыл бұрын
Loving demos cause it shows the real things in practical world, always intrigued to watch her demos;
@HassanSani
@HassanSani 5 жыл бұрын
Wow the way you make things feel simple, now I'm even a go pro developer
@loupax
@loupax 2 жыл бұрын
Looks like my favorite presentations are those that start so simple you almost think they are jokes, until suddenly they are not.
@mattt2684
@mattt2684 5 жыл бұрын
I loved this talk!
@artvandelay777
@artvandelay777 6 жыл бұрын
I finally think I understand what a Docker container is! Thanks.
@sussus4914
@sussus4914 2 жыл бұрын
Her 50 lines of GO lang code hides over a 100 levels of OS level abstraction, and you confidently say that you think you understand what a Docker container is. That's laughable.
@safiahmed7955
@safiahmed7955 Жыл бұрын
@@sussus4914 so why don’t you give a talk on those 100 lines of OS abstraction?
@milanpanic3755
@milanpanic3755 4 ай бұрын
@@sussus4914precisely why they are abstractions, so you don’t get distracted with boilerplate
@afortiorama
@afortiorama 5 жыл бұрын
This was an excellent presentation, thanks!
@johnschiwitz4412
@johnschiwitz4412 5 жыл бұрын
one of the best container talk i've heard
@gangsterholla179
@gangsterholla179 2 жыл бұрын
This was amazing. Simple and easy to digest, but packed with information.
@mahdijh1
@mahdijh1 3 жыл бұрын
Thanks, It was the best way someone can show me concept of a container.
@billvvoods
@billvvoods 2 жыл бұрын
Awesome video and a great intro to how containers are constructed
@abhinjose
@abhinjose 5 жыл бұрын
Thanks, That was cool and easy to understand!
@iknownothing13
@iknownothing13 6 жыл бұрын
That's very inspiring, especially Liz shows her charm by unique humor and coding flow.
@jasonguo7596
@jasonguo7596 5 жыл бұрын
This is awesome!
@abstractplanet6018
@abstractplanet6018 3 жыл бұрын
Made me want to learn Go. Thanks.
@gscacco
@gscacco 5 жыл бұрын
Great work !
@xinli4938
@xinli4938 6 жыл бұрын
Great Demo!
@freakybaby1012
@freakybaby1012 3 жыл бұрын
Great tutorial thank you!
@ahmedifhaam7266
@ahmedifhaam7266 2 жыл бұрын
great explanation. Thank you 👍
6 жыл бұрын
Great impressive Demo
@izzzzzzza
@izzzzzzza 6 жыл бұрын
awesome, thanks!
@dengan699
@dengan699 5 жыл бұрын
very good, thanks
@rohitm8526
@rohitm8526 Жыл бұрын
Woah... very nice explanation 🔥
@actsrv9
@actsrv9 4 жыл бұрын
All big words should be explained like this.
@hamed775
@hamed775 6 жыл бұрын
............Excellent .................
@abhirishi6200
@abhirishi6200 6 жыл бұрын
excellent video
@mithleshmeghwal7093
@mithleshmeghwal7093 5 жыл бұрын
awesome lizrice
@johnschiwitz4412
@johnschiwitz4412 5 жыл бұрын
hope to see you at kubecon nice video
@chiragsingla.
@chiragsingla. 3 жыл бұрын
Thanks
@sunwoojang6888
@sunwoojang6888 3 жыл бұрын
really good
@generosonunezarias369
@generosonunezarias369 4 жыл бұрын
Badass!
@KeithMakank3
@KeithMakank3 2 жыл бұрын
Really good talk
@reprC
@reprC 4 жыл бұрын
Awesome stuff. Any reason that calling /proc/self/exe was done rather than syscall.ForkExec? She mentioned that it does the same thing. Just because the copy-paste portion is faster for the demo? Minimizing the Go-specific parts since ForkExec is a convenience method and takes a Go struct? Not criticizing, just curious
@evilsdexter5261
@evilsdexter5261 5 жыл бұрын
why can't I give 1000 likes to this one? :)
@codelucky
@codelucky 3 жыл бұрын
Did I just watch Go programing in Downtown Abbey?
@anshubehera2600
@anshubehera2600 3 жыл бұрын
"You are my peer reviewers"... what a lass
@derekreed6798
@derekreed6798 Жыл бұрын
Nice
@liuyanjun6693
@liuyanjun6693 6 жыл бұрын
very impressive demo
@techindia3602
@techindia3602 3 жыл бұрын
Does anyone have the link to the talk by Julian Friedman she is talking about ?
@KevinCantwell
@KevinCantwell 7 жыл бұрын
This is a fantastic presentation, thank you! I notice that you quickly gloss over installing a root file system ("I just happen to have one lying around"). I'm not familiar with installing linux file systems and my attempts at doing so are apparently too naive to work. Is there a straightforward way to download or copy one?
@cyphaetus
@cyphaetus 7 жыл бұрын
For ubuntu: apt-get install lxc sudo lxc-create -t ubuntu -n yakkety # now use this for the chroot /var/cache/lxc/yakkety/rootfs-amd64 # I still had to `run mount -t proc proc /proc` to get ps to work though, not sure how to get around that
@theoutsider01
@theoutsider01 7 жыл бұрын
I could do this by creating a chroot filesystem. help.ubuntu.com/community/BasicChroot
@deepspaceninefreak
@deepspaceninefreak 6 жыл бұрын
debootstrap stretch test1
@MoAliDevOps
@MoAliDevOps 7 жыл бұрын
The talk really begins at 2:25 You're welcome.
@metaorior
@metaorior 6 жыл бұрын
good afterneen
@konstantingeyst4568
@konstantingeyst4568 8 ай бұрын
Note that child processes can call chroot() again and break outside of this container easily. Docker doesn't use chroot.
@RockwellAIM65
@RockwellAIM65 Жыл бұрын
Where is the network stack+virtualization for that? How does that work?
@TheBendixSA
@TheBendixSA 2 жыл бұрын
Badass
@LilRofl
@LilRofl 11 ай бұрын
🤯
@obrien8228
@obrien8228 Жыл бұрын
wait this is so easy
@piyushsingh178
@piyushsingh178 2 жыл бұрын
wow..this is super awesome!! ps not showing host processes was very nice. But why Go though. As someone who doesnt speak Go, what I understood was you did some syscalls, cloned UTS namespace, changed rootdir, and invoked a new /bin/bash as a fork process. Same thing can be done in any language cpp/python/java right?
@RockwellAIM65
@RockwellAIM65 Жыл бұрын
Efficiency. You can build a completely self-contained binary that does everything. If you add https or a straight TLS socket you only need the exe and a cert file... it's super clean. With Python you may have versioning/suppor issues. Java is a pig - it latches onto cpu+memory resources. Not really apropos. C++ is ok for this, but younger engineers may not know it + unix command programming in C++ can be a bit tricky. Golang makes it (and certain other tasks) pretty straightforward. I would use either C or golang. Maybe Rust but I don't know it yet.
@piyushsingh178
@piyushsingh178 Жыл бұрын
@@RockwellAIM65 yeah I think outside of Go, c++ would be the best choice
@RockwellAIM65
@RockwellAIM65 Жыл бұрын
@@piyushsingh178 A C based solution would be clean; you'd have to add lots of external libraries tho' ... would have been nice if C had a standard add-on for managing databases, doing all the simple network type transactions w/ a second thread perhaps (application+background processing thread) + an easy-to-interface string based hierarchical data store. C++ wasn't really necessary... it turned into the Cobol of the 1990s!
@joepoptiya
@joepoptiya 2 жыл бұрын
Really good walk through. The container doesn't have internet access. Is there a way to provide the container with internet access?
@electricimpulsetoprogramming
@electricimpulsetoprogramming Жыл бұрын
yes there is a way, how to do that i have no idea
@pclokcer
@pclokcer 2 жыл бұрын
Likee
@cookiebinary
@cookiebinary 5 ай бұрын
TL;DR: chroot && mount proc
@marccawood
@marccawood 4 жыл бұрын
I thought Linux supported containers/virtualization natively (LXC) - why is she faking container isolation by e.g. mounting alternative file systems?
@l1703
@l1703 4 жыл бұрын
How is she faking it ?
@reprC
@reprC 4 жыл бұрын
When did she mount an alternative fs? When she mounted proc? Or do you mean the chroot? The chroot source dir already contains a file system hierarchy because the child process quite literally has a different root, and would not be able to access anything “outside”. Without this, calling /bin/bash would do nothing since that path wouldn’t even exist. Mounting proc is required purely because of the chroot. LXC isn’t a “native” feature, cgroups are. LXC is just one of several system virtualization frameworks such as libvirt or systemd-nspawn. Her talk was about making containers from scratch, which I’ll interpret as a LSB compliant OS with a vanilla Linux kernel. LXC under the hood does pretty much the same thing as her code. Go ahead and check out their github; it’s all open-source. LXC has more features, but I’m pretty sure it’s quite a bit bigger than 60-ish lines
@GerinoMorn
@GerinoMorn 9 ай бұрын
Why am I watching 7yo video about sth I don't do very often in a language I don't use, I don't know. But it''s good xD
@SuperMarkusparkus
@SuperMarkusparkus 6 жыл бұрын
I'm not sure it really explained what a container is or how it works. I just showed what result a few lines of go code had, but what really happened?
@kevint6878
@kevint6878 5 жыл бұрын
For me it was the fact that I always sort of imagined containers as this mystical thing. I use them all the time, but I never really thought about how they are created or work under the hood. Seeing this video really opened up my mind to how simple it really is. Of course I know there is so much more to containers than that, but just seeing how she could give the processes their own namespace, their own processes, their own “isolation”, is really interesting and impressive for just 56 lines of code.
@foljs5858
@foljs5858 4 жыл бұрын
If you follow what it shows, you'll also see what happened. It gave the program it run isolation (not messing with the environment outside), it's own root (not seeing outside a particular directory), and a few other similar things. That's what a container like Docker does, using several OS provided utilities (like chgroups, chroot, etc), like this program does (in a more basic way)
@fardeadok
@fardeadok 5 жыл бұрын
“Sublime” editor?
@maninarush2112
@maninarush2112 5 жыл бұрын
Yis
@GreyDeathVaccine
@GreyDeathVaccine Жыл бұрын
Too much weird sounds from Liz (don't how to say it since I am not good with english) but good presentation.
@matthijshebly
@matthijshebly 5 жыл бұрын
Good presentation. One thing, however: Why the need for go? Couldn't all this have been done in plain bash? After all, all she's doing is calling system commands.
@markotikvic
@markotikvic 5 жыл бұрын
Why the need for programming languages at all? After all, all they do is translate human readable code to bunch of machine instructions. Just write those instead.
@bt82
@bt82 5 жыл бұрын
Docker is written in go.
@kirasan
@kirasan 5 жыл бұрын
She compared the length of her code to Docker's in the end, so it had to be written in Go.
@foljs5858
@foljs5858 4 жыл бұрын
Yes, it could be done in plain bash. But it would be hell to maintain, scale, and make able to run arbitrary containers. Whereas this shows how a container manager like Docker does it (of course with much less functionality here), so it can be more easily extended configurable etc.
@idiotshypocrites9547
@idiotshypocrites9547 2 жыл бұрын
Min 05:00 and I don't know what the heck she is doing. And yes as she said, this is quite dull. And Go, why?
@NyttNorge
@NyttNorge 6 жыл бұрын
What was the point of this program again?
@markotikvic
@markotikvic 5 жыл бұрын
Trust me, nobody is surprised that a flat earth proponent is not able to understand something very basic.
@kirasan
@kirasan 5 жыл бұрын
The point was to run a container without docker.
@foljs5858
@foljs5858 4 жыл бұрын
Isn't it OBVIOUS? To show how the basics with which a container system like Docker can be implemented...
@reprC
@reprC 4 жыл бұрын
What was the point of this comment again?
@idiotshypocrites9547
@idiotshypocrites9547 2 жыл бұрын
06:35 cringe, with respect for trying
@Jone952
@Jone952 5 жыл бұрын
Was expecting a token female the managers stuck out front then she started coding live lol
@shailynortiz
@shailynortiz 3 жыл бұрын
Very skewed view of the tech world where most of the innovation is done by women since the beginning of the time.
@Jone952
@Jone952 3 жыл бұрын
@@shailynortiz def not true
@JosueRodriguez08
@JosueRodriguez08 3 жыл бұрын
@@shailynortiz lol, not true
@automatic241
@automatic241 3 жыл бұрын
@@shailynortiz I think both views are skewed. Females are not recognized for their accomplishments in the tech world, but saying they've done the majority of innovation in that field is simply not true.
@alexwexov4298
@alexwexov4298 2 жыл бұрын
Came for Vim, saw Sublime, leave.
@dukearchon
@dukearchon 6 жыл бұрын
I stopped listening once she said,"... on my Mac..."
@snoooters
@snoooters 6 жыл бұрын
that's a cool story
@alexkozadaev911
@alexkozadaev911 6 жыл бұрын
You got to be running the TempleOS or something to be that arrogant.
@coreyreichle1921
@coreyreichle1921 6 жыл бұрын
Alex Kozadaev nope, just not a proprietary os on proprietary hardware both designed to restrict your freedoms.
@coreyreichle1921
@coreyreichle1921 6 жыл бұрын
An Enemy nope. Linux.
@alexkozadaev911
@alexkozadaev911 6 жыл бұрын
Corey Reichle makes sense. I also prefer Linux and OpenBSD and cannot see myself ever buying a Mac, however as we can see in this presentation despite of what you said it won’t stand in a way of doing cool stuff either :)
@zakariachahboun
@zakariachahboun 2 жыл бұрын
Thanks
Containers from scratch: The sequel - Liz Rice (Aqua Security)
26:48
Container Camp
Рет қаралды 20 М.
GopherCon 2017: Liz Rice - A Go Programmer's Guide to Syscalls
34:44
Gopher Academy
Рет қаралды 19 М.
Useful gadget for styling hair 🤩💖 #gadgets #hairstyle
00:20
FLIP FLOP Hacks
Рет қаралды 10 МЛН
Alex hid in the closet #shorts
00:14
Mihdens
Рет қаралды 16 МЛН
DAD LEFT HIS OLD SOCKS ON THE COUCH…😱😂
00:24
JULI_PROETO
Рет қаралды 17 МЛН
Containers From Scratch • Liz Rice • GOTO 2018
42:54
GOTO Conferences
Рет қаралды 251 М.
This Is The BEST Way To Structure Your GO Projects
11:08
Melkey
Рет қаралды 68 М.
dotGo 2015 - Rob Pike - Simplicity is Complicated
23:12
dotconferences
Рет қаралды 153 М.
Building a Bank with Go
53:22
InfoQ
Рет қаралды 118 М.
Master Go Programming With These Concurrency Patterns (in 40 minutes)
46:15
Linux Container Primitives: cgroups, namespaces, and more!
34:27
linuxfestnorthwest
Рет қаралды 52 М.
Go + Microservices = Go Kit [I] - Peter Bourgon, Go Kit
38:49
CNCF [Cloud Native Computing Foundation]
Рет қаралды 102 М.
Building containers from scratch | Talks at DeepSource
22:42
DeepSource
Рет қаралды 5 М.
Program your next server in Go
1:02:06
Association for Computing Machinery (ACM)
Рет қаралды 70 М.
Todos os modelos de smartphone
0:20
Spider Slack
Рет қаралды 64 МЛН
Что делать если в телефон попала вода?
0:17
Лена Тропоцел
Рет қаралды 3,2 МЛН
Сколько реально стоит ПК Величайшего?
0:37