Why Brain-like Computers Are Hard

  Рет қаралды 231,877

Asianometry

Asianometry

5 ай бұрын

Links:
- The Asianometry Newsletter: www.asianometry.com
- Patreon: / asianometry
- Threads: www.threads.net/@asianometry
- Twitter: / asianometry

Пікірлер: 531
@gspaulsson
@gspaulsson 5 ай бұрын
Of course, the human brain takes 9 months to construct, around 16 years to reach full functionality, and requires about 33% downtime to function properly.
@AC-jk8wq
@AC-jk8wq 5 ай бұрын
And can be completely destroyed in a few minutes of complete inactivity…. Such as stop breathing or have a heart attack…. Rebuilding that same brain, that experienced the unscheduled down time, can take another decade or so…. It would be nice to have a method, or understanding, of rebuilding all of those lost connections in the brain…. I’m open to ideas… 😃
@issholland
@issholland 5 ай бұрын
The downtime is on the user end, the brain is still working though
@SuperAdnan117
@SuperAdnan117 5 ай бұрын
@@isshollandwrong. the body never has downtime, it just has concurrent repair time
@christophermullins7163
@christophermullins7163 5 ай бұрын
​@@AC-jk8wqpsychedelics
@dread69420
@dread69420 5 ай бұрын
There is no downtime, its constantly at work.
@TheOwlGuy777
@TheOwlGuy777 5 ай бұрын
And lastly, the brain is an analog device. And lastly, the brain is an analog device.
@mookie2637
@mookie2637 5 ай бұрын
At that point I thought someone had failed a Turing Test.
@LavaHotMan
@LavaHotMan 5 ай бұрын
When your professor is checking to see if you're paying attention.
@markosluga5797
@markosluga5797 5 ай бұрын
Attention paid.
@jonathanyang6230
@jonathanyang6230 5 ай бұрын
i thought i was having a brain aneurysm
@AC-jk8wq
@AC-jk8wq 5 ай бұрын
I checked twice to see if I missed a point, or if Jon missed a point! 😃
@westrim
@westrim 5 ай бұрын
They're hard? I thought they'd be soft, maybe a bit squish.
@hieronymusbutts7349
@hieronymusbutts7349 5 ай бұрын
Hard, but surprisingly elastic! The average human brain makes an excellent emergency trampoline if pancake smooshed (sorry for the technical language)
@JamesWang007
@JamesWang007 5 ай бұрын
It depends on preparation id imagine
@uku4171
@uku4171 5 ай бұрын
Exactly what I was gonna say lol
@dewiz9596
@dewiz9596 5 ай бұрын
I think you’re being difficult 😉
@melody3741
@melody3741 5 ай бұрын
Its not that difficult anyway, My mother made one like 28 years ago
@cogoid
@cogoid 5 ай бұрын
Brain-like circuits sound like a great idea, and many people have always found it appealing. Once upon a time there were two legendary chip designers -- Federico Faggin (the father of Intel 4004, 8080 and then Z80) and Carver Mead (famous for the design methodology in "Introduction to VLSI" course which inspired fabless semiconductor industry). Back in 1986 the two have founded Synaptics -- precisely to develop brain-like chips. The name was an allusion to the synapses of biological neurons. They really tried, but could not make it work. However, the developed know-how allowed them to successfully pivot towards capacitive touch-pads.The company became quite famous, and their touch-pads were found in many laptop computers. Few people remember now that the touch-pads were not the plan, when Synaptics first started.
@globalvillage423
@globalvillage423 5 ай бұрын
Faggin lolol
@pcenero
@pcenero 4 ай бұрын
Oooh so that's where the name comes from. Always wondered that.
@Y2Kvids
@Y2Kvids 2 ай бұрын
they still do
@derekstaroba
@derekstaroba 2 ай бұрын
Is it me or did Lots of interesting stuff happened in 1986 🙃
@Six_Gorillion
@Six_Gorillion 5 ай бұрын
I thought Huang's law meant you need to pay 2X for your GPU every 4 years 🤔
@rkan2
@rkan2 5 ай бұрын
i think it was 2x for the amount of memory lane width in bits. Fortunately we have DDR manufacturers increasing the bandwidth.
@Mfields4517
@Mfields4517 2 ай бұрын
That would be Biden’s law
@dcamron46
@dcamron46 Ай бұрын
@@Mfields4517get outa here…you think Trump and MAGA are more aligned with a science and engineering based society? Freaking quacks all of em. I’ll take the lesser of two evils…the same people in the GOP are not the ones moving technology forward in society today or in the past
@YouCanHasAccount
@YouCanHasAccount 5 ай бұрын
Even if they could build a brain-like computer it wouldn't be commercially viable due to the accuracy problem. Analog brains make mistakes all the time. We forget, we overlook, we assume. It is excused as "human error" and as humans we accept it. But we would never accept such flaws from a machine that we cannot even sue for damages.
@ethans4783
@ethans4783 5 ай бұрын
just another hurdle in the way, with time and funding I'm sure this too will be solved. like you said it's "brain-like", but never will be a brain, only a machine
@rizizum
@rizizum 5 ай бұрын
Yet we can still build airplanes, rockets and computers. Yes takes a lot of work and redundancies to make these possible with all these errors humans can make, but if it works it works
@charlesmanning3454
@charlesmanning3454 4 ай бұрын
@@rizizum Yes, we use digital computers to airplanes, rockets and other computers because they are great tools for what the human brain doesn't do well.
@azhuransmx126
@azhuransmx126 4 ай бұрын
​@@ethans4783 and what the fuck is a brain if not a very complex meat machine?
@brendawilliams8062
@brendawilliams8062 4 ай бұрын
Ruler was fine just the way he was. Did he need a brain chip. I believe consciousness is outside of all the hoopla. Two different highways
@IAmPattycakes
@IAmPattycakes 7 ай бұрын
If you're planning on bringing this one public, just FYI, the patreon plug is muted.
@Asianometry
@Asianometry 7 ай бұрын
Got it. Just edited it out for this one.
@punkdigerati
@punkdigerati 5 ай бұрын
2 months out? Wow, that's quite the lead time.
@RafaquaQuetta
@RafaquaQuetta 5 ай бұрын
@IAmPattycakes found the OG stan😅
@gljames24
@gljames24 5 ай бұрын
What's wild is that neurochemical system in the brain and on top of that the several operating frequencies for various brain waves. The brain is really space efficient and uses a lot of layered systems to synthesize all its stimulus, internal state, decision making, and responses. It's plasticity, neural weighting, and glitches are fascinating too and all of this is done based on protein and dna based hardware which limits the thermal and frequency response. If we could get better 3D stacked and capillary cooled systems, we might be able to get close.
@VanFire87
@VanFire87 Ай бұрын
To call the brain space efficient is like calling the ocean big. It's efficient to an extent that's not replicable by modern technology. The packaging of biomolecules and living tissues are and will be, for the foreseeable future, wonders of physics that everyone can only look up to.
@ingridfong-daley5899
@ingridfong-daley5899 5 ай бұрын
I experienced a TBI in 2017, losing my identity and conscious access to memory. I was already neuroatypical and had seizures, but my capacity for 'linear communication' was often confounded. I knew words and understood when people spoke and could respond, but it became easier to write in symbols with a few terms peppered in for clarification. But i basically 'mapped out' my brain's rewiring process in real-time, and there's so much overlap in concepts and terminology--using the computer memory framework as a reference has helped me streamline my understanding and troubleshoot ongoing problems with my memory. Thanks for uploading such great and detailed information--it's been really helpful!
@JordanJ01
@JordanJ01 3 ай бұрын
🙄
@AC-jk8wq
@AC-jk8wq 3 ай бұрын
Very impressive recovery story Ingrid! I have had the good fortune of working with many people recovering from TBIs. Their recovery continues strongly for more than a decade… I hope this note finds you continuing on your journey! No two TBIs are the same, but…. Chances are… you have great memories still awaiting to be discovered. The harder you work at memory recall…. The more memories get re-connected! An impressive non-linearly rate of recovery… TBI 2011 😃
@user-xf4es7eh9y
@user-xf4es7eh9y 2 ай бұрын
you come across as hypochondriac and presenting with some kind of personality disorder, perhaps narcissism, that I'm not qualified to speculate about, more so than someone that actually has brain damage.
@orbismworldbuilding8428
@orbismworldbuilding8428 2 ай бұрын
Thats cool
@perfectionbox
@perfectionbox 5 ай бұрын
A huge challenge is the interconnects. You could mimic the brain's massive many-to-many network by going 3D, but then run into heat dissipation problems on top of the manufacturing issues.
@raifikarj6698
@raifikarj6698 5 ай бұрын
Liquid (Blood) cooling baby
@dsdy1205
@dsdy1205 5 ай бұрын
to make matters worse, those links need to be tuned like an analog circuit
@gljames24
@gljames24 5 ай бұрын
in-chip capillary cooling!
@makuru_dd3662
@makuru_dd3662 5 ай бұрын
That explains why the brain is so darn power efficient, because otherwise it would just be a glowing orb.
@vadimpozhidaev9647
@vadimpozhidaev9647 5 ай бұрын
heat is not such a problem when you run with ~10kHz, but I agree that network design is very critical for such systems.
@jamessnook8449
@jamessnook8449 5 ай бұрын
I designed a neuromorphic processor back in 2004 when I was at The Neurosciences Institute. I could write a book on the neuromorphic paths one could take and the reasons they won't work. You did an excellent job of covering the different areas of the brain that need to be represented in a circuit. There are two aspects of neural computation that are paramount in creating brain-like functionality, but always get glossed over. They are synaptic plasticity and connectivity. Almost all of the changes in your brain that affect behavior are centered on the efficacy of synaptic propagation, likewise a lot of the functional differences between areas that have similar neuronal structure are the result of the connectivity within and between neural areas. The memristor is going nowhere - it's a red herring. If someone is successful in creating a commercially viable neuromorphic chip, they will encounter two problems that will stop them cold: 1) no one is trained to use them, as the computation is fundamentally different in everyway from a traditional computer; 2) intelligence is extremely complicated, not from an intellectual perspective, but from a conceptual perspective. The effort and education required to be able to use this type of chip and also make the conceptual leap to create an intelligent system is beyond anything available today..
@ddlc_monika
@ddlc_monika 5 ай бұрын
would you agree that there might be research to do on something like a universal language of logic first? Let me explain. Right now, we have machine "language" at the center, the "ones and zeroes" everyone should know about, with several layers designed to make sense to humans - assembly first, low-level programming languages second, and finally high-level ones and scripts. What we do here is take computer logic and make it human-readable. I'd think it may come at a cost. I'd be inclined to say we may tackle the problem wrong right now. Don't get me wrong, the research is all valuable - there's lessons to be learned from all the attempts so far which will no doubt help down the road. But as so often in human nature, especially when I look at the tedium at office jobs, you get to ask: How do we even know what of all of this is truly neccessary? Is there something we overlook? What's the core problem, and did I communicate it correctly? Most times you can't even be sure, because our wirings are not even uniform. At work. Now try globally. Human cultures, male and female, go down to animals etc. One might do good in finding the Atom first, before we dive into how to do alchemy. "Intelligence" as it stands is fairly human-centric in its definition, or in plain terms we wouldn't know it if it bashed our face in right now because the term is quite old and refers to all kinds of clever outcomes. Stuff like "emotional intelligence" is a buzzword, but it's inference itself may lead us to the core of the problem here. Right now we all have a fuzzy interpretation of what kinds of machines we want to build with this. Maybe it's time to define the problem first?
@Hollowed2wiz
@Hollowed2wiz 5 ай бұрын
@@ddlc_monika the problem that we are trying to solve is one intuitively known by everyone: we are trying to build a god. At its core, I think that the race for AI (including the need for better hardware for AI models) is about designing an entity that can solve all of our problems, an intelligent entity inspired by human intelligence but not bound by the limitations of the human condition (i.e being limited in ressources such as time, attention, biological needs, ...), a true embodiment of the philosophical notion of Logos.
@jamessnook8449
@jamessnook8449 5 ай бұрын
There is a universal language of logic, it's called 'First Order Predicate Calculus' or FOPC. i think I understand what you are saying. If you are saying that we don't even have a good definition of intelligence - I agree with you. People use the words artificial intelligence to describe everything that doesn't have a straight linear relationship or has a unique response to a stimulus. The point I was trying to make about the conceptual complexity of intelligence is itself complex. People that haven't lived in the world of neural computation can't see it - they think it is just like neural nets. In truth neuromorphic is to neural networks like neural networks are to Von Neuman architecture. They may look similar but they are fundamentally different. @@ddlc_monika
@jamessnook8449
@jamessnook8449 5 ай бұрын
Most people I've worked with have more modest asperations than becoming the spirt of the universe. Our goal was always discovery, of the mind and the brain and the mind/brain. I don't think anyone expects the intelligence clergy to come and bless their work. Few realize, as I discovered during my R&D work, that the test for intelligent systems isn't deterministic it is behavioral.@@Hollowed2wiz
@lucamatteobarbieri2493
@lucamatteobarbieri2493 5 ай бұрын
1) llms can translate natural language into any code. Tranformers where made for translations. 2) Artificial intelligence nowdays is an emergent property of neural networks, it is not hard-coded symbolically.
@samik83
@samik83 5 ай бұрын
For a long time I've had the idea that these system (neural computers and AI) will need some sort of random generator in the loop. Was amazed to hear that some of these systems actually use it. Just my gut feeling that true intelligence has to have some form of randomness in it, for it to produce novel new ideas and solutions to problems.
@user-up1id5rv2m
@user-up1id5rv2m 4 ай бұрын
Isn't that exactly how diffusion works in image AI?
@samik83
@samik83 4 ай бұрын
@@user-up1id5rv2m yes, I think it does
@Bestmann3n
@Bestmann3n 2 ай бұрын
Not randomness but chaos. If you think that idea is interesting, then you should definitely look into cybernetics.
@m89hu
@m89hu 5 ай бұрын
This was incredibly interesting, thank you! Neuromorphic engineering is something that isn’t much talked about - or maybe I am just not well informed. I also like that your voice is very calm and soft in this video perhaps this topic was more enjoyable to process than the fab war episodes. *Northpole had insane performance charts at the keynote, not sure why it isn’t big news.
@ChuckSwiger
@ChuckSwiger 5 ай бұрын
ran across a paper that tried to determine how complicated an artificial neural network would be needed just to simulate one neuron is about 5 to 8 layers - easy to find: A temporally convolutional DNN with five to eight layers was required to capture the I/O mapping of a realistic model of a layer 5 cortical pyramidal cell (L5PC).
@user-dk1ro7go4c
@user-dk1ro7go4c 5 ай бұрын
That was a TCN the layers equate to temporal context....the 5-8 layers simply represent the time windown needed to recognise a spike train. so not indicative of complexity. There are better approches which are more faithful to postsynaptic neuronal response which are quite small and efficient compared to the TCNN approach
@okman9684
@okman9684 5 ай бұрын
13:57 You turned A.I for a moment 🤖 😁
@sindiamayer787
@sindiamayer787 5 ай бұрын
13:57 repeating voice line.
@RaverSnowLep
@RaverSnowLep 5 ай бұрын
Im seeing this so often in videos now, whats going on?
@NikolaosSkordilis
@NikolaosSkordilis 4 ай бұрын
@@RaverSnowLep An AI bug? :)
@Onimirare
@Onimirare 2 ай бұрын
@@RaverSnowLep It's a common mistake, while editing the voice lines, you might hear the start of a sentence, and to not lose time, you skip to the end of the sentence, so you might incorrectly assume that that line is correct because the start is correct and the end is correct. You'll not notice it repeats itself because you haven't heard the middle. The only way to avoid this is to hear the whole thing, which almost no one does. I think I remember hearing an Oblivion NPC in like 2006 saying something like "let me do that one again" between two identical sentences, you can find it on KZfaq.
@beancount811
@beancount811 5 ай бұрын
Mullet computing is the future!
@gus473
@gus473 5 ай бұрын
Would that elevate the status of North American hockey players? Or bass tournament anglers in The South? Asking for a friend.... 😉✌️
@GeoffryGifari
@GeoffryGifari 5 ай бұрын
I imagine in the future neuromorphic and Von Neumann architecture will work side-by-side, the former for adaptability and robustness, and the latter for precision and fast math
@eliaskouakou7051
@eliaskouakou7051 4 ай бұрын
That what current AI are, just not of hardware but software shape
@ThePhiphler
@ThePhiphler 5 ай бұрын
The lesson to take home is really that we have no great theory for why the brain works as it does, and thus we are guessing when we try to replicate it in hardware or software.
@chris_hisss
@chris_hisss 4 ай бұрын
Sounds like we have a lot of the how's and I think we understand a lot of the why's. Trying to replicate it is helping to connect those dots. If anything it is deconstructing the longstanding theories that made it seem like magic.
@lit1041
@lit1041 4 ай бұрын
In fact, everything is not as bad as it might seem. People understand a key concept of how the brain works - it is a huge set of nested conditions, which, due to their large nesting, can make an incredible number of matches (speaking as an AI student). The main thing that still remains a mystery is the details of the structure of the brain and the principles of its self-learning. This certainly does not indicate an almost complete lack of knowledge about the functioning of the brain; I would even say that the opposite statement is more accurate. We know more key concepts than we have left to learn.
@TheIgnoramus
@TheIgnoramus 3 ай бұрын
@@lit1041indeed, the only real issue left is the memory/storage problem. Where woo tends to happen 😂
@Bestmann3n
@Bestmann3n 2 ай бұрын
​@@lit1041 I'd say the main mystery is figuring out how subjectivity works, and we haven't made any real progress on that.
@Error_404-F.cks_Not_Found
@Error_404-F.cks_Not_Found 2 ай бұрын
This is very evident when you read about medications for depression and bipolar …. They all state, “while how the drugs works is unknown it’s suspected that …”
@sdstorm
@sdstorm 5 ай бұрын
13:56 vs 14:08 a glitch in the matrix
@shavoshaco2402
@shavoshaco2402 3 ай бұрын
I think the brain is so efficient due to its size and nature of cells. Nerve cells are eessentialy small batteries, holding electrical potential and discharging it when told to do so by either primary or secondary neurotransmitters. And in this case the brain can be way more sophisticated, as each nerve cell much doesn't act as a logic gate, but rather only fires when sufficient or the right type of data is pass to it, only then will it fire. It basically acts as an impossibly complex neutral network, only we don't have any neural network technology I am aware of that can run on as little energy as the brain. We have transistors smaller than cells, but each cell also holds a bunch of data of the whole machine(DNA), and also depends on it metabolism, it's life span, etc... Basically a single cell acts a a mini-brain, being specialized in what it does but also having all the data in what everything does. I feel like the reason it's hard to figure out how neural networks solve a problem is the same reason it's so hard to study the brain. Each bit of information passed onto the brain is already spread across dozens of trillions of cells.
@KomradZX1989
@KomradZX1989 5 ай бұрын
This was beyond interesting. I absolutely love the interests you have and out of the 100+ channels I subscribe to, you are one of three that I hit the bell icon for so I get a notification when you drop a new video. Keep up the amazing work dude. Love it all 🥰
@Flor-ian
@Flor-ian 5 ай бұрын
Incredibly compelling video. Learned a lot. Thanks as always
@KomradZX1989
@KomradZX1989 5 ай бұрын
Anyone else rewind the video to make sure they heard him say the same thing twice? lol I was like, dang did I rewind by accident just at the right moment or what? 😂
@mattydukes007
@mattydukes007 5 ай бұрын
yes!
@lucaschen9512
@lucaschen9512 5 ай бұрын
Repeats on 14:20
@nelsonprestan3
@nelsonprestan3 5 ай бұрын
The quality of your videos is outstanding, man. That mullet joke? Chef's kiss XD
@kinngrimm
@kinngrimm 5 ай бұрын
Most of the current AIs i assume simmulate by machine learning and neural network principles to some extant how a brain works. In our own brains, there is no need for a simulation as the rules of the game are hardwired through physiognomy, chemical neurotransmitter and neuro elictricity ... physics chemistry biology brain. Not just like having different levels, but having different levels interacting with one other or multiple other levels in parallel. I would further assume, aslong the hardware stays just in silicon, there will always be a simulation aspect to it and thereby less energy efficiency as that efficiency comes from the varied interations between different levels of the brain. Am i mistaken?
@cerebralm
@cerebralm 5 ай бұрын
Yes. There is no reason why silicon couldn't imitate or even surpass the performance of a biological neuron. A biological neuron calculates on the order of hundreds of impulses per second. A digital neuron, if built as an ASIC on cutting edge process node, could calculate on the order of _billions_ of impulses per second. The overwhelming majority of the complexity in a biological neuron is not necessary for the computing the neuron does, so you could really argue that there is a simulation aspect to our brain. Enormous quantities of molecules and proteins that have nothing to do with the logical operations, as opposed to a chip where only the substrate is not an active participant in calculation. At best they have immunological or other physical resilience purposes that an artificial brain wouldn't need to implement.
@mikebarushok5361
@mikebarushok5361 5 ай бұрын
​@@cerebralmand yet, the brain needs over 3300 types of neurons.
@rherydrevins
@rherydrevins 5 ай бұрын
Neural networks don't actually simulate how a brain works, since a human brain is not trying to approximate a mathematical function, which is all a neural network is doing. An analogy would be an aeroplane; the aeroplane manages to fly, but it is not using even remotely the same mechanisms for flight as a bird does. The end result is similar, yes, and its designers were probably originally inspired by birds, but the way it is actually achieved could not be more different.
@stephene.robbins6273
@stephene.robbins6273 5 ай бұрын
“Simulate” has been the implicit problem with AI. Just because you can argue that your CNN or AlexNet, whatever, appears to be accounting for, say, 70% of what you attribute to be a brain’s network response(e.g. the initial retinal network of a mouse), this does not mean your AI network is actually doing anything like the brain network - in fact you’re making assumptions on both ends - what the mouse network actually is, and your AI approach. This difficulty was already in full swing with Newell and Simon’s General Problem Solver, 1972, where they assumed that because the program’s steps were, say, 70% similar to the steps humans claimed to take in solving something like a symbolic logic proof, that this meant their simulation approach had validity, that it was actually near emulating the human brain/thought process - when nothing such was necessarily the case.
@RafaquaQuetta
@RafaquaQuetta 5 ай бұрын
14:42 its the shirt for me
@raphaelcardoso7927
@raphaelcardoso7927 5 ай бұрын
Thanks for the great view, as always, on the subject. In electronics academia we talk only about this and to be fair im kinda tired, but your opinions are very refreshing
@Johnnyde94v2
@Johnnyde94v2 5 ай бұрын
Amazing! I am a TMS Patient you should look into this technology. It's MRI Strength Magnet that goes on my right side of my head and had honestly saved my life. Want to work on a book on my experience.
@kmikc909
@kmikc909 5 ай бұрын
This is insanely interesting, knowing that this much was tried by big names in the hardware industry, makes you think what might be going on with their RnD departments nowadays
@petergerdes1094
@petergerdes1094 5 ай бұрын
I don't think we know enough about the brain yet to understand if the non-digital aspects are needed to replicate it's power (probably needed if we want to literally simulate a human brain but that's not really the goal).
@azhuransmx126
@azhuransmx126 4 ай бұрын
You of course don't know, but there are people out there that knows much much much more than you.
@VanFire87
@VanFire87 Ай бұрын
@@azhuransmx126 And even what they know is a drop in the ocean. The issue is that our tech is fundamentally different from how our body functions. It's like comparing a fish to a whale. Both live in water, but they couldn't be any more different.
@azhuransmx126
@azhuransmx126 Ай бұрын
@@VanFire87 aircrafts and birds, they don't need to work the same, to do..... the same and better.
@VanFire87
@VanFire87 Ай бұрын
@@azhuransmx126 We are fine the way we're going forward right now, with a few feature inspired from our nervous system and the like. Advancement in processing power and efficiency is our way forward, and not making a human brain computer, unless you're willing to overturn and overhaul all of the advancement we have gone though and don't forget the massive numbers of human experiments required.
@azhuransmx126
@azhuransmx126 Ай бұрын
@VanFire87 The area of ​​the brain responsible for controlling offspring rearing in mammals is known as the limbic system, and within this system, the anterior cingulate cortex (ACC) plays an important role in regulating maternal behaviors. The ACC is located in the medial part of the frontal lobe and is connected to other areas of the limbic system, such as the hippocampus and amygdala. This brain area is involved in the regulation of emotions, decision making and evaluation of social stimuli, and its activity is believed to be essential for maternal motivation and care of offspring. In studies in mice, it has been shown that lesion or inactivation of the ACC can decrease maternal motivation and reduce the mother's response to signals from her offspring. The ablation of the ACC by electroscalpel makes the mother regress to a stage 200 million years more primitive or reptilian, seen in animals from the Carboniferous period 440 million years ago, mammals are from the (Permian Triassic) 230 million years ago. Scan that area, compile and digitize the algorithms that make it work, calibrate its neuronal weights, download the cortical model of the mother on an artificial substrate descended from current GPUs (probably photonic chips), reconnect its inputs and outputs and you will see how the mother returns to take care of her babies as if nothing had happened. Turn off the artificial neural network and the mother will revert to a reptilian state and her babies will starve to death. In the future General Artificial Intelligences will do a brain scan of animals in Biology starting from the most primitive beings (flatworms descended from Pycaia) to the most advanced (apes and humans). With these stored connectomes, a virtual twin of the biological being will be created that will be subjected to the same gradient, amplitude and frequency of inputs and if they react exactly the same (Intelligence) we will have created a digital twin. In the digital world copy and original lose all meaning, once something becomes Code and becomes Information it can be replicated millions of times and no one can say that they have the original download of a song. We have been digitizing everything, books, audio, paintings, etc., and the last thing we are going to be able to digitize is going to be the most important thing, our brain and not even we will achieve it, but the AIs will achieve it. Ray Kurzweil describes a similar procedure to realize the Mind Uploading in his book.
@perfectionbox
@perfectionbox 5 ай бұрын
"Lastly, the brain is an analog device" No, because the video mentioned that part twice in immediate succession 🤣
@VanFire87
@VanFire87 Ай бұрын
The brain isn't an analog device. It's a biological machine, something we have never even tried before. Describing it as analog or digital is fundamentally wrong. I don't know of a single machine that works on chemical signals, based completely upon water, is self replicating and self repairing, and have a hard age limit coded into them. Oddly enough, we went more and more electricity based with our technological innovation, while biological evolution did the complete opposite.
@DMoRiaM
@DMoRiaM 5 ай бұрын
A small moment of "Deja vu" at 13:53 and 14:09. Excelent video though.
@TouringWolf42
@TouringWolf42 5 ай бұрын
Thinking about it. Brains are complex, according to the brain. In reality it's quite simple but grand. Like how a single neuron may have so many connections that are rather simple in function but are so vast that it seems difficult to comprehend where to even start or how to even start. Recently they essentially made synthetic neurons "learn" to play pong, it's simply just a game of slowly reverse engineering how some aspects of the brain function and how this works in tandem with other functions. It's not a question of "if" but when. I say 50 years.
@FatherGapon-gw6yo
@FatherGapon-gw6yo 3 ай бұрын
Most likely the brain is nothing more than a transceiver.
@BuceGar
@BuceGar 5 ай бұрын
Excellent explanation, great video. This is why I subbed.
@aukir
@aukir 5 ай бұрын
Brain might only take low watts most of the time, but it's been on, running, consistently for our entire lives. I think that's where consciousness emerges, and the first AGI will probably be lost with the speed we force it to learn, while creating the giant LLM matrices.
@eugenb9017
@eugenb9017 5 ай бұрын
This was a very nice video, thanks :)
@whong09
@whong09 4 ай бұрын
I remember reading about memristors in an ieee magazine back around 2010, I was a freshman taking intro ee classes. Even back then neural nets got a lot of attention and the article talked about how memristors could be used with neural nets, I remember thinking this was going to be huge, and then nothing for a decade. Cool to see it mentioned now in 2024. The future can come fast or it can come slow, but there's no stopping its arrival. What a time to be alive.
@clintcowan9424
@clintcowan9424 5 ай бұрын
Hahaha never heard someone compare computers and the mullet. You are on another level. Bravo
@cramble
@cramble 4 ай бұрын
Your description on how the brain processes data reminds me of OpenCog's Atomspace. That uses a mixture of different structures joined together in various ways to both represent knowledge and process data. It is a metagraph based system, where the brain (don't quote me on this) seems like a graph based system. It's weird to see a line of similarity between those two things.
@adaslesniak
@adaslesniak 4 ай бұрын
Thank you for this video. Very educational.
@mt-qc2qh
@mt-qc2qh 5 ай бұрын
Good explanation of the differences. Using a digital approach we can only simulate a finite number of neurons. Hardly comparable to a brain. Perhaps the analog nature of Quantum computers might get closer, but they will be limited to even a smaller number of neurons. I think the current limit of qbits is less than 200.
@vvvvvvvvvvv631
@vvvvvvvvvvv631 5 ай бұрын
at 14:11 it seems you rendered the same scene twice
@digguscience
@digguscience 5 ай бұрын
The most important thing is to continue learning and updating existing methods
@Dell-ol6hb
@Dell-ol6hb 5 ай бұрын
This reminds me of Pluto, where one of the roboticists, says that to create the “perfect” robot (the most like a human) you need to introduce chaos to its mind by flooding it with countless different personalities and strong emotions and let it bring order to the chaos, this may or may not end up creating a robot that is a monstrous psychopath but it will result in a robot most like a human for good or bad.
@azhuransmx126
@azhuransmx126 4 ай бұрын
A company is using 100 lava lamps to introduce chaos for using in cryptography. Maybe we need to create a tiny chip with 100 micro lava lamps to create a particular personality, making it impossible to predict their actions. It always was a problem in computing science, how to generate random numbers from nothing.
@perverse_ince
@perverse_ince 5 ай бұрын
"The work goes on" Powerful
@cliffordbell8827
@cliffordbell8827 3 ай бұрын
like a mullet hahaha. Thanks for making informative videos. I missed a few recent ones and I'm just now going through them
@mndtr0
@mndtr0 Ай бұрын
Very interesting and good video. Would also love to watch video about bio-computers...
@Efecretion
@Efecretion 4 ай бұрын
I was NOT prepared for the mullet similie!!
@maybehuman2148
@maybehuman2148 5 ай бұрын
14:20 did you stutter? 🤣
@SimonStone360
@SimonStone360 5 ай бұрын
Really great content!
@MayzMatthiasYzebaert
@MayzMatthiasYzebaert 5 ай бұрын
Mullet joke got me :')) Oh could you mabe do a video on the future of analog computing? Anywa, love you video's.
@GCAGATGAGTTAGCAAGA
@GCAGATGAGTTAGCAAGA 2 ай бұрын
video on analog computing would be dope
@ianmercer1291
@ianmercer1291 5 ай бұрын
Take a look at Susan McKinstry's work on moving away from von neumann architecture, its pretty cool and is another road for this type of work. She's a professor at penn state and has videos online of her research.
@EvDelen
@EvDelen 5 ай бұрын
@13:57 repeat on purpose or glitch in the neural net?
@DrN007
@DrN007 5 ай бұрын
From an application perspective, would've been worth mentioning Event Cameras as well.
@microwavecoffee
@microwavecoffee 2 ай бұрын
The vocal delivery is so serious and then theres a joke that throws me off
@krandeloy
@krandeloy 5 ай бұрын
Oh that's a neat extrapolation of sci-fi at the end. the Mullet joke? no. That was bad. I got a good flash of a cool Cybernetic Sci-Fi setting where instead of humans with cybernetic impacts, it's robots with memristor or IBM true-north type stuff to make them random more similar to biological life.
@joshjones3408
@joshjones3408 5 ай бұрын
I was thinking maybe...a fine drink an some beans an maybe a face mask... 😆😆
@50wledligthbulb
@50wledligthbulb 5 ай бұрын
2:00 XXI century materialism crisis
@JoseLopez-hp5oo
@JoseLopez-hp5oo 5 ай бұрын
Maybe that feeling when you hit your funny bone is your clock nerve shorting to the muscle activation nerve! Perhaps we have a global clock line!
@smeagols_smelliest_smuggler
@smeagols_smelliest_smuggler 29 күн бұрын
4:06 should be a high signal-to-noise ratio.
@PutterV
@PutterV 5 ай бұрын
This really helps explain intel’s pivot towards NPUs for me thank you for making the vid. Like of course AI is the current trend but this really helps show how it can be more than just a trend.
@brendawilliams8062
@brendawilliams8062 4 ай бұрын
How can you gauge Moored Law? Noise and non- linear seem to be a path problem.
@dan_loup
@dan_loup 5 ай бұрын
That digital neuron could be a bit better by using DRAM instead of SRAM. Speed is obviously not needed, and DRAM use 8 times less space on the silicon than SRAM. The problem is that you need to keep refreshing it as its essentially a tiny capacitor.
@jonathancaldwell517
@jonathancaldwell517 2 ай бұрын
nice video. Repeats 2x @13:55: "and lastly the brain is an analog device, digital devices are an ill fit for replicating their behavior so we need to incorporate the analog element, which limits the systems flexibility"
@SurakIII
@SurakIII 5 ай бұрын
The mullet joke at the end was priceless. It was the delivery. 🙂🖖🏻
@harnojotanuwidjaja2309
@harnojotanuwidjaja2309 5 ай бұрын
Business in the front, party in the back.
@EDee20NINE
@EDee20NINE 5 ай бұрын
Party in the back..... Priceless 🧠
@niks660097
@niks660097 4 ай бұрын
Memory bottleneck is more serious problem than moore's law, a senior dev in my team once wrote a small C code to show how memory bandwidth limited modern CPUs are, the code would just read serially from an array of 1 Billion 4 Byte integers and time it with elements parsed per ms, on testing even a single ZEN 2 core would saturate 40GB/s dual-channel 3200 DDR4, let alone 8 cores, its almost magic how CPUs and GPUs can still work so fast being so bandwidth starved, specially on servers.
@oscarguzman3017
@oscarguzman3017 4 ай бұрын
13:55 deja vu
@GeoffryGifari
@GeoffryGifari 5 ай бұрын
I wonder, as neuromorphic computing develops what would software be like? If memory and computation can be combined, could the line between software and hardware also be blurred? In the brain, is there a difference between the substrate and its program?
@vadimpozhidaev9647
@vadimpozhidaev9647 5 ай бұрын
Probably, you are just going to use some different python libs for that :-D. Compiler developers will care about the rest.
@urekh
@urekh 3 ай бұрын
i can literally feel what you are describing about the brain computing idk if its the adhd or something else
@Wastedcum
@Wastedcum 5 ай бұрын
that mullet joke was real good!
@darthmemeious9526
@darthmemeious9526 2 ай бұрын
we need christopher mitchel to make a faust like deal with a super inteligence
@the2theonly672
@the2theonly672 5 ай бұрын
You answered the question in the video. The brain is only capable of achieving that low of a power consumption due to it making mistakes. Computers take very high amounts of power, but they are deterministic
@danytoob
@danytoob 5 ай бұрын
Gotta get me one of them mullet cuts. Now.
@robincray116
@robincray116 5 ай бұрын
Great Video!
@jachymfibir6626
@jachymfibir6626 3 ай бұрын
Brilliant content man, and what an epic ending 👌😁 creme de la creme
@hovant6666
@hovant6666 5 ай бұрын
I'd like to hear more about isentropic / reversible computing
@GCAGATGAGTTAGCAAGA
@GCAGATGAGTTAGCAAGA 2 ай бұрын
would be dope as well
@AnarchoCatBoyEthan
@AnarchoCatBoyEthan 5 ай бұрын
Good video. I thought the references you made were a smart inclusion because I thought for sure they’d be great engagement bait, but I don’t see any comments about them. I suppose in the only idiot here so I’ll say, man i love It’s Always Sunny. Also quite funny you used the avengers meme quote, quite randomly.
@darkguardian1314
@darkguardian1314 5 ай бұрын
Not all white papers are legit… I looked at the 1971 memristor white paper and it seems like it’s reaching for greatness like it wants to be first to coin the term, in case someone else comes up with a working system. At the time integrated circuits and microprocessors were brand new cutting edge stuff. We had the naive opinion that the human brain could be replicated as AI (Hal) with this (new for the time) technologies. This paper though interesting historically seems to be more about publishing papers as a requirement to maintain academic status than pushing the state of the art forward. I could be horribly wrong but after 52 years nothing came of it. Not even by the Soviets or China. Yeah, I was around then…🤣
@chris_hisss
@chris_hisss 4 ай бұрын
"Best of both worlds, like a mullet." Well done
@causewaykayak
@causewaykayak 5 ай бұрын
Its sort of ironic that this lovely peep into brain analogs has its own Matrix moment - The cat walk past the door - Twice. Look for that around 14:21 Did you do that on purpose ? Always fantastic quality !!
@qta-dd3ot
@qta-dd3ot 3 ай бұрын
another aspect that makes computer can't be powerful like human brain is the human itself. Human brain doesn't care about size, like it can grow to whatever size if necessary, while the chip manufacturers and perhaps customers prefer smaller CPU form factor. I wonder what can we achieve if we make a chip with the same volume as human brains
@RUHappyATM
@RUHappyATM 3 ай бұрын
Can you explain how human memory works? Is there a HDD somewhere up top?
@jwkelley
@jwkelley 5 ай бұрын
We do not know how memories are stored or how the brain computes. We know synapsis have something to do with them we can destroy the synapses and the memory trace remains (Tomas Ryans work and also mentioned by Randy Gallistal).
@GeoffryGifari
@GeoffryGifari 5 ай бұрын
If neuromorphic hardware were to be built in solid-state-chips, could they mimic neurons ability to grow, die, multiply, and morph their shape? How important are these aspects for the brains ability to compute?
@artifactingreality
@artifactingreality 5 ай бұрын
Thanks, near the beginning you said that traditional CPUs achieve low signal to noise ratio when you meant to say high ratio.
@artifactingreality
@artifactingreality 5 ай бұрын
Or you meant to say low noise (total) as opposed to low noise ratio.
@anthonyratcliffe
@anthonyratcliffe 4 ай бұрын
Thanks!
@st.john_one
@st.john_one 5 ай бұрын
incredibly interesting topic
@lomotil3370
@lomotil3370 5 ай бұрын
🎯 Key Takeaways for quick navigation: 00:03 💡 *Computers with Von Neumann architecture face limitations due to the Von Neumann bottleneck, restricting performance based on data and program memory access.* 01:01 ⚡ *The brain's efficiency, operating at low power (12-20 watts) with 86 billion neurons, inspires neuromorphic hardware development, aiming to replicate its capabilities.* 02:29 🔄 *The brain achieves exaflop-level computation through parallelism, unlike digital circuits. Lack of synchronization allows flexibility and resilience, using chaos as a feature for efficient learning.* 04:44 🧠 *Neurons, the brain's fundamental units, exhibit diversity in size, speed, and stimuli preferences. They form complex connections through synapses, contributing to computation and memory.* 09:11 🌐 *Silicon neurons, like IBM's TrueNorth and others, emulate neural behavior using traditional CMOS transistors. While scalable and low-power, they face challenges in energy efficiency, scalability, and replicating analog brain behavior.* Made with HARPA AI
@123zB3avisz123
@123zB3avisz123 4 ай бұрын
"Like a Mullet," had me dying.
@ronaldmarcks1842
@ronaldmarcks1842 5 ай бұрын
Repetion of "and lastly, the brain is an analog device...." at about 14:00
@essbeevanhoutte4095
@essbeevanhoutte4095 5 ай бұрын
Von Neumann's "The computer and the brain" is an interesting read on this topic.
@micahtewersofficial
@micahtewersofficial 5 ай бұрын
FUCK YEAH. Great video.
@STR82DVD
@STR82DVD 5 ай бұрын
Bloody brilliant presentation lad. Huge thanks from a Grade 8 teacher.
@Dogo.R
@Dogo.R 5 ай бұрын
Making brain computers is quite easy. Its called having a child. Aka a new brain cooperation partner. Costs extremely little too. So little it was even possible tens of thousands of years ago.
@rizizum
@rizizum 5 ай бұрын
Training takes too long and is too expensive though
@Dogo.R
@Dogo.R 5 ай бұрын
@@rizizum Costs almost nothing to train. Mimics by itself. In fact the most successful schooling systems are mainly powered by children interacting with each other, like the ACT system. Very automated and very scalable when done properly.
@GCAGATGAGTTAGCAAGA
@GCAGATGAGTTAGCAAGA 2 ай бұрын
reproducing human brains cost almost nothing nowadays, but reverse engineer them is the toughest part
@gardenofava
@gardenofava 5 ай бұрын
13:58 this is repeated twice
@engineeredarmy1152
@engineeredarmy1152 4 ай бұрын
Pretty hard to beat the evolution and i love the beauty of the life trying to optimise itself.
@lowkeyiguana
@lowkeyiguana 4 ай бұрын
Very good video!
AI’s Hardware Problem
16:47
Asianometry
Рет қаралды 614 М.
How Semiconductor DRAM Went 3D
19:53
Asianometry
Рет қаралды 95 М.
1 класс vs 11 класс (неаккуратность)
01:00
БЕРТ
Рет қаралды 4,2 МЛН
Chips evolution !! 😔😔
00:23
Tibo InShape
Рет қаралды 42 МЛН
Growing Living Rat Neurons To Play... DOOM?
27:10
The Thought Emporium
Рет қаралды 3,5 МЛН
P vs. NP: The Biggest Puzzle in Computer Science
19:44
Quanta Magazine
Рет қаралды 684 М.
Can SRAM Keep Shrinking?
14:50
Asianometry
Рет қаралды 139 М.
Why the Soviet Internet Failed
21:16
Asianometry
Рет қаралды 640 М.
How do Video Game Graphics Work?
21:00
Branch Education
Рет қаралды 3,2 МЛН
Analog Computing is GENIUS - Here's Why!
15:28
Two Bit da Vinci
Рет қаралды 467 М.
Why the UK's IBM Failed
34:49
Asianometry
Рет қаралды 493 М.
Neuromorphic: BRAINLIKE Computers
35:52
Coreteks
Рет қаралды 90 М.
Myths that Everyone Just Seems to Believe
14:38
Sideprojects
Рет қаралды 203 М.
Why The First Computers Were Made Out Of Light Bulbs
18:56
Veritasium
Рет қаралды 5 МЛН