Kolmogorov-Arnold Network (KAN) - A New Deep Learning Architecture to Disrupt a $10T Industry?

  Рет қаралды 1,071

Finxter

Finxter

27 күн бұрын

Will Kolmogorov-Arnold Networks (KANs) disrupt the AI industry once again? Are they strictly superior to Multi-Layer Perceptrons (MLPs)? What are their weaknesses? Let's find out in this video!
♥️ Join my free email newsletter to stay on the right side of change:
👉 blog.finxter.com/email-academy/
Also, make sure to check out the AI and prompt engineering courses on the Finxter Academy:
👉 academy.finxter.com
🚀 Prompt engineers can scale their reach, success, and impact by orders of magnitude!
You can get access to all courses by becoming a channel member here:
👉 / @finxter

Пікірлер: 7
@Jagentic
@Jagentic 25 күн бұрын
Very good presentation - interesting, exciting, informative, and balanced. Thank you!
@finxter
@finxter 25 күн бұрын
Thanks, appreciate you like it. I tried to keep it simple and focused on the key insight, i.e., replacing dumb functions that make up an intelligent function with more intelligent functions that make up an even more intelligent function. ;)
@DimaZheludko
@DimaZheludko 25 күн бұрын
That answers some questions. When trying to implement NNs myself, I was amazed by simplicity of functions used in typical NNs. And I tried to utilize some more complex functions, at least activaton ones. In the result, I came to the same conclusion: more complex activation functions demand more compute, but their benefit is quite not obvious. So, in the end I used ReLu or something similar. I use NN to sort some images on my pc. The goal is to rank them according to the likelihood that I'll find those images visually pleasing. Program works ok, it does the job.
@finxter
@finxter 25 күн бұрын
That's great although I think using NN with small data and small training (e.g., on your computer) is likely to be overly complex. Their strength is mostly on HUGE data with MASSIVE compute due to the scaling laws.
@DimaZheludko
@DimaZheludko 24 күн бұрын
@@finxter That's true. Real power is in big numbers. However, my experience shows that some significant estimations can be made even on simple networks. For me, the network has to vagely recognize the scene and asess image quality. I suppose that can be done even on moderately sized networks. As for training dataset, mine counts tens of thousands images. Dataset has only two categories: accepted and regected. And program has to guess likelihood that given image will be in one of those categories. On other words, NN gives a number between 0 and 1, but tries to be as close to a expected answer as possible. As I said, results are quite acceptable. One notable obstacle is that I have no Nvidia card, so that had to be set up to work on Radeon and under Windows. Still, it works and I'm content.
@ringpolitiet
@ringpolitiet 25 күн бұрын
If you are curious about KANs, find a different source than this video.
@finxter
@finxter 25 күн бұрын
Fair. For instance check out this one for a more technical explanation (without memes as neurons): kzfaq.info/get/bejne/edFznM2Svdelf4E.htmlsi=90V0Vj11XlRhnKvD
Why the world NEEDS Kolmogorov Arnold Networks
7:07
ThatMathThing
Рет қаралды 23 М.
The moment we stopped understanding AI [AlexNet]
17:38
Welch Labs
Рет қаралды 840 М.
НРАВИТСЯ ЭТОТ ФОРМАТ??
00:37
МЯТНАЯ ФАНТА
Рет қаралды 8 МЛН
Best KFC Homemade For My Son #cooking #shorts
00:58
BANKII
Рет қаралды 69 МЛН
Inside Out Babies (Inside Out Animation)
00:21
FASH
Рет қаралды 22 МЛН
Meta Just Achieved Mind-Reading Using AI
18:17
ColdFusion
Рет қаралды 1,2 МЛН
What is an LLM Router?
9:16
Sam Witteveen
Рет қаралды 26 М.
AI’s Dirty Little Secret
6:41
Sabine Hossenfelder
Рет қаралды 542 М.
100+ Linux Things you Need to Know
12:23
Fireship
Рет қаралды 924 М.
Transformer Neural Networks Derived from Scratch
18:08
Algorithmic Simplicity
Рет қаралды 132 М.
A Path Towards Autonomous Machine Intelligence with Dr. Yann LeCun
1:03:05
AFOSR, Air Force Office of Scientific Research
Рет қаралды 20 М.
The Man Who Solved the World’s Most Famous Math Problem
11:14
Newsthink
Рет қаралды 760 М.
НРАВИТСЯ ЭТОТ ФОРМАТ??
00:37
МЯТНАЯ ФАНТА
Рет қаралды 8 МЛН