*Edge Devices and LLMs: What's Ahead for AI*
In this episode of the Altium OnTrack podcast, host Tech Consultant Zach Peterson explores the fascinating world of Edge AI and how Large Language Models (LLMs) fit into the picture with Jan Jongboom, co-founder of Edge Impulse.
The two discuss the evolution from GPT-2 to GPT-4, the importance of edge computing, and the hardware requirements for running AI on edge devices. Discover how reducing the size of LLMs enables efficient deployment on edge devices, gain insights into the practical applications of AI in various industries, and learn about EDGE IMPULSE.
👉 Connect with Jan Here: www.linkedin.com/in/jan-jongb...
👉 Learn more about Edge Impulse: edgeimpulse.com/
👉 Check Out a Recent Vid from Edge Impulse: Using GPT-4o to train a 2,000,000x smaller model (that runs directly on device): • Using GPT-4o to train ...
👉 Getting started w/ Edge Impulse on Renesas platforms:
- docs.edgeimpulse.com/docs
- docs.edgeimpulse.com/docs/edg...
- docs.edgeimpulse.com/docs/edg...
👉 Exclusive 15 Days Free Altium Designer Access: www.altium.com/promotions/alt...
💡 Stay Connected:
Don't forget to like, comment, and subscribe for more in-depth tutorials and tips from @AltiumAcademy Share your thoughts and questions in the comments below!
👉 Subscribe for more OnTrack Podcast: / @altiumacademy
Don't forget to follow us on social to stay up-to-date on the latest Altium Academy content.
👉 Follow Altium on TikTok: / altiumdesigner
👉 Follow Altium on Twitter: / altium
👉 Follow Altium on Linkedin: / altium
👉 Follow Altium on Facebook: / altiumofficial
👉 Ready to try the industry's best-in-class design experience yourself? Download it today and get started! www.altium.com/downloads?utm_...
The Altium Academy is an online experience created to bring modern education to PCB Designers and Engineers all across the world. Here you can access a vast library of free training and educational content covering everything from basic design to advanced principles and step-by-step walkthroughs. Join industry legends as they share their career knowledge, review real-life design projects, or learn how to leverage one of Altium's leading design tools. No matter your level of experience, the Altium Academy can help you become a better Designer and Engineer!
About Altium LLC
Altium LLC (ASX:ALU), a global software company based in San Diego, California, is accelerating the pace of innovation through electronics. From individual inventors to multinational corporations, more PCB designers and engineers choose Altium software to design and realize electronics-based products.
#EdgeAI #GPT4 #MachineLearning
0:00 Intro
2:22 Jan and Edge Impulse Background
4:41 Power Reduction
8:21 FPGAs?
14:33 Parameter Reduction
20:35 Hardware Architecture
23:02 Synthetic Data?
27:07 Data Challenges
34:27 Speech Detection Challenges
37:17 Where Are LLMs Going?
39:46 Wrapping Up