How to learn deep learning? (Transformers Example)

Рет қаралды 8,472

Күн бұрын

❤️ Become The AI Epiphany Patreon ❤️ ► / theaiepiphany
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
In this video, I walk you through how I approach tackling a new deep learning topic and how my learning program looks like!
You'll learn about:
✔️ My strategy for learning ANY new (deep learning) topic fast
✔️ Lots of learning/personal tips along the way
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ jalammar.github.io/illustrate...
✅ Link to pdf of my OneNote page: 1drv.ms/b/s!AiUr5QUl32i_0B54C...
Note: it's a snapshot from November 12th, 2020.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
0:00 Quick recap of my 2020 deep learning journey
0:55 Tricks I learned doing my past projects
4:11 What I learned from researching NST
6:30 Deep Dream project
8:25 GANs project
10:00 Going forward - transformers!
10:36 Why transformers?
12:47 OneNote walk-through (attention mechanism)
15:30 OneNote (self-attention mechanism)
17:40 Zoom out - is there a life after GPT?
18:50 Word embeddings (word to vec, GloVe)
20:30 Tokenization - the underdog of NLP
22:00 Main BERT dependencies
25:30 Going forward
27:00 Always keep the bigger picture in your head
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 BECOME A PATREON OF THE AI EPIPHANY ❤️
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany ► / theaiepiphany
One-time donation:
www.paypal.com/paypalme/theai...
Much love! ❤️
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💡 The AI Epiphany is a channel dedicated to simplifying the field of AI using creative visualizations and in general, a stronger focus on geometrical and visual intuition, rather than the algebraic and numerical "intuition".
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
👋 CONNECT WITH ME ON SOCIAL
LinkedIn ► / aleksagordic
Twitter ► / gordic_aleksa
Instagram ► / aiepiphany
Facebook ► / aiepiphany
👨‍👩‍👧‍👦 JOIN OUR DISCORD COMMUNITY:
Discord ► / discord
📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER:
Substack ► aiepiphany.substack.com/
💻 FOLLOW ME ON GITHUB FOR COOL PROJECTS:
GitHub ► github.com/gordicaleksa
📚 FOLLOW ME ON MEDIUM:
Medium ► / gordicaleksa
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#deeplearning #deeplearningtips #learningtips

Пікірлер: 29

@TheAIEpiphany 3 жыл бұрын

One of my biggest strengths is that I learn stuff really fast. And it's not because I'm really smart or whatever. It's the experience I got learning stuff on my own over the past 10+ years (not limited to intellectual things but also human languages - I speak 5 currently, body workout, etc.). I share some tips in this video! I'd love to hear what's your learning strategy? and what advice did resonate the most with you?

@markhopkins8731 2 жыл бұрын

I'm head of ML at an animation company. I'm going to share this with our engineers. Great post, very inspiring!

@TheAIEpiphany 2 жыл бұрын

Glad to hear that! 🙏

@shandi1241 Жыл бұрын

Do you have some ML-vacancies in your team ?=)

@user-or7ji5hv8y 3 жыл бұрын

this is a great video. always interesting to see other people's journey into ML, as I try to take that path as well.

@TheAIEpiphany 3 жыл бұрын

Thanks! I agree I always love to hear other people's journeys as well.

@nhikieu6348 2 жыл бұрын

Thank you for the video. I just started doing PhD in CV and struggling to approach new mechanisms/architectures. Can't agree with you more on the opinion that papers not always the best way to accumulate understanding and knowledge. It would be very helpful if you can create github repo sharing your reading/watching list for CV topics (e.g., transformer, perceiver, etc.,). Great inspiration 🍀

@fengli8156 3 жыл бұрын

I LOVES THIS VIDEO!

@krishbaisoya9863 2 жыл бұрын

You're the one, Who encouraged me to switch from tensorflow to pytorch 🤞

@TheAIEpiphany 2 жыл бұрын

I am doing God's work hahahah

@aleksabisercic1410 3 жыл бұрын

Found it very helpful, thank you

@TheAIEpiphany 3 жыл бұрын

You're welcome Aleksa!

@neural1023 3 жыл бұрын

Great video!

@TheAIEpiphany 3 жыл бұрын

Thanks!!

@ProfRvS 3 жыл бұрын

Thanks a lot for your video. Would you be willing to share not just the link to Jay Alammar's blog but the whole OneNote document? That really looked like an awesome collection of references others could profit from as well ...

@TheAIEpiphany 3 жыл бұрын

Hi Reinhold! Thanks! Sure I'd love to do that, what would be the most convinient way to share the ON document?

@ProfRvS 3 жыл бұрын

@@TheAIEpiphany Hi Aleksa, I sent a message to your GMail concerning this. Maybe you coukd just reply to that?

@quanhua92 3 жыл бұрын

@@TheAIEpiphany Hi Aleksa, I have also sent you an email to your Gmail. Can you export your note to PDF and upload it somewhere? Thank you very much

@konda8376 3 жыл бұрын

@@TheAIEpiphany Can you please upload the PDF of your OneNote and add a link in the description of this video?

@TheAIEpiphany 3 жыл бұрын

@@konda8376 got so many requests I'm super sorry I didn't do it sooner! I'll upload it tomorrow

@AleksandarIvanovicTV 3 жыл бұрын

Je l imaš neki savet kako ući u ove vode iz perspektive početnika? Konkretno imam želju da se usmerim ka computer vision-u. Imao sam na faksu do sada možda dva predmeta iz mašinskog učenja koja sam solidno savladao i sada treći kod koga je eto sreća u nesreći da je baš iz oblasti CV-a, ali nije kako treba, više se svodi na to da se koriste gotove stvari bez nekog dubljeg zalaženja u to kako to zaista radi. A po meni površno znanje je isto kao da ništa ni ne znaš, pa me je ova tvoja priča oko implementiranja stvari od nule baš inspirisala. Počeo sam da pratim Deep Learning specijalizaciju na korseri kako bih stekao znanje o neuralnim mrežama koje mi nedostaje, jer iako su ovi kursevi na fakultetu koje sam imao bili dobri i gde smo prošli klasične algoritme mašinskog ucenja, na kraju se neuralne mreže uvek nekako pretandrljaju pa sam tu ostajao uvek nekako kratak. Pa konkretno pitanje šta misliš o Deep Learning specijalizaciji, kuda posle nje i da li vredi investirati vreme u Machine Learning kurs Andrew Ng-a, jer sam dobar deo tih stvari prošao na faksu i krenuo sam bio da ga pratim, ali pošto se radi u Octave-u i Matlabu me je nacisto demotivisalo pa sam ga ostavio nekako sa strane, možda pogrešno ga smatrajući zastarelim upravo zbog toga što nije u pajtonu.

@TheAIEpiphany 3 жыл бұрын

Hej! Baci pogled na ovaj video: kzfaq.info/get/bejne/bdePgq2ntrebpo0.html Njega sam napravio da odgovorim bas na takvo pitanje. Takodje imas u description-u svakog videa link ka mom Medium blogu tamo ces takodje naci korisne stvari za pocetnike. Srecno, cepaj samo.

@AleksandarIvanovicTV 3 жыл бұрын

@@TheAIEpiphany Hvala najlepše!

@fengli8156 3 жыл бұрын

would u mind share onenote plz

@TheAIEpiphany 2 жыл бұрын

It should be linked in the video description