Supercharge your PyTorch training loop with 🤗 Accelerate

  Рет қаралды 2,710

HuggingFace

HuggingFace

2 жыл бұрын

Sylvain shows how to make a script work on any kind of distributed setup with the Accelerate library.
Sylvain is a Research Engineer at Hugging Face and one of the core maintainers of 🤗 Transformers and the developer behind 🤗 Accelerate. He likes making model training more accessible.

Пікірлер
Walk with fastai, all about Hugging Face Accelerate
28:17
Walk with fastai, all about Hugging Face Accelerate
Zachary Mueller
Рет қаралды 1,9 М.
ML Frameworks: Hugging Face Accelerate w/ Sylvain Gugger
1:05:29
ML Frameworks: Hugging Face Accelerate w/ Sylvain Gugger
Weights & Biases
Рет қаралды 4 М.
Giảm áp lực cho thắt lưng với mẹo này. #vungocson #drson #shorts
00:24
Giảm áp lực cho thắt lưng với mẹo này. #vungocson #drson #shorts
Vu Ngoc Son
Рет қаралды 30 МЛН
Hice un balde entero de palomitas de maíz usando una plancha para el cabello 🤭🤯
00:24
Hice un balde entero de palomitas de maíz usando una plancha para el cabello 🤭🤯
Poly Holy Yow Spanish
Рет қаралды 26 МЛН
❌А с малыми только таким способом! Не бить же их #pov #story
01:00
❌А с малыми только таким способом! Не бить же их #pov #story
Gufee.medalin
Рет қаралды 2,8 МЛН
Children deceived dad #comedy
00:19
Children deceived dad #comedy
yuzvikii_family
Рет қаралды 6 МЛН
Microsoft DeepSpeed introduction at KAUST
1:11:36
Microsoft DeepSpeed introduction at KAUST
KAUST Supercomputing Laboratory
Рет қаралды 6 М.
Turing-NLG, DeepSpeed and the ZeRO optimizer
21:18
Turing-NLG, DeepSpeed and the ZeRO optimizer
Yannic Kilcher
Рет қаралды 15 М.
Write your training loop in PyTorch
4:52
Write your training loop in PyTorch
HuggingFace
Рет қаралды 17 М.
DSPy Explained!
54:16
DSPy Explained!
Connor Shorten
Рет қаралды 50 М.
Getting Started with Pytorch 2.0 and Hugging Face Transformers - Philipp Schmid, Hugging Face
20:11
Getting Started with Pytorch 2.0 and Hugging Face Transformers - Philipp Schmid, Hugging Face
PyTorch
Рет қаралды 3,1 М.
DeepSpeed: All the tricks to scale to gigantic models
39:42
DeepSpeed: All the tricks to scale to gigantic models
Mark Saroufim
Рет қаралды 18 М.
Direct Preference Optimization: Forget RLHF (PPO)
9:10
Direct Preference Optimization: Forget RLHF (PPO)
code_your_own_AI
Рет қаралды 12 М.
Automate your GitHub Actions Releases (with Semantic Release)!
23:39
Automate your GitHub Actions Releases (with Semantic Release)!
Dave's Dev Channel
Рет қаралды 28 М.
Load Data and Train Neural Network Model - Deep Learning with PyTorch 6
22:47
Load Data and Train Neural Network Model - Deep Learning with PyTorch 6
Codemy.com
Рет қаралды 32 М.
Prompt Engineering, RAG, and Fine-tuning: Benefits and When to Use
15:21
Prompt Engineering, RAG, and Fine-tuning: Benefits and When to Use
Entry Point AI
Рет қаралды 59 М.
УГАДАЙ КАКАЯ ЧАСТЬ МАНДАРИНА НАРИСОВАННАЯ! (99% СПРАВИТСЯ) #Shorts #Глент
0:20
УГАДАЙ КАКАЯ ЧАСТЬ МАНДАРИНА НАРИСОВАННАЯ! (99% СПРАВИТСЯ) #Shorts #Глент
ГЛЕНТ
Рет қаралды 2,8 МЛН
Smart Sigma Kid #funny #sigma #comedy
0:25
Smart Sigma Kid #funny #sigma #comedy
CRAZY GREAPA
Рет қаралды 1,8 МЛН
What's happening??🤯 #enid #jennaortega #fakeortega #wednesday #wednesdayaddams #netflix
0:12
What's happening??🤯 #enid #jennaortega #fakeortega #wednesday #wednesdayaddams #netflix
the same Wednesday
Рет қаралды 31 МЛН
Ақтөре неге студияға келді😳 Бір Болайық! 25.06.24
27:05
Ақтөре неге студияға келді😳 Бір Болайық! 25.06.24
Бір болайық / Бир Болайык / Bir Bolayiq
Рет қаралды 304 М.
Средний палец и собака 🤯
0:25
Средний палец и собака 🤯
FATA MORGANA
Рет қаралды 3,6 МЛН
Мы никогда не были так напуганы!
0:15
Мы никогда не были так напуганы!
Аришнев
Рет қаралды 3,3 МЛН
I thought the car was rolling away, but I didn't expect it was out of battery? ,I never expected
0:17
I thought the car was rolling away, but I didn't expect it was out of battery? ,I never expected
PvZ Gaming
Рет қаралды 6 МЛН