Article
From DeepSpeed to FSDP and Back Again with HF中国镜像站 Accelerate
•
47
Stas Bekman
stas
AI & ML interests
Toolmaker. Software creator, optimizer and harmonizer.
Makes things work and fly at Contextual.AI
Training LLM/RAG/Generative AI/Machine Learning/Scalability
Recent Activity
posted
an
update
21 days ago
Do you want ArcticTraining at @SnowflakeDB to add an ability to post-train DeepSeek V3/R1 models with DPO using just a few GPU nodes?
Please vote here and tell others about it: https://github.com/snowflakedb/ArcticTraining/discussions/58
ArcticTraining is an open-source, easy to use post-training framework for NVIDIA GPUs built on top of DeepSpeed.
updated
a model
about 2 months ago
stas/ml-engineering-book
updated
a model
about 2 months ago
stas/ml-engineering-book
Organizations
stas's activity
published
an
article
9 months ago
published
an
article
over 1 year ago
Article
Introducing IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model
•
31
published
an
article
over 2 years ago
Article
Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate
•
1
published
an
article
over 2 years ago
Article
The Technology Behind BLOOM Training
•
28
published
an
article
about 4 years ago
Article
Fit More and Train Faster With ZeRO via DeepSpeed and FairScale
•
4
published
an
article
over 4 years ago
Article