DeepSpeed: Accelerating large-scale model inference and training
![](https://www.microsoft.com/en-us/research/uploads/prod/2021/05/1400x788_deepspeed_no_logo_still-1-scaled.jpg)
![](https://miro.medium.com/v2/resize:fit:1400/1*Y7pjELRhyIW_V-XuRWeKMA.png)
Colossal-AI: A Unified Deep Learning System For Large-Scale
![](https://www.imzluo.com/images/deepspeed/end-to-end-throughput-speedup-of-1-bit-lamb-compared-to-lamb-for-pretraining-task-using-bert-large-with-different-batch-sizes-and-numbers-of-gpus.webp)
DeepSpeed - Make distributed training easy, efficient, and effective
![](https://www.microsoft.com/en-us/research/uploads/prod/2020/09/DeepSpeed_3_FeatureImage_MCRSite.png)
DeepSpeed: Extreme-scale model training for everyone - Microsoft
![](https://ar5iv.labs.arxiv.org/html/2201.05596/assets/x3.png)
2201.05596] DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
![](https://i0.wp.com/syncedreview.com/wp-content/uploads/2023/08/image-22.png?resize=950%2C663&ssl=1)
Microsoft Releases DeepSpeed-Chat for RLHF Training of ChatGPT
Deep Speed, PDF, Computer Architecture
![](https://i0.wp.com/neptune.ai/wp-content/uploads/2023/03/optimizing-infrastructure-costs-for-deploying-large-nlp-models-9.png?resize=793%2C453&ssl=1)
Inference Optimization Strategies for Large Language Models
![](https://www.microsoft.com/en-us/research/uploads/prod/2020/05/Fig-2-updated-larger_DeepSpeed2-1024x704.png)
AI at Scale: Timeline - Microsoft Research
![](https://economics.illinois.edu/sites/default/files/2023-02/Econometrics%20lab%20logo_0.png)
Machine Learning and Inference Laboratory - Photos from Conferences, thomas mitchell machine learning
![](https://www.microsoft.com/en-us/research/uploads/prod/2021/05/DeepSpeed5_fig7_final.jpg)
DeepSpeed: Accelerating large-scale model inference and training
Yuxiong He on LinkedIn: Excited to announce DeepSpeed-FastGen - a
Yuxiong He on LinkedIn: DeepSpeed powers 8x larger MoE model