BigScience Large Model Training

@BigScienceLLM

Follow the training of "BLOOM 🌸", the @BigScienceW multilingual 176B parameter open-science open-access language model, a research tool for the AI community.

JeanZay supercomputer (France)

bigscience.notion.site/BigScience-176…

Replies Reposts Media

Pinned
BigScience Large Model Training
@BigScienceLLM
Jul 12, 2022
The BLOOM model is now officially released! Read more here: bigscience.huggingface.co/blog/bloom Find the model here: huggingface.co/bigscience/blo…
BigScience Research Workshop
@BigscienceW
Jul 12, 2022
BLOOM is here. The largest open-access multilingual language model ever. Read more about it or get it at bigscience.huggingface.co/blog/bloom hf.co/bigscience/blo…
6
BigScience Large Model Training
@BigScienceLLM
Sep 15, 2022
The super-fast inference solutions are finally here for all to use:
Stas Bekman
@StasBekman
Sep 15, 2022
Learn how you can get under 1msec per token generation time with BLOOM 176B model! Not one, but multiple super-fast solutions including Deepspeed-Inference, Accelerate and Deepspeed-ZeRO! huggingface.co/blog/bloom-inf…
1
BigScience Large Model Training
@BigScienceLLM
Jun 30, 2022
▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ 102%
15
BigScience Large Model Training
@BigScienceLLM
Jun 29, 2022
For 111 days, we've enjoyed world-class hardware stability and throughput thanks to the hard work of our friends at @Genci_fr, @INS2I_CNRS, Megatron & DeepSpeed. Having reached our objective earlier than expected, we'll keep training for a few more days. Stay tuned, more soon ;)
3
BigScience Large Model Training
@BigScienceLLM
Jun 29, 2022
▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓ 101%
67