Pinned Loading

1. deepspeedai/Megatron-DeepSpeed deepspeedai/Megatron-DeepSpeed Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 2.2k 359

2. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 40k 4.5k

3. tensorflow/recommenders-addons tensorflow/recommenders-addons Public

   Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.

   Cuda 621 143

4. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 13.5k 3.1k

5. ISEEKYAN/mbridge ISEEKYAN/mbridge Public

   Bridge Megatron-Core to Hugging Face/Reinforcement Learning

   Python 116 16