Looking for a way to convert model weights between huggingface and Megatron-LM.
(1): Continual pretraining from pretrained weights from huggingface
(2): Convert Megatron-LM model weights to huggingface

It shouldn't be too difficult to adjust layer names/weights, but I'm hoping someone has already done this.

Related #3 (already closed but couldn't find the solution)