heterogeneous-distributed-training-framework/docs/source/index.rst

Megatron Core User Guide

Megatron Core is a Python library that has the core components required to build your language models. A reference implementation of megatorn core can be found in NeMo It offers a simple and intuitive API.

user-guide/index

api-guide/index