heterogeneous-distributed-training-framework/docs/source/api-guide/models.rst

models package

This package contains most of the popular LLMs . Currently we have support for GPT, Bert, T5 and Retro . This is an ever growing list so keep an eye out.

Subpackages

models.gpt models.t5 models.bert

Module contents

core.models