API Guide
=========

.. toctree::
   :maxdepth: 4

   models
   tensor_parallel
   context_parallel
   pipeline_parallel
   fusions
   transformer
   moe
   dist_checkpointing
   distributed
   datasets
   num_microbatches_calculator