Files
heterogeneous-distributed-t…/docs/source/api-guide/dist_checkpointing.strategies.rst
tianyutong d6ce507681 Initial Commit of Megatron-LM-0.8.0
Change-Id: Ifb4c061207ee2644a21e161ad52fc6ff40564e39
2025-05-23 09:54:48 +08:00

1.4 KiB

dist_checkpointing.strategies package

Package defining different checkpoint formats (backends) and saving/loading algorithms (strategies).

Strategies can be used for implementing new checkpoint formats or implementing new (more optimal for a given use case) ways of saving/loading of existing formats. Strategies are passed to dist_checkpointing.load and dist_checkpointing.save functions and control the actual saving/loading procedure.

Submodules

dist_checkpointing.strategies.base module

core.dist_checkpointing.strategies.base

dist_checkpointing.strategies.tensorstore module

core.dist_checkpointing.strategies.tensorstore

dist_checkpointing.strategies.two_stage module

core.dist_checkpointing.strategies.two_stage

dist_checkpointing.strategies.zarr module

core.dist_checkpointing.strategies.zarr

Module contents

core.dist_checkpointing.strategies