FlexModel
latest

Getting Started

  • Introduction
  • Examples
  • Demos

Key Python API:

  • Core: Wrapper and HookFunction
  • Distributed: Backend, mappings and strategies
  • Traverse: Pytree traversal utility
FlexModel
  • Examples
  • Edit on GitHub

Examples

  1. Single-GPU Example

  2. Megatron Example

  3. FSDP Example

Previous Next

© Copyright 2023, Matthew Choi. Revision 94e3cb43.

Built with Sphinx using a theme provided by Read the Docs.