flex_model.distributed.GPUMemoryOffloadStrategy

class flex_model.distributed.GPUMemoryOffloadStrategy(offload_fn)

__init__(offload_fn)

Methods

__init__(offload_fn)
execute(tensor)
initialize(name, output_ptr)