flex_model.distributed.CPUPagedMemoryOffloadStrategy

class flex_model.distributed.CPUPagedMemoryOffloadStrategy(offload_fn)

__init__(offload_fn)

Methods

__init__(offload_fn)
execute(tensor)
initialize(name, output_ptr)