flex_model.distributed.CPUPinnedMemoryOffloadStrategy

class flex_model.distributed.CPUPinnedMemoryOffloadStrategy(offload_fn)

__init__(offload_fn)

Methods

__init__(offload_fn)
execute(tensor)
initialize(name, output_ptr)