fsdp
Functions:
| Name | Description |
|---|---|
apply_fsdp2 |
Apply FSDP2 to the model. |
apply_fsdp2(model: Module, mesh: DeviceMesh) -> None
Apply FSDP2 to the model.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
|
Module
|
The model to apply FSDP2 to. |
required |
|
DeviceMesh
|
The device mesh. |
required |