ΑiPSSKrSSKJr SSKJr SSKJrJr SSKJ r S Sjr Sr g) N)fleet)in_dynamic_mode)HeterParallelOptimizerHybridParallelOptimizer)loggerc[RnXlUbBUR(a[R"S5 [ R "U5Ul0UlUR5S:aURR(d[XRUR5nURRSR(aSUlSUlURRSR"(aSUlUR (aS5eU$['XR5$U$)a| Optimizer for distributed training. For the distributed training, this method would rebuild a new instance of DistributedOptimizer. Which has basic Optimizer function and special features for distributed training. Args: optimizer(Optimizer): The executor to run for init server. strategy(DistributedStrategy): Extra properties for distributed optimizer. It is recommended to use DistributedStrategy in fleet.init(). The strategy here is for compatibility. If the strategy in fleet.distributed_optimizer() is not None, then it will overwrite the DistributedStrategy in fleet.init(), which will take effect in distributed training. Returns: Fleet: instance of fleet. Examples: .. code-block:: python >>> import paddle >>> import paddle.distributed.fleet as fleet >>> fleet.init(is_collective=True) >>> strategy = fleet.DistributedStrategy() >>> linear = paddle.nn.Linear(10, 10) >>> optimizer = paddle.optimizer.SGD(learning_rate=0.001, parameters=linear.parameters()) >>> optimizer = fleet.distributed_optimizer(optimizer, strategy=strategy) a$It is recommended to use DistributedStrategy in fleet_env.init(). The strategy here is only for compatibility. If the strategy in fleet_env.distributed_optimizer() is not None, then it will overwrite the DistributedStrategy in fleet_env.init(), which will take effect in distributed training.r pp_configsFz7sep parallel can not coexist with sharding_comm_overlap)ruser_defined_optimizer_is_collectiverwarningcopydeepcopy_user_defined_strategy_context worker_numheter_ccl_moder_hcghybrid_configsdp_comm_overlap _dp_enable _sep_enablesharding_comm_overlap_sharding_enabler) optimizerstrategy fleet_envhp_optims b/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/paddle/distributed/fleet/optimizer.py_dygraph_distributed_optimizerr s'4 I'0$  # # NNB ,0==+B (I!//>>.>>9+K+KH//>>o',#',$//>>##$-2)#//M/O);; cv[5(a [U0UD6$[RR"U0UD6$N)rr rdistributed_optimizer)argskwargss rr$r$`s5-t>v>>{{00$A&AAr!r#) rpaddle.distributedrpaddle.frameworkrmeta_optimizersrrutils.log_utilrr r$r!rr,s# $,L"EPBr!