x-j#ddlmZddlZddlmZddlmZerddlmZGddZ Gd d e Z Gd d e Z Gd de Z Gdde Z Gdde ZGdde ZGdde ZGdde ZGdde ZGdde ZGdde ZGdd e ZGd!d"e ZGd#d$e ZdS)%) annotationsN) TYPE_CHECKING) constants) _DTypeLiteralc6eZdZddZdZdZdZdZddZdS) BaseConfigNcR||_d|_|/t|tr||_nt d|t j|j}|D]\}}t||||jr| |jdSdSNz%Expected a dictionary. But received: ) _category _config_dict isinstancedict ValueErrorrget_category_default_configitemssetattr from_dict)selfcategory config_dictconfigfield default_values i/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/distributed/auto_parallel/strategy.py__init__zBaseConfig.__init__s!   "+t,, $/!! IKII6t~FF$*LLNN 0 0 E= D% / / / /   . NN4, - - - - - . .ctj|j}|D]C}||tj}|tjkrt |||DdSN)rrr keysget NOT_FOUNDr)rrrrvalues rrzBaseConfig.from_dict-sl6t~FF[[]] , ,EOOE9+>??E +++eU+++  , ,rc*i}tj|j}|D]}t ||}|||<|jD]1\}}t|tr| ||<2|Sr) rrr r getattr__dict__rrr to_dict)r result_dictrrr#s rr'zBaseConfig.to_dict5s 6t~FF[[]] ' 'ED%((E!&K   M//11 5 5LE5%,, 5%*]]__ E"rc|}d}|D]\}}|d|d|dz }|dzS)N{"z":"z",})r'r)rr(stringkvs r__repr__zBaseConfig.__repr__@sWllnn %%'' & &DAq o!ooooo %FF|rc |j}||}||t|<|jD])\}}t ||t j||*|Sr) __class____new__idr&rrcopydeepcopy)rmemoclsresultr.r/s r __deepcopy__zBaseConfig.__deepcopy__GspnS!!RXXM'')) 7 7DAq FAt}Q55 6 6 6 6 rcV|}|||Sr)r'r!)rr.dr(s rr!zBaseConfig.getOs#llnn q!$$$rr) __name__ __module__ __qualname__rrr'r0r:r!rrr r sx....&,,,   %%%%%%rr c eZdZdfd ZxZS)RecomputeConfigNcdtj}t||dSr)r RECOMPUTEsuperrrrrr2s rrzRecomputeConfig.__init__Us+& ;/////rrr=r>r?r __classcell__r2s@rrBrBT=0000000000rrBc eZdZdfd ZxZS)FusedLinearPromotionConfigNcdtj}t||dSr)rFUSEDLINEARPROMOTIONrErrFs rrz#FusedLinearPromotionConfig.__init__[s+1 ;/////rrrGrIs@rrLrLZrJrrLceZdZUded<ded<ded<ded<d ed <d ed <ded <ded <ded<ded<ded<ded<ded<ded<ded<dfd ZxZS) AMPConfigboolenablerdtypestrlevelfloatinit_loss_scalingintincr_every_n_stepsdecr_every_n_nan_or_inf incr_ratio decr_ratiouse_dynamic_loss_scalingz list[str]custom_white_listcustom_black_listcustom_black_varnamesuse_fp16_guarduse_bf16_guarduse_master_gradNcdtj}t||dSr)rAMPrErrFs rrzAMPConfig.__init__q*= ;/////rrr=r>r?__annotations__rrHrIs@rrPrP`sLLLJJJ    """"        $$$$0000000000rrPc@eZdZUded<ded<ded<dfd ZxZS) ShardingConfigrQrRrXstagedegreeNcdtj}t||dSr)rSHARDINGrErrFs rrzShardingConfig.__init__{+% ;/////rrrgrIs@rrjrjvsZLLLJJJKKK0000000000rrjc@eZdZUded<ded<ded<dfd ZxZS) GradientMergeConfigrQrRrXk_stepsavgNcdtj}t||dSr)rGRADIENT_MERGErErrFs rrzGradientMergeConfig.__init__s++ ;/////rrrgrIs@rrqrqsZLLLLLL III0000000000rrqcJeZdZUded<ded<ded<ded<d fd ZxZS) PipelineConfigrQrRrT schedule_moderXmicro_batch_sizeaccumulate_stepsNcdtj}t||dSr)rPIPELINErErrFs rrzPipelineConfig.__init__rorrrgrIs@rrwrwslLLL0000000000rrwc eZdZdfd ZxZS) QATConfigNcdtj}t||dSr)rQATrErrFs rrzQATConfig.__init__rfrrrGrIs@rr~r~rJrr~c eZdZdfd ZxZS) TuningConfigNcdtj}t||dSr)rTUNINGrErrFs rrzTuningConfig.__init__s+# ;/////rrrGrIs@rrrrJrrc eZdZdfd ZxZS) DatasetConfigNcdtj}t||dSr)rDATASETrErrFs rrzDatasetConfig.__init__s+$ ;/////rrrGrIs@rrrrJrrc eZdZdfd ZxZS)FusedPassesConfigNcdtj}t||dSr)r FUSED_PASSESrErrFs rrzFusedPassesConfig.__init__s+) ;/////rrrGrIs@rrrrJrrc eZdZdfd ZxZS)DPOptimizationConfigNcdtj}t||dSr)rDP_OPTIMIZATIONrErrFs rrzDPOptimizationConfig.__init__+, ;/////rrrGrIs@rrrrJrrc eZdZdfd ZxZS)MPOptimizationConfigNcdtj}t||dSr)rMP_OPTIMIZATIONrErrFs rrzMPOptimizationConfig.__init__rrrrGrIs@rrrrJrrc eZdZdfd ZxZS)SPOptimizationConfigNcdtj}t||dSr)rSP_OPTIMIZATIONrErrFs rrzSPOptimizationConfig.__init__rrrrGrIs@rrrrJrrc$eZdZdZdfd ZxZS)Strategya The `Strategy` object is used to configure the parallelization and optimization for static graph. Args: config (dict|string, optional): If this is None, the default configurations will used. If this is a dictionary, the recognized key-value of it will be used to override the default configurations while other default configurations are left unchanged. If this is a string, it is interpreted as the path to a YAML configuration and will be loaded to override the corresponding default configurations. Examples: .. code-block:: python >>> import paddle >>> from paddle.distributed.fleet import auto >>> strategy = auto.Strategy() >>> sharding = strategy.sharding >>> assert sharding.enable == False >>> assert sharding.stage == 1 >>> assert sharding.degree == 8 >>> sharding.enable = True >>> sharding.stage = 2 >>> sharding.degree = 2 >>> assert sharding.enable == True >>> assert sharding.stage == 2 >>> assert sharding.degree == 2 Nc|At|trtj||_nt d|i|_t j}t ||j|j t j d}t||_ |j t jd}t||_|j t jd}t%||_|j t jd}t+||_|j t jd}t1||_|j t jd}t7||_|j t jd}t=||_|j t j d}tC||_"|j t j#d}tI||_%|j t j&d}tO||_(|j t j)d}tU||_+|j t j,d}t[||_.|j t j/d}ta||_1dSr )2rrr5r6r rrBASErErr!rDrB recomputererPamprnrjshardingrurqgradient_merger|rwpipelinerr~qatrrtuningrrdatasetrr fused_passesrNrLfused_linear_promotionrrdp_optimizationrrmp_optimizationrrsp_optimization)rrrrr2s rrzStrategy.__init__s  &$'' $(M&$9$9!! !DFDD!#D > 4#4555'++I,?FF (55'++IM4@@ [))'++I,>EE &{33 '++I,DdKK 1+>>'++I,>EE &{33 '++IM4@@ [))'++I,r?__doc__rrHrIs@rrrsQ>8A8A8A8A8A8A8A8A8A8Arr) __future__rr5typingrrpaddle._typing.dtype_likerr rBrLrPrjrqrwr~rrrrrrrr@rrrs#""""" 87777778%8%8%8%8%8%8%8%v00000j000 00000000 00000 000,00000Z00000000*00000000Z00000000 000 00000:000 00000J000 00000 000 00000:000 00000:000 00000:000 XAXAXAXAXAzXAXAXAXAXAr