x-jhXddlmZddlZddlmZddlmZddlmZddl Z ddl Z ddl m cmZddl mZddlmZddlmZdd lmZmZdd lmZdd lmZdd lmZdd lmZmZm Z m!Z!ddl"m#Z#ddl$m%Z%ddl&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/erddl0m1Z1gZ2e%Z3e Z4dZ5ddddZ6GddZ7GddZ8GddZ9GddZ:Gd d!Z;Gd"d#Z<Gd$d%e<Z=Gd&d'Z>ed(Z? d0d1d/Z@dS)2) annotationsN)contextmanager)cached_property) TYPE_CHECKING)_C_ops) ValueDict)grad)core framework) BuildStrategy) check_type)switch_to_static_graph)Value fake_valueget_fake_value_name is_fake_value)event_register)TranslatorLogger) RETURN_NO_VALUE_MAGIC_NUMBackendCUDAGraphState TimeCounterauto_layout_is_enabled backend_guardcse_is_enabledmaybe_dynamic_shape_tensoruse_specialized_device)ConcreteProgramc<t|rtS|jSN)rFAKE_VALUE_NAMEname)values h/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/jit/dy2static/pir_partial_program.pyget_value_namer'<s U :T enable_cseenable_delete_assert_opctjd}|r|di|r|di||dS)Nr%common_subexpression_elimination_passdelete_assert_op_pass)paddlepir PassManageradd_passrun)programr*r+pms r&apply_general_passesr6Bsg    " "BA ;R@@@1 +R000FF7OOOOOr(c\eZdZdZdZedZdZdZe dZ dZ dZ d S) NestSequencea A wrapper class that easily to flatten and restore the nest structure of given sequence. It also remove the duplicate variables in the sequence. For example: >>> t = [v1, v2, v1] >>> m = tolist(t) [v1, v2] >>> m.restore([t1, t2]) [t1, t2, t1] cV||_|\|_|_dSr") _raw_input_tolist_var_map _var_list)self raw_inputs r&__init__zNestSequence.__init__Ys##(, % t~~~r(c|jSr"r=r>s r&var_listzNestSequence.var_list]s ~r(ct}g}tj|jD]D}t |t s||vrt|||<||E||fS)zx Flattens the nested sequences into single list and remove duplicate variables + non-variable elements. ) rr/utilsflattenr: isinstancerlenappend)r> variable_map variable_listr%s r&r;zNestSequence._tolistas!{{  \))$/:: ( (EeU++  $$"%m"4"4L    ' ' ' ']**r(c $tjtksJfd}tjjt t|tjjS)z@ Restores the nested sequence from tensor list. cXt|trj|S|Sr")rHrr<)xr>tensor_result_lists r&to_tensor_resultz.NestSequence.restore..to_tensor_resultws,!U## <)$-*:;;Hr() rIr=r/rFpack_sequence_asr:listmaprG)r>rPrQs`` r&restorezNestSequence.restoreqs4>""c*<&=&=====       |,, O %v|';';DO'L'LMM N N   r(cj}t|dkr|d}td|DsJfd|DS)Nrrc3@K|]}t|tVdSr")rHr.0vs r& z/NestSequence.quick_index_map..s,<s r& z0NestSequence.quick_index_map..s 555Q a 555r()r:rIall)r> raw_inputss` r&quick_index_mapzNestSequence.quick_index_mapsa_ z??a  #AJ<<<<<<<<<<5555*5555r(c*fd|jDS)Nc g|] }| Sr]r])rYidx tensor_lists r&r_z.NestSequence.quick_restore..sAAAS C AAAr()rb)r>rfs `r& quick_restorezNestSequence.quick_restores AAAAD,@AAAAr(c|j|Sr"rB)r>items r& __getitem__zNestSequence.__getitem__s~d##r(N) __name__ __module__ __qualname____doc__r@propertyrDr;rUrrbrgrjr]r(r&r8r8Ms  777X+++    66_6BBB$$$$$r(r8ceZdZdZedZed"dZedZdZ edZ ed Z ed Z ed Z ed Zed Z d#dZdZdZdZdZdZdZdZedZedZed$dZed%dZedZed Zed!ZdS)&RunnableProgramaa pir program ready for run_program_op to run. constructed by 3 parts: - pir program (pir::Program) - in_out_values - input_x values ([string | pir::Value]) - input_param values ([string | pir::Value]) - output values ([string | pir::Value]) - forward_backward_ranges - forward_range (tuple(Int, Int)) | None - backward_range (tuple(Int, Int)) | None cTgfd|S)Nc ||jD]K}||D] }|LdSr")extendkwargsvaluesopsresultsblocks)blockop all_values extend_valuess r&r}z>RunnableProgram._get_program_all_values..extend_valuess   ellnn3355 6 6 6i ) )!!"**,,///YY[[))E!M%(((() ) )r() global_block)r4r|r}s @@r&_get_program_all_valuesz'RunnableProgram._get_program_all_valuessK  ) ) ) ) ) )  g**,,---r(returndict[str, Value]ctti}t|D]}|jD]}|||<|Sr")r#rrqr_names)r4name_to_value_dictr%r$s r& _get_name_value_map_from_programz0RunnableProgram._get_name_value_map_from_programsX0?/N$<.s 222aq!!222r()rIrHstr)r>rvs r& convert_namezRunnableProgram.convert_namesG v;;!  I fQi % % M2262222r(c*fdjDS)Nc*g|]}j|Sr]rr^s r&r_z,RunnableProgram.x_values..s!===1#A&===r()x_namesrCs`r&x_valueszRunnableProgram.x_valuess==== ====r(c*fdjDS)Nc*g|]}j|Sr]rr^s r&r_z0RunnableProgram.param_values..s!AAA1#A&AAAr() param_namesrCs`r& param_valueszRunnableProgram.param_valuess AAAA0@AAAAr(c*fdjDS)Nc*g|]}j|Sr]rr^s r&r_z.RunnableProgram.out_values..s!???1#A&???r() out_namesrCs`r& out_valueszRunnableProgram.out_valuess????????r(c*fdjDS)Nc*g|]}j|Sr]rr^s r&r_z1RunnableProgram.x_grad_values..!BBB1#A&BBBr() x_grad_namesrCs`r& x_grad_valueszRunnableProgram.x_grad_values BBBB0ABBBBr(c*fdjDS)Nc*g|]}j|Sr]rr^s r&r_z5RunnableProgram.param_grad_values..rr() p_grad_namesrCs`r&param_grad_valuesz!RunnableProgram.param_grad_valuesrr(c*fdjDS)Nc*g|]}j|Sr]rr^s r&r_z3RunnableProgram.out_grad_values..rr() o_grad_namesrCs`r&out_grad_valueszRunnableProgram.out_grad_valuesrr(Nct|ts Jdt|dks Jdt|dts Jd||_||d|_||d|_||d|_||_ ||_ ||_ d|_ d|_ |j 2dt|jjf|_ |j [t|jjt|jjf|_ |gggf}||d|_||d|_||d|_|j dt|jjkr/|jj|j dnd|_|j ddkro|j ddz t|jjkr2|jj|j ddz nd|_|j dt|jjkr/|jj|j dnd|_dS)Nz)in_out_values must be tuple with len == 3rrrF)rHtuplerIrSr4rrrrout_stop_gradients forward_rangebackward_range has_splited finish_passr~rwrrrfwd_end_next_opbwd_start_pre_opbwd_end_nex_op)r>r4 in_out_valuesrgrad_in_out_valuesrrs r&r@zRunnableProgram.__init__s(-//  7  /=!!Q&&& 7'&&-*D11  7  1 ((q)9:: ,,]1-=>>**=+;<<"4*,     %"#S)B)B)D)D)H%I%I!JD    &DL--//344DL--//344#D   %!#R  --.@.CDD --.@.CDD --.@.CDD !!$s4<+D+D+F+F+J'K'KKK L % % ' ' +D,>q,A B B #A&**'*Q.dl//1156677 L % % ' ' +D,?,BQ,F G G  "1%DL,E,E,G,G,K(L(LLL L % % ' ' +D,?,B C C r(c|j|jdt|jjf|_t|jjt|jjf|_dS|jd}|jd}|jd}|jd}t|jjD]/\}}||jkr|}||jkr|dz}||j kr|}0|j +t|jj}||f|_||f|_dSNrr) rrrIr4r~rwrr enumerater)r> fwd_startfwd_end bwd_startbwd_endrer{s r&update_op_rangezRunnableProgram.update_op_rangesh   '4+@+H"#S)B)B)D)D)H%I%I!JD DL--//344DL--//344#D    *1-I(+G+A.I)!,G$T\%>%>%@%@%DEE " "R---!G... #aI,,,!G"*dl7799=>>"+W!5D #,g"6D   r(ctjjj|j\}}t ||j|j|j f|j d|j |j Sr") r/base libpaddler0 clone_programr4rqrrrrrr)r>cloned_program_s r&clonezRunnableProgram.clone,sf"K15CC L    \4+T^ <  #         r(c 2|jdus Jdd|_|tjjj|j|j|j |j |j |j |j |j|j \\}}}||g|fS)NFzJPlease ensure only split once! don't call split_forward_backward manually.T)rrr/rrr0 split_programr4rrrrrrrr)r>fwd_progbwd_prog prog_attrs r&split_forward_backwardz&RunnableProgram.split_forward_backward9s5((( X)((   K ! % 3 3 L M   O    "         (#Y..r(c\|j}|j}tdd|dtdd|d|j}||||\|_|_tdd|dtdd|ddS)a Main entries for pass function, without considering any input/output and forward segmentation. pass_fn' signature is: 1. This function will change forward and backward program. 2. call self.program_attr means start to run. so we can't call this function after program_attr is called. def pass_fn(forward_program, backward_program): return forward_program, backward_program rz<******** [JIT] PIR forward program before PIR PASS ********  z=******** [JIT] PIR backward program before PIR PASS ******** z;******** [JIT] PIR forward program after PIR PASS ******** z<******** [JIT] PIR backward program after PIR PASS ******** N)forward_programbackward_program prog_loggerlogprogram_name_attr)r>pass_fn origin_fwd origin_bwdrs r&apply_pir_program_passz&RunnableProgram.apply_pir_program_passRs) *  YJ Y Y Y     ZZ Z Z Z   !26=g  $57 7 3d3  X: X X X     YJ Y Y Y     r(c\|jjD] }|jdS dS)NTF)r4r~rw dist_attr)r>r{s r&is_distributed_programz&RunnableProgram.is_distributed_programws;,++--1  B|'tt(ur(c|r5tjjjj|jdSdSr")rr/ distributed auto_parallelstaticmix_to_dist_passapply_mix2dist_passr4rCs r&"apply_dist_pass_for_origin_programz2RunnableProgram.apply_dist_pass_for_origin_program}sS  & & ( (    , 3 D X X        r(c2|rtjjjj|jtjjjj |jtjjjjj |jtj j j|jtjjjj|jdSdSr")rr/rrrrrr4pir_passapply_partition_pass ReshardPassesapply_reshard_passrrr0apply_dist2dense_passremove_unuseful_comm_op_passrCs r&!apply_dist_pass_for_whole_programz1RunnableProgram.apply_dist_pass_for_whole_programs  & & ( (    , 3 D X X       , 3 < Q Q       , 3 < J ] ]     K ! % ; ;DL I I I   , 3 < Y Y        r(c*|Sr")rrCs r&_forward_backward_programz)RunnableProgram._forward_backward_programs**,,,r(c| |jdus Jdd|_t|j |j}|d}i}t|j|}t|j|}|D]K\}}||ht|zr2||vr| |||vr| |Lt |j|i}|jD]'\}}|dkr fd|D||d<|||d<(t|d t|j ks Jd t|d |j D]\} } t| r| | _|S) NFzgprogram_attr() is called by PartialProgramLayer, don't call it manually, use program_name_attr instead.Tno_need_buffersfocTg|]$}|t%Sr]getr)rYnfwd_maps r&r_z0RunnableProgram.program_attr..s8///56GKK:<<00///r(_valuesr fo_valuesz0Output values and stop gradients length mismatch)rrqrrrunify_value_namesritemssetremoveupdate_program_name_attrrIrzipr stop_gradient) r>rno_need_buffer_namesrename_mapping original_namenew_name program_attrknsrZrrs @r&rzRunnableProgram.program_attrs?5((( u)(( !BB    !201BC(::  .  )::  !>  (6';';'='= : : #M8x(3/C+D+DD : $888(// >>>333(//99900  "N    +1133 , ,EArDyy////:</// ]]]+*,LA & &< ,--T5L1M1MMMM >NMM!$  %t'>! !  , , A}Q +AOOr(rdict[str, str]ct|}t|D]b}|js |j}|||}||||ct|D]2}|jr)| sJd|d|j 3|S)z7Ensure every value at most has one name in the program.z7Expected all values in Program have only one name, but z has multiple names: ) dictrqrhas_namer$rupdate_renamer~_has_only_one_namer)r4rr%rs r&rz!RunnableProgram.unify_value_namess n--$< zH%))(H==H  ! ! h(<(<(>(>??    %<.s:DEQ.%8%8q!!ar()r)rrrvss ` r&rz(RunnableProgram.update_program_name_attrsZ__&&  EArIKIaLL  r(cv|jd}i}|D]\}}d|D||<|S)Nrc,g|]}t|Sr]rrXs r&r_z5RunnableProgram.program_name_attr..s >>>aq 1 1>>>r()rr)r> origin_attr _program_attrrr s r&rz!RunnableProgram.program_name_attrsT4Q7   &&(( ? ?EAr>>2>>>M!  r(c(|jddS)NrrrCs r&rzRunnableProgram.forward_program-a033r(c(|jddSrrrCs r&rz RunnableProgram.backward_programrr()rrNNN)rrrr)rr rr)rkrlrmrn staticmethodrrrrrrrrrrrr@rrrrrrrrrrrrrrr]r(r&rqrqs    \ """\"NN_N333>>_>BB_B@@_@CC_CCC_CCC_C ; ; ; ; z7774    ///2# # # J  "--_-22_2h\*\_44_444_444r(rqc eZdZdZdZdZdS)PartialProgramLayerHookc ||fSr"r])r>rsrc_varss r&before_append_backwardz.PartialProgramLayerHook.before_append_backwards ((r(c |||fSr"r])r> whole_programinputsr grad_outputsforward_end_idxbackward_start_idxs r&after_append_backwardz-PartialProgramLayerHook.after_append_backwardsox77r(c|Sr"r])r> infer_programs r& after_inferz#PartialProgramLayerHook.after_infer sr(N)rkrlrmrr"r%r]r(r&rrsA))) 8 8 8r(rc"eZdZdZdZdZdZdS)OperatorIndexPreservePasspreserved_index_rctjtj|_txjdz c_||_||_dSNr)r'OP_NAME_PREFIXcounterr$rindex)r>r-rs r&r@z"OperatorIndexPreservePass.__init__sA0?dAZAbdd !))Q.))  r(cjt|jdkr"|jdksJ||St jjj ||jd d|j |j||}d}|jD]B}| dkr#|j | dvrn|dz }C|t|jkrtd|j d||j|||_|S)Nrbuiltin.shadow_output output_namerz Can't find index preserve label z, don't remove it in pass.)rIr~rwr-rr/rrr0append_shadow_outputresultr$attrs RuntimeError remove_op)r>r4 new_indexr{s r&__call__z"OperatorIndexPreservePass.__call__s w##%%) * *a / /:????<<(( ( !66   " " &q ) 0 0 3 3 I J    ,,w'' &&((,  B 444IM!::: NII G0022677 7 7X49XXX  (()=)=)?)?)CI)NOOO r(N)rkrlrmr+r,r@r7r]r(r&r'r's<'NG r(r'ceZdZdZdZdS)IndicesPreservePassc0||_||_d|_dSr")rindices new_indices)r>r;rs r&r@zIndicesPreservePass.__init__8s  r(c|jg}t|jD].\}}|t |||/|d|}d|ddD|_|S)Ncg|] }|j Sr])r-)rYps r&r_z0IndicesPreservePass.__call__..Cs888AG888r(r)rrr;rJr'r<)r>r4passesrer- new_programs r&r7zIndicesPreservePass.__call__=s,#DL11 I IJC MM3E6#;GG H H H H fRj)) 88VABBZ888r(N)rkrlrmr@r7r]r(r&r9r97s2   r(r9cPeZdZdZdZdZedZedZdZ dS)ValuePreservePasspreserved_value_c"||_||_dSr")rv use_cinn_pass)r>rvrGs r&r@zValuePreservePass.__init__Js *r(c td)NzNot implemented.)r4)r>r4s r&applyzValuePreservePass.applyNs-...r(cdfd}|S)Nrc}dz |Sr*r])r$countprefixs r&name_genz9ValuePreservePass.create_name_generator..name_genUs!%e%%D QJEKr(r])rMrNrLs` @r&create_name_generatorz'ValuePreservePass.create_name_generatorQs.       r(c t|rdS||vr||S|}|||<tjjj|||t |j|Sr") rr/rrr0r1rIr~rw)r%r4 value2namename_generatorr$s r&attach_preserved_namez'ValuePreservePass.attach_preserved_name]s    4 J  e$ $~ 5 !66    $$&&* + +     r(c&tttjtjfd|j}|ig} j D]}| dkr| d tjrW|d| d<|||D])} |*tjfd||_S)Nc>t|Sr")rDrS)r%rRr4rQs r&z,ValuePreservePass.__call__..ts$+AA r(r/r0rcH|tSr"r)r$name2new_values r&rVz,ValuePreservePass.__call__..s++D*,,??r()rrDrOr+r/rF map_structurervrIr~rwr$r3 startswithoperandsourcerJr5)r>r4names to_remove_opr{rXrRrQs ` @@@r&r7zValuePreservePass.__call__ms[[ *@@  ,   **       K   **W%% &&((, , ,Bwwyy33388::m,77%4,AC AAfhh#288::m#<=!''+++ 1 1B  " " , ,R 0 0 0 0l00 ? ? ? ?   r(N) rkrlrmr+r@rIrrOrSr7r]r(r&rDrDGs|'N+++///  \   \ )))))r(rDceZdZdZdS)FullGraphPreProcessPassctjjj|}|jrtjjj}|ditjjj||tjjj ||| ||S)Nr.) r/rrr0apply_bn_add_act_passrGr1r2infer_symbolic_shape_passreduce_as_sum_passr3)r>r4r5s r&rIzFullGraphPreProcessPass.applys+'+AA'JJ   &*6688B KK/ 4 4 4 K ! % ? ?G L L L K ! % 8 8W E E E FF7OOOr(N)rkrlrmrIr]r(r&r`r`s#     r(r`ceZdZdZdZ d%ddfd ZedZdZe ddZ d Z e d&d Z d Zd'dZed(d&dZe dZe dZed&dZedZe d&dZe d&dZdZed)dZd(dZdZd'dZdZedZdZ d Z!d*d"Z"d#Z#ed$Z$xZ%S)+PartialProgramLayera PartialProgramLayer wraps all the ops from layers decorated by `@to_static` and execute them as a static subgraph. .. note:: **1. This is a very low level API. Users should not use this API directly. Please use `partial_program_from(concrete_program)` to create it. **2. TensorArray is not currently supported in the output. Args: main_program(Program): The main program that contains ops need to be executed. inputs(list[Variable]): The input list of the decorated function by `@to_static`. outputs(list[Variable]): The output list of the decorated function by `@to_static`. parameters(list[Tensor]|None): All trainable parameters included in the program. Default None. constraints(list[tuple[str, int|None, int|None]]): A list to specify the constraints of the program. Default None. Returns: Layer: A Layer object that run all ops internally in static graph mode. N) constraintsc tt||_t||_||ng|_||nggf\|_|_|dt|_ t|j tsJ| ||j|_ |$|j|ddd<|j|ddd<d|_i|_d\}}} t!j} | r| \}} | j}|5|dvr1t(jjj|| ||_i|_g|_|dt8j|_i|_tA|_!i|_"dS) Nbuild_strategyrrTr)float16bfloat16)custom_white_listcustom_black_listdtypebackend)#superr@r8_inputs_outputs _constraints_params _param_valuesrr _build_strategyrH_verify_program_origin_main_programtraining_program_extra_infor _dygraph_tracer_get_amp_op_list _amp_dtyper/ramp fp16_listsAutoMixedPrecisionLists _amp_list _scope_cache_hookersrPHI_backend_grad_var_namesr_compile_time_counter_prog_attrs_map_cache) r> main_programroutputs parametersrgru amp_dtyperlrmtracer __class__s r&r@zPartialProgramLayer.__init__s #F++ $W-- +6+BKK$0JJr2h ) d( &zz*:MOOLL$. >>>>>$($8$8 $-% % !  !#|JqM!!! #1JqM!!!  #% :J7 $&7*,,  *393J3J3L3L 0 0)I  Y2I%I%I !,DD&7&7#E N  9gk:: !%0]]"%'"""r(c|\}}tjjtjj|||dt jk|d}tjt |t || |d||S)Ncuda_graph_statecuda_graph_dispatch_keyT cache_keyuse_scope_cache) r/rr calc_scope_cache_keyget_program_id_from_attrsrDISABLEr run_programrf _valid_vars_create_scope_vec)partial_program_layerrrr3 prog_attrscuda_graph_attrsscope_cache_keys r&run_implzPartialProgramLayer.run_impls',$ $ +*?? K  6 6z B B  / 0N4J J 6 7    !  + +F 3 3  + +J 7 7 ! 3 3) $ 4       r(c|d}||}|||j|}||}||S)zQ Execute static graph by Interpreter and Return dynamic Tensors. F in_sot_mode)_prepare_attributes_prepare_inputscall_run_impl_with_hookrt _restore_out_remove_no_value)r>rr3outrestored_nest_outs r&r7zPartialProgramLayer.__call__ sx((U(;;%%f--**  L    !--c22$$%6777r(zsot call partial_programc|d}|||j|}|j|S)zz In sot, inputs and outputs of partial program only contain tensors, so we can skip some step to speed up Tr)rrrtrrrg)r>rr3rs r&sot_callzPartialProgramLayer.sot_callsR ((T(::**  L    }**3///r(ctj)tj||||Sttj||||Sr")rfHOOKED_RUN_IMPLr__get__)r>rrr3s r&rz+PartialProgramLayer.call_run_impl_with_hook'sp  . 6&/77==  '66#,44T::  r(rrqcrt|jj}t|jj}d|D}|j}t jjj |j |t|j j dt|j |||f|S)Ncg|] }|j Sr]rrXs r&r_z?PartialProgramLayer.origin_runnable_program..As???!ao???r(output_)rSrqrDrrrur/rrr0append_shadow_outputsrxrIr~rwrq)r>rrrparamss r&origin_runnable_programz+PartialProgramLayer.origin_runnable_program;sdl+,,t}-..@?w???# !77  %  )6688< = =       % VW %    r(c:|j|dSr")rrJ)r>hookers r& add_hookerzPartialProgramLayer.add_hookerOs V$$$$$r(Fc|stjS||jvr g|j|<|j|}|D] }|jr|cStj}|||Sr")r Scoper _can_reusedrJ)r>rr cached_scopesscopes r& _get_scopezPartialProgramLayer._get_scopeRs :<<  D- - -+-D i ())4 "  E     U### r(cz|rʈfd}j}trhjrOt jd}|di| |j j D]}| || ||Sj}|trhjrOt jd}|di| |j |}j|fd}| ||S)Ncjrt|tjtjjj|j tjjj |nЉj rYtjjj|j tjjj |n^t|tjtjjj |||fS)Nr))ris_cinnr6rr/rrr0bind_symbolic_constraintsrsapply_cinn_passis_pccapply_pcc_passcheck_infer_symbolic_if_need)rrrr>s r&rz4PartialProgramLayer._create_program..pass_fnds^=((**('#1#3#304 0E0E0G0G K)-GG'):K)-==oNNNN]))++ K)-GG'):K)-<<_MMMM('#1#3#304 0E0E0G0G K)-JJ''(888r(rauto_layout_passcpfd}t|tjt|tjjrtjjj|j tjjj ||||tjjj |nj rYtjjj|j tjjj |n)tjjj |||fS)Nc tjjj| tjjj| d|D fd} fd}| D]\}}|||}|||dS)Nc(i|]}|jD]}||Sr])r)rYrir$s r& zvPartialProgramLayer._create_program..pass_fn..init_backward_program_shape_analysis..sC... $(K..!d....r(cZ||dSr")set_shape_or_data_for_varget_shape_or_data_for_var) forward_valuebackward_valuebackward_shape_analysisforward_shape_analysiss r&+share_symbol_shape_from_forward_to_backwardzPartialProgramLayer._create_program..pass_fn..init_backward_program_shape_analysis..share_symbol_shape_from_forward_to_backwards@0II*2LL -r(c|dvr/d|}d|S|vr|Std|d)Nbo_grz kw_args: z not found)r- Exception)kw_namekw_valuereforward_name_value_maprs r& get_kwargs_forward_matched_valuezPartialProgramLayer._create_program..pass_fn..init_backward_program_shape_analysis..get_kwargs_forward_matched_valuesy"&7&???"3F";"A"A'"J"JC#9 1$ 7 <$%(>>>#9'#BB"+,K,K,K,K"L"LLr() r/rrr0 get_shape_constraint_ir_analysis(register_symbol_cstr_from_shape_analysis list_varsr~rur) rrrrrrforward_matched_valuerrrrs @@@r&$init_backward_program_shape_analysiszbPartialProgramLayer._create_program..pass_fn..init_backward_program_shape_analysissS.4[-B-F-g-g'..*/5k.C.G.h.h(//+,TT...$3$=$=$?$?...*  M M M M M M)5577>>@@FFHH+(=s ` r&rz4PartialProgramLayer._create_program..pass_fns/////b%#-//,0M,A,A,C,C %$-//,0M,A,A,C,C =((**K)-GG'):K)-==oNNN88')9K)-==>NOOOO]))++K)-GG'):K)-<<_MMMMK)-JJ''(888r()rrrrrr/r0r1r2r3r4rr%rr_append_backward_set_grad_typert)r> is_infer_moderr$r5r train_programs` r&_create_programz#PartialProgramLayer._create_program`s J ! 9 9 9 9 9<!8>>@@M%'' .DM,A,A,C,C .Z++A.. .333},---- 2 2""=1111  0 0 9 9 9 ,2244   < < > > >&'' .DM,A,A,C,C .Z++A.. .333},--- 11-@@M    m < < <O 9O 9O 9O 9O 9b  0 0 9 9 9 r(cPtj|j|}|Sr")r/rF _hash_with_idr)r> program_ids r&_train_program_idz%PartialProgramLayer._train_program_ids"\//0BDII r(cLtj|j|Sr")r/rFrr$rCs r&_infer_program_idz%PartialProgramLayer._infer_program_ids|))$*rrs r&rwz#PartialProgramLayer._verify_programs %%l333r(train_runnable_programc N |j}|j}|jD]}|||\}}|j}|j}t tj||}t| j }d} |dkr| j d} dgt|z} t|j 5t|dtt t fdt#j|d5g} |D]^} | jdur"| t+-t-j| d| j} | | _t,jjj|| t| j dt| j |z }tt t;d |dkrt=|t t;d |t t;d |  } | 9t?| j D]\}}|| kr|d z}ndddn #1swxYwY|jD]#}| |||| |||z\}}}$ dddn #1swxYwYd}t|}t tC|| d|}t tC|| |d}t tC|| }t t;d|}t t;d||z}t| j }t,jjj|||d||z}tE||||||g|j #}tI|||g|}||}|j%\}}}}}}|j&\}}}tO||||f|j(|||fd|f||f}|)|S)Nrr>targetszpaddle.static.gradientsTg?) fill_valuern grad_input_c|jduSNFrrOs r&rVz6PartialProgramLayer._append_backward..R Q_-Er(c|jduSrrrs r&rVz6PartialProgramLayer._append_backward..Zrr(c"t| Sr"rrs r&rVz6PartialProgramLayer._append_backward..^smA.>.>*>r()rrrrcLt|tr|n tSr")rHrrrs r&rVz6PartialProgramLayer._append_backward..wsz!U';';"M!!r(c"t| Sr"rrs r&rVz6PartialProgramLayer._append_backward..q!1!11r(c"t| Sr"rrs r&rVz6PartialProgramLayer._append_backward..rr( grad_output_)*r4rrrrrrS itertoolschainrIr~rwrrr rr ir_static program_guardrrJrr/ full_likernrrr0rfilterr rr"rTr`rr9rvr<rqrr)r>rr4rrrrcombined_inputsr forward_end_op grad_info_mapforward_outputs_grads out_valuer%op_between_forward_and_backwardrer{ mapping_value inputs_size x_grad_value p_grad_value o_grad_valueinput_grads_to_appendoutput_grads_to_appendbackward_end_op_indexbackward_start_op_indexfull_graph_pre_process_passforward_index_passrs r&rz$PartialProgramLayer._append_backwards)0(3m O OF%<>??g2244899 Q  $11337;N_!5!55 4= ) )E E  e$)     ($770 &0 &(*%!( <  > 5&& % % %M&1'01E1E1G1G1K'L'L&&GC!^3325' % 4]0 &0 &0 &0 &0 &0 &0 &0 &0 &0 &0 &0 &0 &0 &0 &d-   00#)##&EE  #G sE E E E E E E E E E E E E E E NNM &kk C }Q{]/KLLMM C }[\\/JKKLL C /DEEFF !% 11< @ @! ! "& 11<,3N O O" " !$G$8$8$:$:$> ? ? !77  " !      = = '> VWlL, O M ! ! # #' ' #1 57L M '   %$W-- ( .        *   # !(  VW % " 5 < 6  $&; <    77999s7:K0FJ-! K0-J1 1K04J1 5.K00K47K4c.|j|j|f}||jvr`|jj|jj|j |j|d|jjz}tjj ||j|<tj dd}|j||fS)N)rris_testrrr)rr) rryrr4rrrr/rr construct_program_attribute_maprr)r>r prog_attr_keyrrs r&rz'PartialProgramLayer._prepare_attributess$-E  : : :#'<#?$(L$A#},"o*   ) *J  @@LL  &} 5 !/ 6'(  )-8:JJJr(c|t|ttfsJtj|}g}t j}t|D]\}}t|tj r&d}tj |d|d}nt|tj j r_|jrU|j|s;t#s-t%|s||d}d|_n|}n|||S)z1 Prepare inputs, outputs, attrs. NFT)r% persistableplace zero_copy)rHrrSr/rFrGr _current_expected_placernpndarrayr eagerTensorrr!_equalsrr_copy_torJ)r>rflatten_inputs input_varsexpected_placeir%vars r&rz#PartialProgramLayer._prepare_inputssK&5$-00000--f55 ":<<!.11 # #HAu%,, j'' %(" ( E4:#455 '  !K//??  344  7u==   ..??C(,C%%CC   c " " " "r(c6|||}|gS)Nr)r)r>rr inner_scopes r&rz%PartialProgramLayer._create_scope_vecs)oo&  }r(ct|j|}|t|dkr|d}|S)zZ Restores same nested outputs by only replacing the Variable with Tensor. Nrr)rrrUrI)r>out_varsoutss r&rz PartialProgramLayer._restore_outs;}$$X..  D Q7D r(c.|dS)NT)for_test)r)r>rs r&_clone_for_testz#PartialProgramLayer._clone_for_tests!!4!000r(ct|tjjr1|jdgkr%|dt krdSdS)NrrTF)rHr r&r'shapenumpyr)r>r.s r& _is_no_valuez PartialProgramLayer._is_no_valuesI c4:, - - #)s2B2Byy{{1~!:::tur(ct|tjjr|rdS|St|t t frt|t rt fd|D}nfd|D}t|t|k}t|dkr|rdSt|dkr |r|dS|S|S)zK Removes invalid value for various-length return statement Nc3FK|]}||VdSr"r:rYr.r>s r&r[z7PartialProgramLayer._remove_no_value..sJ43D3DS3I3Ir(c>g|]}||Sr]r=r>s r&r_z8PartialProgramLayer._remove_no_value..s,MMMsd6G6G6L6LMsMMMr(rr)rHr r&r'r:rrSrI)r>r2res has_removeds` r&rz$PartialProgramLayer._remove_no_values h 1 2 2   ** tO 5$- 0 0 (E** N#+NMMMhMMMh--#c((2K3xx1}}}tSQ;1v Jr(rc|j}|j}t||D]\}}t|r|r4|t jjj j j ]| r4|t jjj j j tddS)Nz5only support selected_row and dense_tensor grad type.)rr4rris_selected_row_typerr/rr VarDescVarType SELECTED_ROWSis_dense_tensor_type DENSE_TENSORNotImplementedError)r>rrforward_params_gradsparamr%s r&rz"PartialProgramLayer._set_grad_type"s ->%- (<==  LE5U## ))++ $$K$,4B++-- $$K$,4A*K  r(c t|jttfs%t dt |jdt }t|jD]a\}}t|tj j s#t d|dt |d| |j bdS)a Check all params from main program are already initialized, see details as follows: 1. all parameters in self._params should be type `framework.EagerParamBase` which are created in dygraph. 2. all parameters from transformed program can be found in self._params. Because they share same data with EagerParamBase of original dygraph. zRType of self._params in PartialProgramLayer should be list or tuple, but received .zType of self._params[zG] in PartialProgramLayer should be Parameter or Variable, but received N) rHrtrSr TypeErrortyperrr r&r'addr$)r>rparam_and_buffer_names_setr-r.s r&rz,PartialProgramLayer._check_params_all_inited;s$,u 66 zeijnjvewewzzz &)UU" -- 5 5FAsc4:#455 CACCvz{~vvCCC ' * *38 4 4 4 4  5 5r(c|r|ndSr"r])varss r&rzPartialProgramLayer._valid_varsPs%tt%r(r")rrqrF)rrqrrq)rrq)&rkrlrmrnrr@rrr7rrrrrrrrrrrror4rrr$rwrrrrrr6r:rrrr __classcell__)rs@r&rfrfs*O 5(5(5(5(5(5(5(5(n  \ &888 ^.// 0 00/ 0(   _ &%%%    K!K!K!K!K!Z_DD_D&&&X&**X****_*<<<_<RRRRhKKKK(###J 11162555*&&\&&&&&r(rfc#~Ktj}|t_ dV|t_dS#|t_wxYw)z~ A context manager to temporarily replace the run_impl of PartialProgramLayer. This is used for testing purposes. N)rfr) new_run_impl old_run_impls r&replace_run_impl_guardrYUsK '6L*6'; .:+++l+::::s.<Fconcrete_programr from_methodboolrc|j}|r |r |dd}t|j||j|jfd|ji|jS)Nrrg)rrfrrrrgru)rZr[rs r&partial_program_fromr^csp $F+ % #    %0    !   r(rT)rZr r[r\rrf)A __future__rr contextlibr functoolsrtypingrr9r$r/paddle.pir.corer0r rrpaddle.autograd.backward_utilsrpaddle.autograd.ir_backwardr paddle.baser paddle.base.compilerr paddle.base.data_feederr paddle.base.dygraph.baser paddle.pirrrrrprofilerr logging_utilsrrFrrrrrrrrrprogram_translatorr __all__rr#r'r6r8rqrr'r9rDr`rfrYr^r]r(r&ros#"""""%%%%%%%%%%%%  #########444444,,,,,,''''''''............;;;;;;LLLLLLLLLLLL%%%%%%++++++                      4333333   &%'' @$@$@$@$@$@$@$@$Fj4j4j4j4j4j4j4j4Z &$$$$$$$$N         OOOOOOOOd     /   l &l &l &l &l &l &l &l &^ ; ; ;