v-jdZddlmZddlZddlmZddlZddlZddlm Z m Z ddl m Z m Z mZmZmZmZmZddlmZmZddlmZmZerdd lmZgZGd d ZdS) ) annotationsN) TYPE_CHECKING)core unique_name)Variable_current_expected_placedefault_main_programdefault_startup_programin_dygraph_modein_dynamic_or_pir_mode in_pir_mode)_global_bias_initializer_global_weight_initializer) ParamAttrWeightNormParamAttr) _DTypeLiteralc"eZdZUdZded<dZedZedZedZ edZ e d Z e d Z dd Zd Zd dd dejjjd fdZ dddZ ddZ ddZdZddZdZdZd S)LayerHelperBasefloat32r_LayerHelperBase__dtypec"||_||_dSN) _layer_type_name)selfname layer_types ]/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/base/layer_helper_base.py__init__zLayerHelperBase.__init__.s% c|jSr)rrs rrzLayerHelperBase.name2s zr!c|jSr)rr#s rrzLayerHelperBase.layer_type6s r!ctSr)r r#s r main_programzLayerHelperBase.main_program:s#%%%r!ctSr)r r#s rstartup_programzLayerHelperBase.startup_program>s&(((r!c||_dSrr)clsdtypes rset_default_dtypez!LayerHelperBase.set_default_dtypeBs  r!c|jSrr*)r+s rget_default_dtypez!LayerHelperBase.get_default_dtypeFs {r!NcLt|tjr4tj|t dd|r|nddSt|ttjjtj j fr|Stdt|)a The API will create a ``Variable`` object from numpy\.ndarray or Variable object. Parameters: value(ndarray): The numpy\.ndarray object that needs to be converted, it can be multi-dimension, and the data type is one of numpy\.{float16, float32, float64, int16, int32, int64, uint8, uint16}. name(str, optional): The default value is None. Normally there is no need for user to set this property. For more information, please refer to :ref:`api_guide_Name` Returns: Variable: ``Tensor`` created from the specified numpy\.ndarray object, data type and shape is the same as ``value`` . Examples: .. code-block:: python >>> import numpy as np >>> import paddle.base as base >>> with base.dygraph.guard(): ... x = np.ones([2, 2], np.float32) ... y = base.dygraph.to_variable(x) ... FNTz[The type of input value is invalid, expected type is 'ndarray' or 'Variable', but received ) isinstancenpndarrayreagerTensorr rpaddlepirValue TypeErrortype)rvaluers r to_variablezLayerHelperBase.to_variableJs. eRZ ( ( :$$'))&$  $**;VZ=MN O O L{nrsxnyny{{ r!c ddddjffd djffd djffd ddjf fd fd}tj|}|jdz|_d gt |z}|j||j||j<tj|}|jd z|_|}jjd|d |d } jjd|d |d }  | | |jj| || jj jd|d |} j jd|d |} || | |j} | S)NFc |O| jjd jdg d}| jjd jdg d}|dd|id|i | jjd jd g d}|d d|id|id t|i | jjd jdg d}|dd|id|i|||dndd |d d|id|id d|z i |S)N.weight_norm_normFrr, persistableweight_norm_absabsXOut)r:inputsoutputsweight_norm_powpowfactorr:rHrIattrsweight_norm_sum reduce_sumT)dimkeep_dim reduce_allg?) create_varr&_name_generatorgenerate_with_ignorable_keyjoinr append_opfloat) xoutprQrRblockabs_outpow_outsum_outr,rs r __norm_opz;LayerHelperBase._create_weight_normalize..__norm_optsM{&&*:VV$)-?!@AA % '&&&6RRHHdi):;<<! 'G OOC8eW5E    &&&6RRHHdi):;<<! 'G OOW~(q*     &&&6RRHHdi):;<<! 'G OO!W~( (*-+$$5     OOW~ q)     Jr!c"|O|jjdjdgd}|d|j}|dd|id |i||d  |S) Nr@weight_norm_reshapeFrBXshape)rr,reshape2rFshape)rGXShape)r:rHrNrI)rTr&rUrVrWrr,rX)rZrfr[r]x_shaper,rs r __reshape_opz>LayerHelperBase._create_weight_normalize..__reshape_ops{&&*:VV$)-B!CDD % '&&HAG&DDG OOQx& #w77     Jr!c|O|jjdjdgd}|dd|id|id|i |S) Nr@weight_norm_transposeFrB transposerFrGaxisrM)rTr&rUrVrWrrX)rZrmr[r]r,rs r__transpose_opz@LayerHelperBase._create_weight_normalize..__transpose_ops{&&*:VV$)-D!EFF % ' OO Qx tn     Jr!c|O|jjdjdg d}| ||||n|dkre|jdgdgt|jdz zz} ||jdd g| } |dg|} |||| n7|t|jdz krddgt|jdz z|jd gz} |d |jd g| } |dg|} |||| nttt|j}|dc|d<||< ||| }|jdgdgt|jdz zz} ||jdd g| } |dg|} ||| }  | ||| |S)z0Computes the norm over all dimensions except dimNr@rAFrBrQr]rr)rfr])r[rfr])r]r[r]) rTr&rUrVrWrrflenlistrange)rZr[rQr] out_shapereshapenormpermrlre_LayerHelperBase__norm_op_LayerHelperBase__reshape_op_LayerHelperBase__transpose_opr,rs r__norm_except_dimzCLayerHelperBase._create_weight_normalize..__norm_except_dims{&&*:VV$)-?!@AA % '{ !Sc77777WQZLA3#ag,,2B+CC &,qR0@NNN yqc??? Ts)5IIIIIAG q(((C3qw<.__weight_normalizes$$s$"3"A"A"C"CDMtE  "66{E% ~FFF;RRC7AHr!_gr_vr,rfwith_initializerT)rZr[rQr]rr)rQ) r( global_blockcopydeepcopyrrsrQcreate_parameter _to_kwargsr&)rattrrfr,"_LayerHelperBase__weight_normalize g_param_attr g_param_shape v_param_attr v_param_shapeg_paramv_paramw_paramrrzr{r|s` ` @@@@r_create_weight_normalizez(LayerHelperBase._create_weight_normalizeqsY &3355 > > > > > > > Bd&:&G&G&I&I       *T%9%F%F%H%H       (T)=)J)J)L)L% % % % % % % % % % N      0}T**  I, c%jj( 8 &+DHoM$( #}T**  I,  G$&3355F   %%u%==   G$&3355F   %%t%<<   &3355        &3355     D$#0022C }  0<0G0G0I0I  D$#0022C }  0<0G0G0I0I  %$Wg48DDDr!Fc tj|}tj|}|sdSt |tsJt |D]\} } | dksJd| d| |s|j}t |tjrtj jj |}|r!d} ttn|}n d} ttn|}|jtr4t!jd|j| g|_n>|jjd|j| g|_||jt |tjjr|tjjjkrw|tjjjkr]|tjjjkrC|tjjjkr)|tjjjkrt;dn|d vrt;d |r|n*|n| |t |tBr8|"|||} tBj#$| | StKrt!j&|j} | rtOd |jd |j(j)d||||d |*d} || +|} | StYrt |tjjrtj jj-|}tj jj)d||d|*d} || +|} | S|j.(j)d|||d|*d|j(j)d|||d|*S)aCreate parameters for this layers. Args: attr: [ParamAttr] should be the parameter attribute for this parameter shape: shape of the parameter dtype: data type of this parameter is_bias: if this is a bias parameter default_initializer: set the default initializer for this parameter device: device where this parameter will be placed Returns created parameter Variable. NrzOExpected every dim's size to be larger than or equal to 0, but the size of the z -th dim is brr@zCan not create parameter with default initializer when dtype is not ['float16', 'float32', 'float64', 'bfloat16'] type. Set default_initializer to fit the parameter dtype!)float16rfloat64bfloat16rYint8zCan not create parameter with default initializer when dtype is not ['float16', 'float32', 'float64', 'bfloat16', 'float'] type. Set default_initializer to fit the parameter dtype!zparameter name [z] have be been used. In dygraph mode, the name of parameter can't be same.Please check the parameter attr value passed to self.create_parameter or constructor of dygraph Layers)r,rfr: stop_gradientTrr)r,rfr:r)/rrr_to_attrr1 enumeraterrDataTyper6r7datatype_to_vartyperrrr rgeneraterWr&rU initializerVarDescVarTypeFP32FP64FP16BF16INT8r9_set_default_bias_initializer_set_default_param_initializer_set_default_initializerrrparams_with_weight_normappendr dygraph_parameter_name_checker ValueErrorrrrtorvartype_to_datatyper()rrrfr,is_biasdefault_initializerrr:deviceisizesuffixparamis_useds rrz LayerHelperBase.create_parameterNs0}T""!$'' 4$ ***** ''  GAt1999<'(<<59<<999  !LE eT] + + ?JO7>E  F,--9)***(  F.//;+,,,( 9 %'' '049f:M1N1NOO  -=FFHHdi011   &4+;+C%!566 T\1666!5!:::!5!:::!5!:::!5!:::#F!$O 6224444335555  ) )*= > > > d/ 0 0 11$uEEE  7 > >u E E EL   * "@KKG  4ty444 FD%2244E+  //4/88 E!((L}} eT\%9::G"JO?FE 8ooto<< %!HHV,,E @D - - / / @   //4/88     E4$1133D5t7;7H7H r!return paddle.Tensorc|s|j}|j|jjd|jdg||tj j j d|S)aICreate a temporary variable that should be type inferred layer. Note: The default type will be set to DENSE_TENSOR. However, when the var is used as operator output, its type will be updated based on operator's `VarTypeInference` implementation in infer_var_type. r@tmpFrr,rfr:rCr) rr&rrTrUrVrWrrrr DENSE_TENSORrr,rrfs r"create_variable_for_type_inferencez2LayerHelperBase.create_variable_for_type_inferences !LE ..00;;"2NN$)U+,,%2'<   r!c|s|j}|j|jjd|jdg||tj j j d|}|jj }d|j_ tjj|j|dd|||_||j_ |S)aFCreate a global variable that should be type inferred layer. Note: The default type will be set to DENSE_TENSOR. However, when the var is used as operator output, its type will be updated based on operator's `VarTypeInference` implementation in infer_var_type. r@rFrrg) force_cpur[)rr&rrTrUrVrWrrrrrcurrent_block_idxr6rcreation fill_constantrfr)rr,rrfoutputsaved_block_ids r*_create_global_variable_for_type_inferencez:LayerHelperBase._create_global_variable_for_type_inferences !LE"//11<<"2NN$)U+,,%2'=   *<./+ ,, L%6 -    -.<+ r!c|s|j}|j|jjd|jdg||tj j j d|S)aNCreate a temporary sparse variable that should be type inferred layer. Note: The default type will be set to SPARSE_COO. However, when the var is used as operator output, its type will be updated based on operator's `VarTypeInference` implementation in infer_var_type. r@rFr) rr&rrTrUrVrWrrrr SPARSE_COOrs r)create_sparse_variable_for_type_inferencez9LayerHelperBase.create_sparse_variable_for_type_inferences !LE ..00;;"2NN$)U+,,%0'<   r!cJ|jj|i|S)zKCreate Variable for this layers. Returns created Variable. )r&rrT)rargskwargss rcreate_variablezLayerHelperBase.create_variable/s+ > > > >  - - / / : :XXii ' ;     r!r)FN)rr)F)__name__ __module__ __qualname__r__annotations__r propertyrrr&r( classmethodr-r/r<rrrrrrrrrrrrrrr!rrr*s&G&&&&X  X &&X&))X)[[%%%%NZZZB  \ ! .LLLL^15     415D15    2MMM     QQQr!r) __future__rrtypingrnumpyr2r6rr frameworkrr r r r r rrrr param_attrrrpaddle._typing.dtype_liker__all__rrr!rrsI#"""""  NMMMMMMM666666668777777 uuuuuuuuuur!