Αi2SSKJr SSKJrJrJrJr SSKrSSKJ r SSK J r \(aSSK J r SSKJr SSKJr SS KJr /r"S S 5r"S S \5rg)) annotations) TYPE_CHECKINGAnyClassVaroverloadN) check_type)WeightDecayRegularizer)Sequence)Tensor) ParamAttrLike) Initializerc0\rSrSr%SrS\S'S\S'S\S'S \S 'S \S 'S \S 'S \S'SSSjjrSSjrSSjrSSjr \ \ SSj55r \ \ SSj55r \ \ S Sj55r \ S5r S!S"Sjjr Srg)# ParamAttr!a Note: ``gradient_clip`` of ``ParamAttr`` HAS BEEN DEPRECATED since 2.0. Please use ``need_clip`` in ``ParamAttr`` to specify the clip scope. There are three clipping strategies: :ref:`api_paddle_nn_ClipGradByGlobalNorm` , :ref:`api_paddle_nn_ClipGradByNorm` , :ref:`api_paddle_nn_ClipGradByValue` . Create a object to represent the attribute of parameter. The attributes are: name, initializer, learning rate, regularizer, trainable, gradient clip, and model average. Parameters: name (str, optional): The parameter's name. Default None, meaning that the name would be created automatically. initializer (Initializer, optional): The method to initial this parameter. Default None, meaning that the weight parameter is initialized by Xavier initializer, and the bias parameter is initialized by 0. learning_rate (float, optional): The parameter's learning rate. The learning rate when optimize is the global learning rates times the parameter's learning rate times the factor of learning rate scheduler. Default 1.0. regularizer (WeightDecayRegularizer, optional): Regularization strategy. There are two method: :ref:`api_paddle_regularizer_L1Decay` , :ref:`api_paddle_regularizer_L2Decay` . If regularizer is also set in ``optimizer`` (such as :ref:`api_paddle_optimizer_SGD` ), that regularizer setting in optimizer will be ignored. Default None, meaning there is no regularization. trainable (bool, optional): Whether this parameter is trainable. Default True. do_model_average (bool, optional): Whether this parameter should do model average when model average is enabled. Only used in ExponentialMovingAverage. Default True. need_clip (bool, optional): Whether the parameter gradient need to be clipped in optimizer. Default is True. Returns: ParamAttr Object. Examples: .. code-block:: python >>> import paddle >>> weight_attr = paddle.ParamAttr( ... name="weight", ... learning_rate=0.5, ... regularizer=paddle.regularizer.L2Decay(1.0), ... trainable=True, ... ) >>> print(weight_attr.name) weight >>> paddle.nn.Linear(3, 4, weight_attr=weight_attr) str | NonenameInitializer | None initializerfloat learning_rateWeightDecayRegularizer | None regularizerbool trainabledo_model_average need_clipNc[US[[S54S5 [US[[4S5 [US[ S5 [US[ S5 [US[ S5 [US[ RRR[S54S5 [US[[S54S5 Xl URS :Xa [S 5eX lX0l X@lXPlX`lXplg) Nrrrrrrrrz&name of ParamAttr can not be empty str)rstrtyperintrpaddlennrr r r ValueErrorrrrrr)selfrrrrrrrs V/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/paddle/base/param_attr.py__init__ParamAttr.__init__]s 4#tDz!2K@=/E3<M9k4=#%7{K9k4=   YY " " . .T ;      #T$Z 0    99?EF F&*&" 0"cdUcURc [S5egURbgXlg)z Set the default initializer, the initializer should be Constant, Uniform, Normal, Xavier, MSRA. Args: initializer(Initializer): the initializer to set. Returns: None Nz ParamAttr.initializer is not set)rr$)r%rs r&_set_default_initializer"ParamAttr._set_default_initializers:  ' !CDD     ' &r)crUR[RRR 55 g)za Set the default initializer for the parameter with Xavier. Args: None. Returns: None. N)r+r"r#r XavierUniformr%s r&_set_default_param_initializer(ParamAttr._set_default_param_initializers% %%fii&;&;&I&I&KLr)ctUR[RRR S55 g)zc Set the default initializer for the bias with Constant(0.0). Args: None. Returns: None. gN)r+r"r#rConstantr/s r&_set_default_bias_initializer'ParamAttr._set_default_bias_initializers' %%fii&;&;&D&DS&IJr)cgNargs r&_to_attrParamAttr._to_attrs*-r)cgr7r8r9s r&r;r<s36r)cgr7r8r9s r&r;r<sCFr)cZUc [5$[U[[45(a&UVs/sHn[R U5PM sn$[U[5(aU$[U[ 5(a [US9$[U[ RRR5(a [US9$[U[5(a [US9$[U[5(aU(a[R S5$S$[[U5S35es snf)aO Create ParamAttr[s]. Args: arg: Arguments to initialize ParamAttr[s]. arg's type can be str, Initializer, float, WeightDecayRegularizer, BaseGradientClipAttr, bool, ParamAttr, or a list of above type. Returns: ParamAttr[s]: ParamAttr[s] initialized with arg. Raises: arg can not initialize a ParamAttr. N)r)r)rFz cast to ParamAttr)r isinstancelisttupler;rr"r#rr r r TypeErrorr )r:as r&r;r<s ;;  dE] + +3673aI&&q)37 7 Y ' 'J S ! !#& & VYY22>> ? ?- - 3 4 4- - T " "/29%%d+ = =tCyk);<= =8sD(cURSUR0URURURUR S.nU(aUR US'U$)z Returns the attributes of this parameter. Args: with_initializer(bool): Whether to add initializer attr. Returns: Parameter attributes(map): The attributes of this parameter. r)r optimize_attrrrrrr)rrrrrrr)r%with_initializerkwargss r& _to_kwargsParamAttr._to_kwargssZII-t/A/AB++ $ 5 5   $($4$4F= ! r))rrrrrrr)NN?NTTT)rrrrrrrrrrrrrrreturnNone)rrrLrM)rLrM)r:rMrLr)r:r rLr)r:zSequence[ParamAttrLike]rLzlist[ParamAttr])F)rGrrLzdict[str, Any])__name__ __module__ __qualname____firstlineno____doc____annotations__r'r+r0r4r staticmethodr;rI__static_attributes__r8r)r&rr!s1f ##..OO *."59!%%#%#(%# %# 3 %#  %#%#%# %#N'* M K-- 66 FF>>@r)rc^\rSrSr%Sr/rS\S'S\S'S S U4SjjjrSrU=r $) WeightNormParamAttra Note: Please use 'paddle.nn.utils.weight_norm' in dygraph mode. Note: ``gradient_clip`` of ``ParamAttr`` HAS BEEN DEPRECATED since 2.0. Please use ``need_clip`` in ``ParamAttr`` to specify the clip scope. There are three clipping strategies: :ref:`api_paddle_nn_ClipGradByGlobalNorm` , :ref:`api_paddle_nn_ClipGradByNorm` , :ref:`api_paddle_nn_ClipGradByValue` . Parameter of weight Norm. Weight Norm is a reparameterization of the weight vectors in a neural network that decouples the magnitude of those weight vectors from their direction. Weight Norm has been implemented as discussed in this paper: `Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks `_. Args: dim(int, optional): Dimension over which to compute the norm. Dim is a non-negative number which is less than the rank of weight Tensor. For Example, dim can be chosen from 0, 1, 2, 3 for convolution whose weight shape is [cout, cin, kh, kw] and rank is 4. Default None, meaning that all elements will be normalized. name(str, optional): The parameter's name. Default None, meaning that the name would be created automatically. Please refer to :ref:`api_guide_Name` for more details. initializer(Initializer, optional): The method to initialize this parameter, such as ``initializer = paddle.nn.initializer.Constant(1.0)``. Default None, meaning that the weight parameter is initialized by Xavier initializer, and the bias parameter is initialized by 0. learning_rate(float32, optional): The parameter's learning rate when optimizer is :math:`global\_lr * parameter\_lr * scheduler\_factor`. Default 1.0. regularizer (WeightDecayRegularizer, optional): Regularization strategy. There are two method: :ref:`api_paddle_regularizer_L1Decay` , :ref:`api_paddle_regularizer_L2Decay`. If regularizer is also set in ``optimizer`` (such as :ref:`api_paddle_optimizer_SGD` ), that regularizer setting in optimizer will be ignored. Default None, meaning there is no regularization. trainable(bool, optional): Whether this parameter is trainable. Default True. do_model_average(bool, optional): Whether this parameter should do model average. Default False. need_clip (bool, optional): Whether the parameter gradient need to be clipped in optimizer. Default is True. Examples: .. code-block:: python >>> import paddle >>> paddle.enable_static() >>> data = paddle.static.data(name="data", shape=[3, 32, 32], dtype="float32") >>> fc = paddle.static.nn.fc( ... x=data, ... size=1000, ... weight_attr=paddle.static.WeightNormParamAttr( ... dim=None, ... name='weight_norm_param', ... initializer=paddle.nn.initializer.Constant(1.0), ... learning_rate=1.0, ... regularizer=paddle.regularizer.L2Decay(0.1), ... trainable=True, ... do_model_average=False, ... need_clip=True, ... ), ... ) zClassVar[list[Tensor]]params_with_weight_norm int | Nonedimc 8>[T U]UUUUUUUS9 Xlg)N)rrrrrrr)superr'r[) r%r[rrrrrrr __class__s r&r'WeightNormParamAttr.__init__Cs3 #'#-  r))r[)NNNrKNTFT)r[rZrrrrrrrrrrrrrrrLrM) rNrOrPrQrRrYrSr'rU __classcell__)r^s@r&rWrWsCR7938 O*."59!& (    3  r)rW) __future__rtypingrrrrr"paddle.base.data_feederrpaddle.regularizerr collections.abcr r paddle._typingr paddle.nn.initializerr __all__rrWr8r)r&risJ#99 .5(,1 QQhb)br)