§ x-j ãóˆ—ddlmZddlmZddlmZddlmZddlm Z erddlm Z edd d d ¬ ¦« ddd„¦«Z d S)é)Ú annotations)Ú TYPE_CHECKING)Ú_C_ops)Ú deprecatedé)Úin_dynamic_or_pir_mode)ÚTensorz3.3.0zpaddle.nn.functional.swigluézopaddle.incubate.nn.functional.swiglu will be removed in future. Please use paddle.nn.functional.swiglu instead.)ÚsinceÚ update_toÚlevelÚreasonNÚxr Úyú Tensor | NoneÚnameú str | NoneÚreturncóL—t¦«rtj||¦«SdS)a? This function performs SwiGLU activation to the input Tensor. .. math:: out = silu(x) * y when y is not None out = silu(xs[0]) * xs[1] when y is None, where xs = paddle.chunk(x, 2, axis=-1) Args: x (Tensor): The first input Tensor of SwiGLU. y (Tensor, optional): The second input Tensor of SwiGLU. Default: None. name (str, optional): For details, please refer to :ref:`api_guide_Name`. Generally, no setting is required. Default: None. Returns: A Tensor with the same data type with x and y. Examples: .. code-block:: python >>> import paddle >>> import paddle.incubate.nn.functional as F >>> x = paddle.to_tensor([1, 2], dtype='float32') >>> out1, out2 = F.swiglu(x), F.swiglu(x, x) >>> print(out1, out2) Tensor(shape=[1], dtype=float32, place=Place(cpu), stop_gradient=True, [1.46211720]) Tensor(shape=[2], dtype=float32, place=Place(cpu), stop_gradient=True, [0.73105860, 3.52318811]) N)rrÚswiglu)rrrs úd/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/incubate/nn/functional/swiglu.pyrrs/€õJÑÔð#ÝŒ}˜Q Ñ"Ô"Ð"ð#ð#ó)NN)rr rrrrrr ) Ú __future__rÚtypingrÚpaddlerÚ paddle.utilsrÚ frameworkrr r©rrúrsÐðð#Ð"Ð"Ð"Ð"Ð"à Ð Ð Ð Ð Ð àÐÐÐÐÐØ#Ð#Ð#Ð#Ð#Ð#à0Ð0Ð0Ð0Ð0Ð0àðØÐÐÐÐÐð €Ø Ø+Ø Ø |ð ñôð<@ð #ð #ð #ð #ñ ôð #ð #ð #r