ёi SSKJr SSKJr SSKJr SSKrSSKJr \(aSSK J r "SS\5r \ RS \ R\RR5R!S S 5\ R"\RR5R!S S 50q\ R\ R"\ R/qS rSSjrSrSSjrSrSSSjjrSSSjjr\SSSjj5rg)) annotations)IntEnum) TYPE_CHECKINGN)signature_safe_contextmanager)Iterablec(\rSrSrSrSrSrSrSrSr g) SDPBackenda An enum-like class that contains the different backends for scaled dot product attention. This backend class is designed to be used with the sdpa_kernel context manager. The following Enums are available: - ERROR: An error occurred when trying to determine the backend. - MATH: The math backend for scaled dot product attention. - FLASH_ATTENTION: The flash attention backend for scaled dot product attention. - EFFICIENT_ATTENTION: The efficient attention backend for scaled dot product attention. See :func:`paddle.nn.attention.sdpa_kernel` for more details. .. warning:: This class is in beta and subject to change. rN) __name__ __module__ __qualname____firstlineno____doc__ERRORMATHFLASH_ATTENTIONEFFICIENT_ATTENTION__static_attributes__rX/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/paddle/nn/attention/sdpa.pyr r s  E DOrr TFLAGS_flash_attn_availableF"FLAGS_mem_efficient_attn_availablecr[R5VVs/sHupU(dMUPM snn$s snnfN)_backend_enableditems)backendenableds r_get_enabled_backendsr#As*,<,B,B,D P,D(G,D PP Ps 33cl[H nS[U'M UHnU[;dMS[U'M g)NFT)rbackendsr!s r_set_enabled_backendsr'Fs5#$)!$ & &(, W %rc*[R5$r)_current_prioritycopyrrr_get_backend_priorityr+Os  ! ! ##rc$UR5qgr)r*r))prioritys r_set_backend_priorityr.Ts rc$[U[5(aU/n[U[[45(d [ S5eUH/n[U[5(aM[ S[ U535e [[ RU55$)NzLbackends must be an instance of SDPBackend or a list of SDPBackend instancesz/All backends must be SDPBackend instances, got ) isinstancer listtuple TypeErrortypedictfromkeysr%s r_validate_backendsr7Ys(J'': hu . . Z  ':..A$w-Q   h' ((rcZ^[5nU(a[5m[UU4SjS9nU$)NcH>UT;aTRU5$[S5$)Ninf)indexfloat)r! curr_prioritys r+_cur_sdpa_kernel_backends..rs,-'!. 3 3G <!u!r)key)r#r+sorted) with_priorityr&r=s @r_cur_sdpa_kernel_backendsrCks/$&H-/    Orc[[U55 U(aB[U5n[5nUHnXB;dM URU5 M [ U5 ggr)r'r1r+appendr.)r& set_priority user_priorityprevious_priorityr!s r _sdpa_kernelrIzsP$x.)X 13(G+$$W-) m,rc## [U[[45(dS5e[U5nU(d [ S5e[ US9n[ X5 0v [ X!5 g![ X!5 f=f7f)a Context manager to select which backend to use for scaled dot product attention. .. warning:: This function is beta and subject to change. Args: backends (Union[list[SDPBackend], SDPBackend]): A backend or list of backends for scaled dot product attention. set_priority (bool, optional): Whether the ordering of the backends is interpreted as their priority order. Default: False. Example: >>> import paddle >>> from paddle.nn.functional import scaled_dot_product_attention >>> from paddle.nn.attention import SDPBackend, sdpa_kernel >>> # Create dummy tensors >>> query = paddle.rand(shape=[2, 4, 8, 16]) >>> key = paddle.rand(shape=[2, 4, 8, 16]) >>> value = paddle.rand(shape=[2, 4, 8, 16]) >>> # Example 1: Only enable math backend >>> with sdpa_kernel(SDPBackend.MATH): ... out = scaled_dot_product_attention(query, key, value) >>> print(out.shape) [2, 4, 8, 16] >>> # Example 2: Enable multiple backends >>> with sdpa_kernel([SDPBackend.MATH, SDPBackend.EFFICIENT_ATTENTION]): ... out = scaled_dot_product_attention(query, key, value) >>> print(out.shape) [2, 4, 8, 16] >>> # Example 3: Set priority order for multiple backends >>> with sdpa_kernel( ... [SDPBackend.MATH, SDPBackend.EFFICIENT_ATTENTION], ... set_priority=True, ... ): ... out = scaled_dot_product_attention(query, key, value) >>> print(out.shape) [2, 4, 8, 16] >>> # doctest: +SKIP('FlashAttention may not be available in all environments') >>> # Example 4: Flash attention (skipped due to environment requirements) >>> with sdpa_kernel(SDPBackend.FLASH_ATTENTION): ... out = scaled_dot_product_attention(query, key, value) >>> # doctest: -SKIP This context manager can be used to select which backend to use for scaled dot product attention. Upon exiting the context manager, the previous state of the flags will be restored. zKBackend must be an instance of SDPBackend or a list of SDPBackend instancesz&At least one backend must be specified)rBN)r0r1r r7 ValueErrorrCrI)r&rFprevious_backendss r sdpa_kernelrMsvh hz 2 3 3U 3"(+H ABB1 M6X, &5 &5sA A7 A' A7' A44A7)r&list[SDPBackend])r-rN)F)rBbool)r&zIterable[SDPBackend]rFrO)r&zlist[SDPBackend] | SDPBackendrFrO) __future__renumrtypingrpaddlepaddle.base.wrapped_decoratorrcollections.abcrr rr framework _global_flagsgetrrr)r#r'r+r.r7rCrIrMrrrrYs# G(.OOT 0 0 > > @ D D$e!""F$4$4$B$B$D$H$H,e% ""OOQ -$ ( )$  -BGB6+B6;?B6B6r