|-j-dZddlmZddlZddlmZddlmZddlZddl m Z dd l m Z e j eZd d d d ZedGddZejd+dZejjd,d%Zd-d*ZdS).zSonicMoE integration: fused MoE using CuteDSL kernels from `kernels-community/sonic-moe`. Provides `sonicmoe_experts_forward` registered as "sonicmoe" in the ExpertsInterface. Requirements: CUDA, `kernels`, `nvidia-cutlass-dsl`, has_gate=True. ) annotationsN)Callable) dataclass)logging)lazy_load_kernelswiglugeglureglu)silugelureluT)frozenc(eZdZUdZded<ded<dS)SonicMoEzAEntry points exposed by the `kernels-community/sonic-moe` kernel.typeactivation_type_enumrmoe_general_routing_inputsN)__name__ __module__ __qualname____doc____annotations__b/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/transformers/integrations/sonicmoe.pyrr's0KK((((((rrreturnctjstdtjd}|dkrtd|dt d}|tdt t |d dd d}t |d d}d d |fd |ffD}|r&tdd|dt||S)z Load sonic-moe once and return its entry points. Raises `ImportError` if CUDA/hardware requirements are not met, or if the kernel or required symbols are not found. zdsonic-moe kernel requires CUDA, but CUDA is not available. Use a different `experts_implementation`.r z`sonic-moe requires a Hopper (SM90+) or newer GPU, but the current device has compute capability z-.x. Use a different `experts_implementation`.z sonic-moeNu}Failed to load the sonic-moe kernel — check that `kernels-community/sonic-moe` has a build matching the current torch/CUDA.enumsActivationTypercg|] \}}|| S)Nr).0nameattrs r z)_load_sonicmoe_kernel..Os- D$ < <r?r@rArBrCrBrr4) rPrQr3r4rRr4rSr4rr4)r __future__r functoolscollections.abcr dataclassesrr(utilsr hub_kernelsr get_loggerrloggerrHrcacher2_dynamoallow_in_graphrOrtrrrrsO #"""""$$$$$$!!!!!! ))))))  H % %Wg > > $)))))))) 0000f++++\======r