x-j^ddlmZddlmZddlmZddlmZddlm Z erddlm Z  dddZ dS)) annotations) TYPE_CHECKING)_C_ops)in_dynamic_or_pir_mode) LayerHelper)TensorNxrcombine_weights scatter_indexname str | NonereturncJtrA|j|j|jtj|||Stj|||St dit }||j}|||d}| d|d|i|S)z Args: x: Input tensor [seq, dim] combine_weights: Combination weights [s, k] scatter_index: Scatter indices [k, s] dtype=int32 Returns: Output Combined output [s, dim] N moe_combine)dtype)r r r y)typeinputsoutputs)r) r process_meshrmoe_combine_autorrlocals"create_variable_for_type_inferencer append_op)r r r r helperrrs i/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/incubate/nn/functional/moe_combine.pyrrsE N ",4*2*1o}MM M!!_mDDD  3 3&(( 3 3F111@@A *&F  -aIII H)N) r rr rr rr r rr) __future__rtypingrpaddlerpaddle.base.frameworkrpaddle.base.layer_helperrrrrrr$s#""""" 988888000000        r