IЦi(SSKrSSKrSSKrSSKrSSKrSSKrSSKJrJrJ r J r J r J r J r Jr SSKJr SSKrSSKJrJr SSKJrJr SSKJrJr SSKJrJr SS KJrJ r J!r!J"r" SS K#J$r$J%r%J&r&J'r'J(r(J)r)J*r* S S K+J,r,J-r-J.r. S S K/J0r0 SSK1J2r2 \ (aSSK4J5r5 SSK6J7r7J8r8 \"S\S9r9S:S;Sjjr:S;Sjr;S\ \<\.44Sjr=Sr>"SS\.5r?"SS\?5r@"SS\@5rA"SS\A5rB"S S!\@5rCS;S"jrD"S#S$\?5rE"S%S&\.5rF"S'S(\.5rGS)rHS;S*jrI"S+S,\@5rJ"S-S.\.5rK"S/S0\.5rLSS1K6JMrMJNrN "S2S3\N5rO\O"5rP"S4S5\.5rQ"S6S7\.5rR"S8S9\.5rSg!\3a Sr2GNf=f)<N)AnyCallableDictListOptionalTuple TYPE_CHECKINGTypeVar)Never) polyfills variables)create_call_function create_rot_n) unimplemented Unsupported) GuardBuilder install_guard) AttrSourceConstantSourceDefaultsSource GetItemSource)check_constant_argscheck_unspec_or_constant_argsidentity is_functionis_wrapper_or_member_descriptoristype make_cell)typestrValueMutationNewVariableTrackerConstantVariable)_fsdp_param_group)InstructionTranslator)TritonGridTypeTritonKernelType_F)boundc[U[5(aU$U(d[R"X5$[RR X5$N) isinstancer#buildrLazyVariableTrackercreate)txvalsources `/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/torch/_dynamo/variables/functions.pywrap_bound_argr61sA#'' $$R--,,33C@@c[UR55H/up#[U[[45(dM"[ X5X'M1 gr-)listitemsr.tupledictr6)r2resultkvs r5wrap_args_kwargsr@=s6V\\^$ a% ' '&r-FI%r7r=cURRnURH<nUR5nXA;a UR XQR U55 XQU'M> g)z Update `result` to add mapping from local name to new cells created directly by `code`, or update SideEffects in `parent` if the a local cell is already in `result` (cell argument). N)output side_effects co_cellvarstrack_cell_new store_cellpop)parentr=coderCnamenew_cells r5 init_cellvarsrLDsV ==--L  ..0 >  # #Hjj.> ?t !r7cSSKJn U"XX#U5nXXl[U[5(aSSKJn [U "U55nUb[U[5(deXhlU$)Nr) FunctionTypepairwise) typesrN__kwdefaults__r.r; itertoolsrPr<__annotations__) rI f_globalsrJdefaultsclosure kwdefaults annotationsrNfuncrPs r5_create_nested_fnr[Us_#  AD$+u%%&8K01   *[$"?"?? ?& Kr7c\\rSrSrSrSrSSjrSSS\S\4S jr S r S r S r g )BaseUserFunctionVariableic6UR5R$r-)get_code co_filenameselfs r5 get_filename%BaseUserFunctionVariable.get_filenamejs}}***r7c6UR5R$r-)r`co_namerbs r5get_name!BaseUserFunctionVariable.get_namems}}&&&r7r2r'returncLURU/UR5QUQU5$r-)inline_user_function_return self_argsrcr2argskwargss r5 call_function&BaseUserFunctionVariable.call_functionps, --d4Ndnn6F4N4NPVWWr7rJcSn[UR5U5n[ R RU5$![a US:Xa[U[5(aSnNHf=f)NF__name__T)hasattr get_functionNotImplementedErrorr.NestedUserFunctionVariablerr%r1rcr2rJr=s r5 call_hasattr%BaseUserFunctionVariable.call_hasattrxsf T..0$7F))0088# z!j7Q&R&R s='A'&A'cp[[R"UR55R5$r-)r9inspect signaturerv parametersrbs r5inspect_parameter_names0BaseUserFunctionVariable.inspect_parameter_namess'G%%d&7&7&9:EEFFr7c0$r-)rcr2s r5 closure_vars%BaseUserFunctionVariable.closure_vars r7rNr2r'roList[VariableTracker]rpDict[str, VariableTracker]rjr#) rt __module__ __qualname____firstlineno__rdrhrqstrr#rzrr__static_attributes__rr7r5r]r]isb+'X #X&X- X  X969c9o9Gr7r]c^\rSrSrSrSS1\R kr\S5rSSU4Sjjjr U4Sjr S r S r S r S rS rSrS\\\44SjrSSS\4SjrSSS\S\4SjrSU4SjjrSrU=r$)UserFunctionVariablez-Some unsupported user-defined global functionfn is_constantc^[UR[R55 U"XS9$Nr4)r make_guardr CLOSURE_MATCHclsvaluer4s r5create_with_source'UserFunctionVariable.create_with_sources&f'' (B(BCD5((r7rjc B>[TU]"S0UD6 [USS5(aSUlOSUl[ U[ R [RR45(dS[U5SU35e[R"USU5nXl g)N_dynamo_marked_constantFTzexpected FunctionType found  _torchdynamo_inliner)super__init__getattrrr.rQrNtorchjitScriptFunctionr!r}getattr_staticr)rcrrrp __class__s r5rUserFunctionVariable.__init__s "6" 20% 8 8#D $D  ##UYY%=%=>   = )'"+at < =  # #B(=r B&(r7cb>[U[5(a UR$[TU]5$r-)rrrras_python_constantrcrs r5r'UserFunctionVariable.as_python_constants( $, - -77Nw)++r7c/$r-rrbs r5rmUserFunctionVariable.self_argsrr7cUR$r-rrbs r5rv!UserFunctionVariable.get_function wwr7c.URR$r-)r__code__rbs r5r`UserFunctionVariable.get_codeswwr7c"[R$r-)rQrNrbs r5 python_type UserFunctionVariable.python_types!!!r7c4[URSS5SL$)N__self__)rrrbs r5has_selfUserFunctionVariable.has_selfstww D1==r7c.URR$r-)r __globals__rbs r5 get_globals UserFunctionVariable.get_globalssww"""r7cUR(aeURRn[R"[ US9nUR nUR=(d /n[U5VV s/sH*upURcSO[URU5PM, n nn [R"URURUR[![#Xz5V V s/sH upU"XS9PM sn n 5UR$5n UR&(a{UR&Vs0sH(nUURcSO[URUSS9_M* nnUR&R)5VVs0sHunnX"UXS9_M snnU l[*R,"U 5R."U0UD6nUR15 [3UR4R)55n[7UU5 [9UUUR5 UR R$=(d Sn[;U5[;UR RR<5:Xde[#[>R@"5UR RR<U5HunnnURRBnUU;aUUnOUR(ac[E[GURS5U5n[GUS5n[HRJ"UURLU5nURUUUU5nO5[HRJ"UURL5nURUSUU5nUUU'M U$s sn nfs sn n fs snfs snnf![Na [PRR"5nNf=f![Na [PRR"5nN{f=f) z Assume `args` and `kwargs` are VariableTracker arguments for a call to this function, create new bindings for initial locals. )r2N)r3r4T)is_kwr __closure__ cell_contents)+rrBroot_tx functoolspartialr6r __defaults__ enumerater4rrQrNrrrtr;ziprrRr:r}r~bindapply_defaultsr< argumentsr@rLlen co_freevarsrScountrCrrr#r/r ValueErrorrDeletedVariabletrack_cell_existing)rcrHrorprwraprrVidx_defaults_sourcesargr4 fake_funcr>kwdefaults_sourcesr?r+r=rWrJcellrCcell_var closure_cellclosure_cell_contents contents_vars r5 bind_argsUserFunctionVariable.bind_argss ####--''  G<!%??(b$H- -KK'D^DKK-M M-  && KK NN KK (+8'F'F S0'F  NN     ** " +A {{*' QdCD + "--335(5DAq4A&8&;<<5(I $ !!),114B6B eoo++-.&)ffbkk2''%%+7|s477#3#3#?#?@@@@" OO tww//;;W OCt"==55L|#'-,t{{M:C  )3<(Q%?#2#8#8 2 24I$L (;; $ ?#2#8#8ASAS#TL(;;D$ U#F4LE H U "(<"?#,#<#<#>L?"?#,#<#<#>L?s<21N *N2/NN"N$!O $OO O+*O+r2r'rJcZUR=(a [URU5n[R"URU5nU(a[ RRXC5$[R"X5$![ a [ R"XUS9s$f=fr) r4rr}rrAttributeErrorrGetAttrVariabler0r1r#r/)rcr2rJr4subobjs r5 var_getattr UserFunctionVariable.var_getattrs>DKK!> H++DGGT:F 0077G G$$R00  H,,TG G Hs!BB*)B*cl[URU5n[RR U5$r-)rurrr%r1rys r5rz!UserFunctionVariable.call_hasattr!s)$'))0088r7cP>UR(a%[XRUR5X#5$URR R (aURR R(dsSSKJ n UbiURURUR4;aC[RRRU5 [ TU]EXU5sSSS5 $[ TU]EXU5$![a SnNf=f!,(df  N0=f)Nr) FSDPState)rinvoke_and_store_as_constantrrhrBcurrent_tracerunder_activation_checkpoint#allow_side_effects_under_checkpoint/torch.distributed.fsdp._fully_shard._fsdp_stater Exception _pre_forward _post_forwardr_dynamorCrrq)rcr2rorprrs r5rq"UserFunctionVariable.call_function%s   /GGT]]_d  II $ $ @ @II,,PP !U$&&''5*]]//SSTVW 706BXWw$Rv66 !  ! XWsDD DD D%)rr)FrjNr)rtrrr__doc__r]_nonvar_fields classmethodrrrrmrvr`rrrrrr#rrrzrqr __classcell__rs@r5rrs7  " 0 0N ))))",  ">#Uc?6J1KUn151S1969c9o97 #7&7- 7  77r7rcv^\rSrSrSrS U4SjjrS\4SjrSrSr S U4Sjjr U4S jr S r U=r $) UserMethodVariablei@z$Some unsupported user-defined methodrjc 6>[TU]"SSU0UD6 X lg)Nrr)rrobj)rcrrrprs r5rUserMethodVariable.__init__Cs )B)&)r7chURRSURSURS3$)N(z, ))rrtrrrbs r5__repr__UserMethodVariable.__repr__Gs...))*!DGG9BtxxjBBr7cUR/$r-rrbs r5rmUserMethodVariable.self_argsJszr7c"[R$r-)rQ MethodTyperbs r5rUserMethodVariable.python_typeMsr7cN>URR5(a[UR[R 5(a[ URSS5nUbURS5(aUS:wdUR(a9URRXRRX#URS9$Ol[beUR[RRLa>[R"UR5R!XR/UQ7U5$UR(aO[ URR"URR5n[%XUR'5X#5$[(TU]AXU5$)Nrz torch.nn.ztorch.nn.utils.parametrize)constant)rBis_root_tracerr.rrNNModuleVariablerr startswithr call_methodrtr&FSDPParamGroupuse_training_stateTorchCtxManagerClassVariablerqrrrhr)rcr2rorp module_attrrrs r5rq UserMethodVariable.call_functionPsN$ 99 # # % %* HHi00+ + "$''<[TU]5SS$)Nr )rrrs r5r*UserMethodVariable.inspect_parameter_names|sw.044r7r rr)rtrrrrrrrrmrrqrrrrs@r5rr@sY.C#C *7 #*7&*7- *7  *7X55r7rcL^\rSrSrSU4SjjrSU4SjjrSrU=r$)WrappedUserMethodVariableic >URSS5 URSS5 [TU]"URUR40UD6 XlX lgNrr)rGrrrrwrappedcontextrcr r!rprs r5r"WrappedUserMethodVariable.__init__sE 4 5$ W[[;F;  r7c>URRU5 [TU] XU5nURR U5 U$r-r!enterrrqexitrcr2rorpr=rs r5rq'WrappedUserMethodVariable.call_function? 2&r8 " r7r!r rrrtrrrrrqrrrs@r5rr8  # & -    r7rcL^\rSrSrSU4SjjrSU4SjjrSrU=r$)WrappedUserFunctionVariableic >URSS5 URSS5 [TU]"UR40UD6 XlX lgr)rGrrrr r!r"s r5r$WrappedUserFunctionVariable.__init__s? 4 5$ .v.  r7c>URRU5 [TU] XU5nURR U5 U$r-r%r(s r5rq)WrappedUserFunctionVariable.call_functionr*r7r+rrr,rs@r5r/r/r-r7r/cSnUVs/sH oe"U5PM nnUR5VVs0sH upxXu"U5_M nnnU"U0UD6n URRU U[U5S9$s snfs snnf)Nc[U[R5(aUR5$UR 5$r-)r.rTensorVariableget_real_valuer)xs r5convert-invoke_and_store_as_constant..converts3 a11 2 2##% %##%%r7r)r:rBregister_attr_or_moduler) r2rrJrorpr9r8r>r?ress r5rrs& !% %1GAJD %(.  7amF 7 d f C 99 , ,  d# -  & 7s A1A6c^\rSrSrS1\R krS SU4SjjjrSrSrSr Sr Sr S r S r S rS rU=r$)rxirUc  \>[T U]"S0U D6 [UR5[5(de[UR5[ R 5(de[U[5(deXlX l X0l X@l XPl X`l XplXlgNr)rrr.rrrQCodeTyper<fn_namerIrUrVrXrYrW wrapped_fn) rcrArIrUrVrXrYrWrBrprs r5r#NestedUserFunctionVariable.__init__s "6"'446<<<<$113U^^DDDD)T****  " $& 5?r7c/$r-rrbs r5rm$NestedUserFunctionVariable.self_argsrr7c6URR5$r-)rIrrbs r5r`#NestedUserFunctionVariable.get_codesyy++--r7cUR(a[e[R"URR 5UR URR 55nUR(aURR 5Ul UR(aURR 5Ul UR(acURR 5n[U[5(aSSKJn [#U"U55n[U["5(deX!lU$)NrrO)rWrwrQrNrIrrUrArVrrXrRrYr.r;rSrPr<rT)rcrZrYrPs r5rv'NestedUserFunctionVariable.get_functions <<% %!! II ( ( * NN LL + + -  == $ @ @ BD  ??"&//"D"D"FD    **==?K+u--."8K#89 k400 00#.  r7cURSL$r-)rWrbs r5 has_closure&NestedUserFunctionVariable.has_closures||4''r7cg)NFrrbs r5r#NestedUserFunctionVariable.has_selfsr7cUR$r-)rUrbs r5r&NestedUserFunctionVariable.get_globalss ~~r7c`UR5n[R"UURURR 5UR (a[UR R5OS[S[[UR5R55555nUR(aURR5Ul[R "U5R""U0UD6nUR%5 ['UR(R55n[+UR,R.U5 [1XU5 [3UR5H)upX;deUR4RUn XU 'M+ U$)Nc38# UHn[S5v M g7fr-)r).0rs r5 7NestedUserFunctionVariable.bind_args..sS+Ra)D//+Rs)r`rQrNrUrArrVr;r:rangerrrXkeys_as_python_constantrRr}r~rrr<rr@rBrrLrrW) rcrHrorprIrZr+r=rrJrs r5r$NestedUserFunctionVariable.bind_argss9}}!!  NN LL + + -*.--E$--%% &T S5T]]_5P5P1Q+RS S   ??"&//"I"I"KD !!$',,d=f= eoo++-...7fd+"4#3#34IC% %%<<%%c*D4L5  r7c&^TRU4Sj5 T"UR5 TRTRUR5/5 T"[ R "URRR55 UR(aT"UR5 O!TRTRS5/5 UR(aT"UR5 O!TRTRS5/5 UR(aT"UR5 O!TRTRS5/5 UR(a=URR5nTRTRU5/5 O!TRTRS5/5 TR[!SS55 UR"(axTRU4Sj5 T"UR"5 TR[!SS55 TR[%S55 TR[!SS55 gg![a T"UR5 Nf=f)Nc0>TR[S5$)Nr[)load_import_fromrtcodegensr58NestedUserFunctionVariable.reconstruct..sG,,X7JKr7Fc(>TRSS5$)Nrwrapsr[r\sr5r^r_>s00gFr7r r T) add_push_nullrI extend_outputcreate_load_const_uncheckedrUr%r1rrgrVcreate_load_constrWrXrYrrwrrBr)rcr]rYs ` r5 reconstruct&NestedUserFunctionVariable.reconstructs K   wBB4>>RST '' (?(?@A == DMM "  ! !7#<#>[TU]"S0UD6 XlX lgr?)rrrrl)rcrrlrprs r5rSkipFunctionVariable.__init__Ms "6"  r7cUR$r-rrbs r5r'SkipFunctionVariable.as_python_constantRs zzr7c~[U5(d([UR[R55 U"XS9$r)rrrrFUNCTION_MATCHrs r5r'SkipFunctionVariable.create_with_sourceUs3.u55 &++L,G,GH I5((r7cB[R[R0$r-) collections namedtuplerUserDefinedClassVariablerr7r5 fold_through_function_to_wrapper5SkipFunctionVariable.fold_through_function_to_wrapper^s  " "I$F$F  r7c ^[R"URSS5(a[SUR35 gURUR 5R 5;a[ TU5(aUR"TVs/sHoDR5PM sn0UR5VVs0sHupVXVR5_M snnD6nUR 5RUR5"U[5S9$UR[RLa2U(d+[T5S:XaU4Sjn[R"U5$[R "UR5n SURR"SU S 3n URR"S:XaSn XR2(aSUR2S 3OS- n [U 5 gs snfs snnf![$GaM S S 1n URR&U ;a3S URR&S URR"S3n NURR&bURR&R)S5(a]SURR&S URR"S3n [*R,R.R1U 5 GNRSURR&S URR"S3n [*R,R.R1U 5 GNf=f)N_torchdynamo_disableFz.call torch._dynamo.disable() wrapped function ) mutation_typer c>[U[R5(aURTSS9$[ SUS35 g)Nr)rBzfunctools.wraps(r)r.rrxcloner)rros r5rb1SkipFunctionVariable.call_function..wraps|s=b)"F"FGG88tAw877 0A67r7z'skip function z in file '_abc _warningsz.Graph break due to unsupported Python builtin .zM. Please file an issue on GitHub so the PyTorch team can add support for it. optreez)Graph break for an optree C/C++ function zj. Consider using torch.utils._pytree - https://github.com/pytorch/pytorch/blob/main/torch/utils/_pytree.pyz'Graph break due to unsupported builtin a. This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind). If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround. If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use torch.compiler.allow_in_graph.allow_in_graphzFound an allow_in_graph decorator to a function which is created inside the parent function that is getting compiled. This is not supported for now.z', r)r}rrrrykeysrrr:getr"rrbrrLambdaVariablegetfiler TypeErrorrrrrutils warn_oncerl) rcr2rorpr8r>r?rrbpathmsgknown_python_builtin_moduless ` r5rq"SkipFunctionVariable.call_functiones  ! !$**.De L L J4::,W X JJ$??AFFH H#D&11JJ267$Q&&($79?H1**,,HE88:>>tzzJ%5%7 ZZ9?? *6c$i1n 8 ++E2 2$ 7tzz2' (?(?'@ $qQFzz&&*::? ;;S Q'B >C # w8H"! 706 /D,::((,HHHI^I^H__`aeakakaxax`yzGH JJ))5 --88BBDDJJDYDYCZZ[\`\f\f\s\s[tu^_ MM''11#6B$**BWBWAXXYZ^ZdZdZqZqYr s9 :MM''11#6C! 7s-G0>G5&=G;;AMBM5AMM)rlrr-rr)rtrrrr#rrrrr staticmethodr lru_cacheryrqrrrs@r5rkrkFs  ' 'N  ))  J #J&J- J  JJr7rkcZ^\rSrSrSrSU4SjjrSU4SjjrS SjrSrU=r $) WrapperUserFunctionVariableia Used to represent a wrapper object that contains the actual callable as an attribute. For example, torch.jit.script/trace have the original function at their _torchdynamo_inline attribute. Similarly, functions with __script_if_tracing_wrapper have the original attr at "__original_fn". c >>[TU]"S0UD6 XlX lgr?)rr wrapper_obj attr_to_trace)rcrrrprs r5r$WrapperUserFunctionVariable.__init__s "6"&*r7c>X R:Xa`[URUR5nUR=(a [ URU5n[ R "XU5$[TU]!X5$r-) rrrr4rr#r/rr)rcr2rJr3r4rs r5r'WrapperUserFunctionVariable.var_getattrsc %% %$**D,>,>?C[[BZ T%BF"((&9 9w"2,,r7c[R"[R5R X[R "UR 5/UQU5$r-)rrr getattr_and_tracerqr%rrns r5rq)WrapperUserFunctionVariable.call_functionsJ --  ' ' - y11$2D2DEMMv  r7)rrrr2r'r) rtrrrrrrrqrrrs@r5rrsB+ -  #  &  -     r7rc\[RR5(aSSKJn U$0$)Nrtraceable_collective_remaps)r distributed is_available)torch.distributed._functional_collectivesrrs r5_traceable_collective_remapsrs) %%'' +* Ir7c[RR5(dS5eU[5R 5;deUR nUR S5n[X25$)NzIllegal invocation.z)torch.distributed._functional_collectives)rrrrvaluesrt import_sourcer)r2r inner_name path_sources r5_traceable_collectives_sourcersc    ) ) + +B-BB + -/668 88 8J""#NOK k ..r7c^\rSrSrSrS U4Sjjr\S Sj5r\S5r\S Sj5r S Sjr Sr U=r $) !CollectiveFunctionRewriteVariableia Some of the torch.distributed.* collective APIs are possible to rewrite to 'traceable' collectives. This class provides both a way to check if a function is remappable, and perform the remapping. In the case that a function is 'remappable' but only for some combinations of call-time arguments, we check the args at `call_function` time and fall back to graph-breaking if needed. This is no worse than status-quo as we currently graph-break on all distributed.* collectives. c b>[TU]"U40UD6 [U[5(deX lgr-)rrr.rreplacement_var)rcrrrprs r5r*CollectiveFunctionRewriteVariable.__init__s/ &v&/+?@@@@.r7c f[RX5upE[U4[U4SU0UD6US.UD6$)Nr4)rr4)rrewriter)r2old_fnr4optionsnew_fn new_sources r5r1(CollectiveFunctionRewriteVariable.createsI>FFrR0  0V VgV    r7cV[R"U5=(a U[5;$r-)r} isfunctionr)variables r5 can_rewrite-CollectiveFunctionRewriteVariable.can_rewrites%   x ( WX9U9W-W r7c6[5UnU[X54$r-)rr)r2rrs r5r)CollectiveFunctionRewriteVariable.rewrites -/34R@@@r7cSSKJn SSKJn [R "UR 5n[UR"U0UD6R5nSnSU;a0USR5(a[SUR 35 UR URURUR4;apURS5nUb UR OUR"SR$nX;a['SU35e[(R*R-XX5US'UR.R1XU5$)Nr)REDUCE_OP_TO_STRrasync_opzBCollectiveFunctionRewriteVariable can't support async_op=True for opzUnsupported all_reduce op: )torch.distributedrrrr}r~rr<rrrr all_reducereduce_scatter_tensor_reduce_scatter_baserrrdefaultrrr%r1rrq) rcr2rorpdistrr~ reduce_op_var reduce_ops r5rq/CollectiveFunctionRewriteVariable.call_function s6 )N%%dgg. innd5f5??@  F:$6$I$I$K$K TUYU\U\T]^  77 OO  & &  % %  #JJt,M!,##))$/77  0 #>yk!JKK$55<< +F4L##11"FCCr7)rrrr) rtrrrrrrr1rrrqrrrs@r5rrs/     AA'D #'D&'D- 'D  'D'Dr7rc|^\rSrSrS\SS4U4SjjrSrSrSS jrSS S \ S\4S jr S r Sr Sr U=r$)FunctoolsPartialVariablei7rZrjNc >[TU]"S0UD6 Xl[U[5(deX l[U[ 5(deX0lgr?)rrrZr.r9ror<keywords)rcrZrorrprs r5r!FunctoolsPartialVariable.__init__8sH "6" $%%%% (D)))) r7cR^TRU4Sj5 T"UR5 UR(aTRUR5 UR(d2TR [ [UR5S-S55 gTRURR55 [URR55nTR TR[U5[UR5-S-US55 g)Nc(>TRSS5$)Nrrrcr\sr5r^6FunctoolsPartialVariable.reconstruct..Asg&>&>{I&Vr7r F) rdrZroforeachrrerrrr;rcreate_call_function_kw)rcr]rs ` r5rh$FunctoolsPartialVariable.reconstruct@sVW  99 OODII &}}  ! !"6s499~7I5"Q R  ,,./T]]'')*  + +CIDII,F,JDRW X r7c"UR5$r-rrbs r5rv%FunctoolsPartialVariable.get_functionO&&((r7r2r'cxURU-n0UREUEnURRXU5$r-)rorrZrq)rcr2rorp merged_args merged_kwargss r5rq&FunctoolsPartialVariable.call_functionRs< ii$& 34==3F3 yy&&r FFr7rJc[RR[[R "[ 5U55$r-)rr%r1rurrr)rcr2rJs r5rz%FunctoolsPartialVariable.call_hasattr\s0))00 I%%h/ 6  r7c B[R"URR5/URVs/sHoR5PM snQ70UR R 5VVs0sHup#X#R5_M snnD6$s snfs snnfr-)rrrZrrorr:)rcrr>r?s r5r+FunctoolsPartialVariable.as_python_constantbs  II ( ( * 26)) <)3$$&) < 6:]]5H5H5JK5JTQq&&((5JK  <K B 4Bc B[R"URR5/URVs/sHoR5PM snQ70UR R 5VVs0sHup!X!R5_M snnD6$s snfs snnf)zcSimilar to as_python_constant(), but add ID_MATCH guards to try to force things to become constants)rrrZguard_as_python_constantrorr:)rcr?r>s r5r1FunctoolsPartialVariable.guard_as_python_constantis  II . . 0 48II >Iq((*I > <@==;N;N;PQ;P41q,,..;PQ  >Qr)rorZrr)rtrrrr#rrhrvrqrrzrrrrrs@r5rr7sz!_!4!  )G #G&G- G  G 6 c o    r7rc*^\rSrSrSSS1\R kr\\R"S5S\ \ S\ 4\ R44Sj55r\S 5rS\SS4U4S jjr\S\4S j5rS rS rSSjrSSjrSrSrU=r$)PolyfilledFunctionVariableirrrB traceable_fnNrj.c0$r-r)rs r5_get_polyfill_handlers1PolyfilledFunctionVariable._get_polyfill_handlerszs  r7c^[UR[R55 U"XS9$r)rrrrsrs r5r-PolyfilledFunctionVariable.create_with_sources&f'' (C(CDE5((r7c D>[TU]"S0UD6 XlUR5R X5n[ U5(d SUSU35eSH,n[ X4S5nU(dM[ U5(deUn O [SUS35eX0lX`l g)NzPolyfill handler z is not callable for )__torch_dynamo_polyfill____python_implementation__z# does not have a traceable functionr) rrrrrcallabler RuntimeErrorrBr)rcrrphandlercandidate_attr candidaterrs r5r#PolyfilledFunctionVariable.__init__s "6"--/33B;  X$5gY>STVSW"XX  N >Iy ****(  #G9,OP & ,r7cUR$r-)rrbs r5 polyfill_fn&PolyfilledFunctionVariable.polyfill_fns   r7c0[URSS5$)N*__torch_dynamo_can_constant_fold_through__F)rrBrbs r5can_constant_fold_through4PolyfilledFunctionVariable.can_constant_fold_throughs OOI5  r7c"UR5$r-rrbs r5rv'PolyfilledFunctionVariable.get_functionrr7c rUR5(a[X#5(awUR"UVs/sHoDR5PM sn0UR 5VVs0sHupVXVR5_M snnD6n[ R "X5$UR[RLGa<[U5S:XGa,U(Gd$[US[R[R45(a[SUSR55(a[RR!UUR"R%S[&R([+SUSR55405[&R("USRVs/sH:n[U[R,5(a UR.O UR0PM< sn5S9$[ R "XR25nUR5XU5$s snfs snnfs snf)Nr rc3# UH~n[U[R5=(a [UR[5=(d7 [U[R 5=(a UR 5[Lv M g7fr-)r.rr%rintSymNodeVariabler)rSr8s r5rT;PolyfilledFunctionVariable.call_function..sd'AAy99:Wz!''SV?WYq)";";<WTWAWY&sBBrqc3@# UHoR5v M g7fr-)as_proxy)rSas r5rTrs?A::<<s)sym_num)rrrrr:r#r/builtinssumrr.r ListVariable TupleVariableallrr1rB create_proxyrsym_sumr;r%rr rrq) rcr2rorpr8r>r?r=traceable_function_variables r5rq(PolyfilledFunctionVariable.call_functions  ) ) + +0M 1 1 6:;d**,d;=C\\^L^TQq..00^L  #((4 4 GGx|| #D Q47Y%;%;Y=T=T$UVVa ,,33 &&#MM?a??A   "&a  "/A *!Y-G-GHHGG!"+"/  4 ('6&;&;B@Q@Q&R#*886JJO<L4sH)%H.-AH4cvUS:XaURXU5$[URUS5nUcSUSUR35e[U5(dSUSUR35e0nUR(a[ URU5US'[ U40UD6nURXU5$)N__call__zMember z not found in z is not callable in r4)rqrrrr4rr)rcr2rJrorpmethodrpolyfilled_method_variables r5r&PolyfilledFunctionVariable.call_methods : %%b7 7$-!JWTF. #JJ!6""QgdV3Gy$QQ" ;; *4;; =GH %?%R'%R")77&IIr7cUR$r-rrbs r5r-PolyfilledFunctionVariable.as_python_constantrr7)rrrBrrorrprrjr#)rtrrrr#rrrrrrrrQrNrrr*rpropertyrrrvrqrrrrrs@r5rrrs   ' ' NtHS#X,>@R@R,R'S)) -2-D-.!R!! )2K #2K&2K- 2K  2KhJ& J - J  J&r7r)TMADescriptorMetadataTritonHOPifierc\rSrSrS\S\4SjrS\S\4Sjr S\S\4Sjr S\ \ RRRS 44S jrS rS\4S jrS rg)DynamoTritonHOPifierirrjc[U5er-)r)rcrs r5raise_unsupported&DynamoTritonHOPifier.raise_unsupporteds #r7maybe_callablec.[U[[45$r-)r.rxr)rcr$s r5 is_callable DynamoTritonHOPifier.is_callables 79MN  r7r3cUR$r-rp)rcr3s r5 get_valueDynamoTritonHOPifier.get_values yyr7.c~SSKJn [X5(aUR5$[ S[ U535 g)Nr )BaseListVariablezgrid for the triton kernel is )listsr,r.rrtype)rcgridr,s r5 check_gridDynamoTritonHOPifier.check_grids0+ d - -==? " :4:,G Hr7cUR5VVs0sH%upE[RRU5U_M' nnnUR X2/05nU$s snnfr-)r:rr%r1rq)rcr/metar2r>r?s r5 call_gridDynamoTritonHOPifier.call_grid sSDHJJLQLDA **11!4a7LQ!!"fb1 Rs,Ac `SSKJn SSKJn 0n[ UR 55HHnX8n [ U [5(dMU R5Xx'U RRX8'MJ UR5VV s0sH%up[RRU5U _M' n nn SSKJn Jn UR5VV s0sH'up[ X5(dMXR#5_M) n nn U R5VV s0sHup[ X5(aMX_M nnn UR%5Hbn U R'5n [ U [R([R*45(aMDUR-S[/U 5S35 Md U R1U 5nU"U[25nUR4R7SU S UR8UUUUR;5S .5 [R"S5$s sn nfs sn nfs sn nf) Nr r$)ConstDictVariabler)kernel_side_tabletriton_kernel_wrapper_mutationz.Unexpected argument type for a Triton kernel: rrqr) kernel_idxconstant_args_idxr/tma_descriptor_metadatarp)rr%dictsr7r9rr.TMADescriptorVariable to_metadatadata_ptr from_tensorr:rr1*torch._higher_order_ops.triton_kernel_wrapr8r9rrrealizer6rr"repradd_constant_argsr<rBrr:r)rcrgridscombined_args_rawr2r%r7r<r>r? combined_argsr8r9 constant_argsnon_constant_argsr;r3s r5call_HOPDynamoTritonHOPifier.call_HOPs.,:<',,./A!$A!233-.]]_'*'(zz'='=!$ 0*//1 1  & & - -a 0! 31   *//1 1!. &A##% %1  &++- -a2 AD-  #))+A Aa)":":I[TU]"S0UD6 [RXX#5 gr?)rr dynamo_triton_hopifier_singleton init_variable)rcrSr:r/rprs r5rTritonKernelVariable.__init__]s# "6"(66tZVr7c.[RXX15$r-)rUcall_triton_kernelrns r5rq"TritonKernelVariable.call_functionas 0BB   r7c>US:Xa[RX5$US:Xa[RXXA5$[TU]XX45$)N __getitem__run)rU call_getitemcall_runrr)rcr2rJrorprs r5r TritonKernelVariable.call_methodksL = 3@@L L U]3<? ? r7rrrr)rtrrrrTrrrrqrrrdrrrs@r5rRrRXs   W # & -     ;& ; - ;  ;ssr7rRcH^\rSrSrSU4SjjrSrSrSrU=r$)r>ic >[U[R5(de[TU]"S0UD6 XlX lX0lX@lgr?) r.rDataPtrVariablerrr@dims block_dims element_size)rcr@rirjrkrprs r5rTMADescriptorVariable.__init__sC(I$=$=>>>> "6"  $(r7cURVs/sHoR5PM snURVs/sHoR5PM snURR54$s snfs snfr-)rirrjrk)rcdims r5r?!TMADescriptorVariable.to_metadatasX'+yy 1y\\^y 1'+ 7\\^ 7    & & (  1 7s A.A3c^^TRUU4Sj5 TRRT5 /TRQTRQTR PnTR U5 TR[U5S-S5 g)NcV>TRSS[TR5S35$)Nz$triton.tools.experimental_descriptorcreate_d_tma_descriptor)r[rri)r]rcsr5r^3TMADescriptorVariable.reconstruct..s)G,,6#dii.))9:r7r F) rdr@rhrirjrkrrqr)rcr]ros`` r5rh!TMADescriptorVariable.reconstructsp  !!'*@@T__@d.?.?@c$i!mU3r7)rjr@rirk)r@zvariables.DataPtrVariableriList[ConstantVariable]rjrvrkr%) rtrrrrr?rhrrrs@r5r>r>s= )- )' )- ) ) )  4 4r7r>cN^\rSrSrS\SS4U4SjjrSSjrSrU=r$) CreateTMADescriptorVariableirankrjNc B>US;de[TU]"S0UD6 Xlg)N)r r r)rrry)rcryrprs r5r$CreateTMADescriptorVariable.__init__s& v~~ "6" r7c$SU;aUSOUSn[U[R5(d[SURS35eURS:Xa@[ U5[ U5-S:XdeSU;aUSOUS/nSU;aUSOUS /nO][ U5[ U5-S :XdeS U;aUS OUSS U;aUS OUS /nS U;aUS OUSSU;aUSOUS/nSU;aUSOUSn[ UUUUS9$)Nptrrz8Please ensure there were no graph breaks between create_z3d_tma_descriptor and the upstream .data_ptr() call.r rn block_dimr dim1dim0 block_dim1 block_dim0rk)r@rirjrk)r.rrhrryrr>)rcr2rorpr}rirjrks r5rq)CreateTMADescriptorVariable.call_functionsd %fUmDG#y8899))%$$  99>t9s6{*a/ //!&&u d1gD(3f'<{#$q'Jt9s6{*a/ //"(F"2vQ"(F"2vQD )5(>|$DG(4(>|$DGJ2@61Ivn-tTVx $!%   r7)ryr) rtrrrrrrqrrrs@r5rxrxsJ  ( #( &( - (  ( ( r7rxr-r)Tr rvrr}rSrQtypingrrrrrrr r typing_extensionsr rrr rbytecode_transformationrrexcrrguardsrrr4rrrrrrrrrrrrbaser!r"r#rr%#torch.distributed.fsdp._fully_shardr&ModuleNotFoundErrortorch._dynamo.symbolic_convertr'rBr(r)r*r6r@rrLr[r]rrrr/rrxrkrrrrrrrrr rUrRr>rxrr7r5rs UUU# #H,0NN=<&E D  T" A. $sO';"< "(@t73t7n=5-=5@ 2("6(  KA!9KA\i?iX / D/LD(<LD^8 8 v~~B Y >Y x$8#9 )?)X!4O!4H2 /2 M$sFFF