x-j#ziddddiddiddddddd d d d d dddddiddidddddiddiddddddddddddddddddddd ddd!dd"dd#dd$d%dddd&d'd(d)d*dd+d, dd-d.d/d0d1dd2d3d4d5d3d6d5d3d7d5d8d9d:d;dddd ddddd?d@dddd&d'd(d)d*dd+d, dd-d.d/d0d1dd2d3d4d5d3d6d5d3d7d5d8d9dAdBddCdDddidEdFdGdHdIdJdKdLdiddiddMdMddiddiddNdNdOddCdPddidQdRdSdIdTdTddUdVdWddiddXdXdYdZid[d\id]d^d_d5id`dadbddiddidcdddedIdfdfdOdgdDddidhdid5dhdjd5dkd9idldmddiddidcdddedIdndoddiddidcdddedIdpdpdYdOidqdrdsddtdtddiddiddudvddiddidcdddedIdwdxdydzd{d|ddid}d~dd}d~dd}d~dd|d9ddddiddiddd~did9ddddiddiddd~did9ddddiddddddddiddddddddiddidddddiddidddddiddidddddiddidddddddddddiddidddddiddididdddidddddiddiddddddDddidddddiddiddddddddddddd ddddddddddddddddddddddddOddCdPddidQdRdSdIddddiddiddddOddVdddidddddddUdVddCddddddǜddidIddddd˜ddiddddddϜdddҜdddddiddidddddddUd؜d[diddidIddddCddVdܜddidddddddUd؜d[diddidIdddddddidd^d~did9iddddiddddddddCdDddidddddiddidddddCdDddidddddCdDddidddddCdDddidddddidddddddddiddddYdiddidddddiddiddddddddiddddddddddddddiddidddddiddidddddiddidddddiddidddddUdddd did d ddiddidd d ddCdDddidd d d diddddddddiddid3dd5d3dd5dd9ddddiddiddddYdOid\ddddidIddddddd d!d"d#d$idId%d%ddCd&ddidd'd'ddiddiddidd^d(d5id)d*d+d*id,d,ddiddidd-d-dOd.d/dd\idd0d0dOd.dVd1dd\id2d^d~did`d3d3dOd.dVd1dd\id2d^d~did`d4d4dOd.d/dd\idd5d5dOd.d6dd\idd7d7d8d9d:dd\idid;d;ddiddidd<dddiddid^d?d@dAd^dBdCdAdDd`dEdEddCdDddiddcidIdFdGddd˜dddddHdHddiddidcdcidIdIdIddiddidd^d~did9dJdJddKdLddCiddMd+dMidNdNddiddiddOdOdOdPd.dQdRdd\iddSdSdOd.d/dd\idTdGdUdVdWdIdXdXdOd.dVd1dd\id2d^d~did`dYdYdYdOid[d\idUdZd[dId\d\ddUdddidd]d]ddUd^d_d`dadCdbdcdddeddfdfddgdhddidididjddOiddiddkdkddiddiddldldddmdddndodpddqddrdsddtduddiddiddvdvdYdOiddiddwdwddOiddiddxdxddiddiddydydzdQiddidd{d{ddCdDddidd|d|ddiddid3d}d5d3d~ddd9ddddCdDddidddddCdDddiddddddddQdddddddddd~iid)dd+didddddddddddddddiddddddddiddddiddddiddidddddidddddidIddddidddddddddCdDddidddddiddiddddddddiddidIddddiddd@ddAidddddCdDddidddddCdDddidddddiddidddddiddidddddiddidddddiddiddidd^d?ddAidddddCdDddidddddiddidddddiddiddidIddddidd~idd~idÜdĜidŐdddƐdǜddiddȐdddiddbdɜddʐdddiddbdɜddːdddUdddidd̐dddiddbdɜdd͐dddiddbdɜddΐdddϐd_d`dМddbdddcdќddҐdddϐd_d`dМddbdddcdќddӐdddϐdԐd՜ddbd֐dלddؐdؐdِdڐdېdܜdݐdސdߜddddOddVdddidTdGdVddIddddidddddiddidddddiddidddddiddidddddiddidddddiddidd3d~did9iddddiddidddddCdDddiddddd~ddd~ddddddd~ddd~ddddddd~ddd~dddddddidddddddIddddiddidddddiddidddddCdDddidddddCdDddidddddCdDddidddddiddCidddddiddidddddiddidcdddedd^d~didddddidddddiddidd3d~did9ddddd~dididd d d dd d ddddd+d ddddddddddddddddd d!d"d#d$d%d& id'd(d)d*d+d,d-d.d/d0d1d2d3d4d5d6d7d8d9d:d;d<d=d>d?d@dAdBdCdDdEdFdGdHdIdJdCdKddLdLddddUdVddCddddddǜddMdMddNdVdddOdIdDd(d*dCdPddQdRddSdddUdVdTdCddddddǜddUdUdOd.dVdVdWd[d\idTdGdUdVdWdIdXdXdOd.dVdVdYd\dZd[dd\d\dOd.dVdVdWd[d\idTdGdUdVdWdId]d]ddCdDddidd^d^ddCdDddidd_d_ddCdDddidd`d`ddCdDddiddadad͐dbdVdUdcddidddddd͐dedfdVdddgdddhdidjdkdldmdnddododddCdpdUdqdrddddsddtdtddudvdwdxdydzd{d|d$d%d} dd~ddddFdHddddd ddddddIdddddddddd!dddd#d ddddd8dd@ddd diddddCdVdddƐddddddCdƐdddddddddidddddddddddd dddd!dd"dd#ddddddddddddddddÐdĐdŜdJddƜddǐdddKdLddiddȐdddiddiddɐddddʐdfdVd˜dldhdiddd͜dΐdϐdVdМdIdѐddddʐdfdVddҜddddhdidjdkdldmdӐdԜ dΐdϐdVdМdIdՐddddVd֜ddd؜ddِddd.dVd1ddڐdۜdܐdݐdސdߜdIddddiddidddddiddiddddddddidd^dd5id9dddddddidddd͐ddddidddddiddd@ddAidddddiddiddddΐdddqdrddddddd$ddIiddddiddidddddiddidddddCdDddiddddddddddddddddddddddddd dd dd d ddCdDddidd d ddCdDddidd dddddd\idddddUdVdWdCdddddidIddddiddidddddiddidddddiddidddddiddidddddiddidddddiddiddidIdd ddCdDddidd!d!dd"d#d$didid%d%ddېd&ddidd'd(ddddVd)d*d+dd,d-d.dd/d/ddCd˜ddNd0dd1d1ddCdDddidd2d2ddiddidd3d3ddiddidd4d4ddd5d6ddidd7d7dd8d9d:d;d<d=ddid>d?d@dAdIdBd+dBidCdCddiddDdDdddddiddEdEdddddiddcidIdFdFddUdVdWdCddŐdGddHdHddOidd\iddIdIddiddiddJdJdOdgdDddidhdid5dhdjd5dkd9dKdLddiddididMdNddiddiddOdPddiddiddQdQddRdSddiddTdTddCdDddiddUdUddidddddVdVddiddiddWdWddXdYddiddZd[dddd&d'd)d*dd+d\ dd-d.d0d1dd]dd^d^ddUdVdWdCdddsdd_d_ddiddid`dzidIdސdaddddUd؜d[diddidIddbddiddiddcidd^dddedAidddfdΐddgdqdrdhdddddd$ddIdidjddCddkdldmddddndodpdqdIdrdsddddUd؜d[diddidIdtduddiddddd^d?d@dAid`dvdvddCdېdwddididxdxddCdDddiddydyddCdDddiddzdzddiddidd{d|ddddUd؜d[diddidId}d+d}id~d~dydddddidddddCdDddidddddiddidddddiddidddddiddidddddiddiddddd"d˜ddidddddiddidddddiddidddddCdDddidddddiddidddddCdDddididdddCdDddidddddiddidddddiddidddddiddiddddd͐dddidddddiddddddddCdDddddddd3d~did9dddddDddddddddddddddddddQdddCidddddCddddddddiddCdDddidddqdIddddCdDddidddddΐdddd!ddddddiddiddddddddidddddiddidcdddedd^d~dididdddiddQdddidIddddiddQdddidIddddCdDddidddddiddidddddiddidcdddedd^d~didddddiddiddĐddd~ddd~ddddŐdddiddiddƐddddd&d'd(d)d*ddǜ dd-d.d/d0d1dd2d3d~dd3d~dd3d~dd8d9dȐddddmdddʜddqdd˜dd̐ddLdiddidd͐dddiddidcdddedd^d~diddϐdddCdDddiddѐdddҐdӜddiddԐdddidddddՐddddmdddʜddqdd˜ddאddd_d`d؜ddbdddcdќdidِdddiddiddڐdddʐdfdVdVdۜddidΐdϐdݜdIdސdސddΐdddiddߐdߐddΐd!dddddddddOddVddddidddddIddddiddidd^d~did9dddd͐dddidddddCdDddiddddddddidddddidddddd^iid`ddrddddUd؜d[diddidIdddddېdddddddddiddidҐdidIddddiddidddddiddddddddCdDddiddd ddOiddidid d ddiddid d^d d5id9ddddiddidddddiddidddddiddidd3d~did9dd+diddddiddiddidd^dd5idddddiddidddddiddidddddidddddiddidddddiddidddddiddidddddiddidddddiddiddidd^d~didddddiddiddidIddddiddid d!id d3d"d5id)d#d#ddQd$ddidid%d%d&d'iddidd(d(dOd)d*ddrd+dd,d-ddiddidcdddedd^d~didd.d.dd/d!d0ddidd1d1dOdd2d3dd4idd5d6d7dId8d+d8id9d9ddid:d;d<dd=d=dYdOid[d\idUdZd6d>dId?d?ddUd^d_d`dadCdbdcdddedd@d@ddiddd@ddAiddAdAddiddBdBdydzd{d|ddid}d~dd}d~dd}d~dd|d9dCdCddiddiddDdDddiddiddEdEddiddiddFdFddiddiddGdHddCdDddididIdIddiddiddJdJddiddidKdcdLdIdMdMddNdOddiddcidIdPdPdYdOid[d\idTdGdQdRdSdIdTdtddiddddd^d?d@dAid`dUdUidddVdWdXdYdZdqd[d\d]d^d_d`dadbdcdddedfdgdhdidjdkdldmdndodpdqdriddCdsdtdudvdwdxdydzd{d|d}d~dddddddddddddddddddddddddddddddddddddSdddddd dCdddddddddddd dddddiddidd^d~did`dddddddd dddd"ddddddddOdddddddddÜddĐddd/d!d0ddiddŐddd/d!d0ddƐdǜddȐdddiddidddd5id`dːdddiddidd̐ddd.d6ddidd͐dddiddiddΐdddididϐdddiddid3d}d5d3d~ddd9dАddd͐dѐdҜddiddӐddddѐdҜddiddԐdԐdՐd֐dלddidddddiddؐdddސdٜddڐdۜddܐdddiddiddݐdddiddiddސdddddddddddd5id`ddddCdddddddddd5id`dd+diddddCdDddidddddid dCiddidd^dd5id)ddddiddidddddddddddddd+didddYdiddididdddiddddddddiddiddddddddddddddddddidddddiddidddddiddidddddiddidddddiddidddddiddidd d dYdOiddid^d d dAd^d d dAdd`ddddOiddidddddiddidddddiddidddddiddidddddiddidҐdidIddddiddidddddCdDddididdddidddddd@ddAidddd^d d dAd^d d dAdddddd^d(d5idddddiddddېdddddidddddiddidd^d~did d^d~did!d"d"dd^d~d(d#idd$d$ddiddidd%d%ddiddidd&d'ddiddddd(idd^d~didd)d)ddiddCidd*d*ddiddidd+d+ddiddidd,d,ddOiddid^d d dAd^d d dAd^d-d.dAd/d`d0d1ddCdDddidd2dJddiddidcddd3d4dd^d~didid5d5ddidd6d7d8dd9d9ddiddidd:d:ddUdVddd;dCddddddǜddidId<dd>ddiddidd?d?ddiddidd@d@ddiddiddAdAddBdCdDdEdFdGdHddIdIddJdKdLdd"dQdMddNdNddiddiddOdOddiddidPd^dQdRdAid`dSdTddiddddUd^dVd5id9dWdXddiddddUd^dVd5id9dYdYddOiddiddZd[ddiddid\didId]d]ddCdDddidd^d^ddiddidid_d`ddddUd؜d[diddidIdadadYdiddiddbdbddiddcdcdYdiddidddddddiddCiddedfddid3d~dd3d~ddddd@ddAidgdhdiddiddiddjdjddiddddkdlddmdmddidddkdnddododddpddidqdid2d^d~diddrdrdddpddiddsdtddiddddd(idd^dudvdAiddwdwddiddCiddxdydddzd{d|d}dd~ddddddd5id9dd+didddOddddΐddddddddddddddidddddCdddiddd+didddddddΐddddddiddiddddddddddddddddddddddddddddOdgdd[d\idddddiddidddddiddidddddiddidddddiddiddddddddddddddddd+didddddddddiddddddSddCiddÐddddSdCddĐdŜddƐddOdǐdȜd\dɐdʜdidːddOd̐dddddΜddddАdѐdҜddӐdddd ddԜdd"d՜dd֐dddאd؜ddiddِdِdddddڜdېdܐdݐdrdސdߜdddd d!d"ddddddddddidddddddddd&dd'dd)dd*dddddddddddddddddddd{idddddddddidddddiddidddddiddddd d dd d ddd dd ddddddYdOiddidddddCdDddddddddCdDddddddddCdVdddidEdFdGdUddddddd dIddddQdddidd d ddiddidd!d!d"ddQd#d$d%d&d'did(d(dLd)id*d+idd,d,ddKdLddidd-d-ddCdDd.d/d0dd1dd2d2ddiddidd3d3dOdddVd4d5d6d7dd8dd9d9dOd:ddVd;d<d=dd>dd?d?ddiddidd@dAdddmdddʜddqdd˜dd>dBddCdDddidCd^dBd5id`dDdDddiddEdEddiddiddFdFdydddGdHddiddIdIdd͐dddiddJdJdOddddVdKddd5dLdMddNdNddidddOdPdQdRidIdSdSddiddiddTdTddiddididUdUddiddiddVdVdOdddVdWdXdYdZd[d\d]d^d_dd`d`ddiddiddadadbdbiddiddcdcddiddddddedfdgdhdiiddjdjdddkdldmddndodpddqdqdrdsdtduddiddvdvddwdxdydzdd{d|d}d~ddIdddddddidddddiddddddddddddddddddiddddddddidddddd.dddiddܐdݐdސddIddddiddddddddOiddidd ddd dddddd`dddOiddidd ddd dddddd`ddddSddiddddCdUdVdddiddd:dVddPdddddddddddddmdddddddqdd˜ddidd^dd5id)dddiddidddddddiddddiddiddddiddiddddiddiddddiddidddYdOiddidddddddidd Ziddddddddddddddddddddddddddddd%dÐdĐdd;dŐddd@dƐdĐddMdǐdȐddNdɐdddTdʐdȐddXdːd̐ddbd͐dddΐdϐdddАdѐddidҐdӐdddfdԐdddmd͐dddod͐dddtddՐddvd͐ddd֐dאdؐddِdڐdddېdڐdddܐdݐdؐddސdߐdddddddddddddddddՐddddՐddddՐdiddddddddddddddddddddddddddddddddddddddddddddddddddɐdddddddddddʐdddddddidӐddddՐdd̐ddڐddՐddސdd̐ddߐdddddddddddddddddddddddddddddddddddddddddddddddd d ddidd d dd dddddddddddddddddddddddddddddddddddddddddddddddddddddd dd!d"d#dd d$dՐdid d%dՐdd d&d'ddd(dddd)dddd*d+ddd,d-dd%d.dՐdd'd/dՐdd,ddȐdd-d0dՐdd0d1ddd3d2ddd4d3dՐdd5d4ddd5d6ddd7dddd7d8ddid;dddd<ddddd9d:dd>d;dddEd<dՐddGd=ddd>d?d@ddƐdAdBddːdCdDddEdFdddGdFdddHdHdddIdIdddJdJdȐddKdLdddӐdMdNddNdOddidOdPddd֐dQdȐddSdRdddSdTdddXd1dddUdVddd\dWdddfdXdddjddՐddِdYdZddkd[dddld\d]ddud^dՐddvd_dddwd`dՐddxddddydaddidbdcddd{dddՐddddՐdddedfdddgdhdddidjddddkdddldkdddddddmdndddodddpdqdrddsdtdՐdddudddvdwdddxdyddddddiddddddddddddddzdddd{ddd|d}d~ddddddddddddddŐddddȐddddʐddddːdWddd̐dddd͐ddddΐddddҐdddidӐddddddՐddddՐddddՐddddddddddddddddddddddddddddddddddddddddddddddddddddȐdidddddddddddddddddddhddddhdddddddddd ddddddddddddddddddddddddddddLddddQdddiddddddddddddddddddddddddddddddddddddddÐddddĐddddŐdƐdddǐddddǐddddȐdɐdddʐdːddd̐ddidd͐dΐdd3dϐdАdd9dѐdҐdddӐdՐdddԐdȐdddՐdȐddd֐ddd dddd!dאdؐdd%dِddd(dڐdېdd/dܐdݐddސddddߐdddddddddddd?dddid1ddȐdd2ddȐdd3dddd4dddd7ddȐddBddȐddCddȐddddddDddՐddEddddddddFdddddd̐ddHddddIddddJddddLdddidNddddPddddQddddTddՐddUddddVddddWddȐdd[dddd^dddd_ddddvddddzddddDdddd|dd̐dd}dddd~dddddddidddddddddddddddddddՐddddddddddddddddddddddddddddddddՐddFddddddddIddȐdddddidJd d ddd d ddNd dddddddddddddddddȐddddddddȐddddddddddddՐddddddd ddd!d"dddd#dddd$dhdidd%dhdd&d'd(ddd)dddd#dddÐddՐdd*d+d,ddTd-dՐdd.d-dՐddĐd/d0ddŐddddƐd1d2ddɐd3d4dd̐d5d6dd7d'd(ddѐd8dՐddԐd9ddd:d;d<did=d;d<dd>d?d<dd@dAdBddCdDdEddFdAdBddGdHdIddJdKdBddLdMdNddOdPdQdd֐dRdSddUdӐdddِdTdՐddߐdUdVdddWddddXdՐdddYdՐddZd[d\didd+d,dd]d^dddrdd̐dd_ddddd`dadddbddddcddddddeddfdgdՐdd ddhdd didddjdudddkdlddddmdՐdddnddddodՐdddpddiddqddddrddddrddddsdՐdddtdՐddddՐddudddddvddddwddddxddd#dyddd(dzd{dd-d|dՐdddd}d~dd.ddՐdd1ddddjdddid9dddddddd@ddddddddqddddAddddvddddddddCddȐddDddddddddddddddddddddEddddFddՐddIdddidJddddMddddtddddddȐddddՐddddddddddddddĐddՐddŐddddȐddddːdddddddddddd͐ddddϐddddАdddidӐddՐddԐddddؐddddݐddՐddߐddddddddddddddȐdddd<ddddddddȐdddddddddddÐdddĐdÐddddŐdddddȐdiddƐdǐdddȐdddddՐdddɐdՐdddddddddddddddddd dʐdՐddddՐddːdd̐ddd͐dՐdddԐdՐddddՐddddՐdddΐdϐdddАdՐdiddѐdҐdd"dӐdԐdd$dddd%ddՐdddddd'dՐddd)d֐dȐddאdddd*dؐdddِdڐddddېdȐdd,dܐdՐddJd^ddd5dݐdސddߐdddddddd9dddiddddddddd<ddՐdd>dddd?dddd@ddՐddAddddIddddddddNddddddddTddddYd`dՐddddՐdd[dddd]ddՐdddddiddddd`dd̐ddddddddddadÐdddddddbddddcdddddddddfddddidddd ddȐddm d dddo ddddr ddddt ddddw d ddidy d d d d dڐdd d d͐dd d d ddd ddd d ddՐdd d ddd d dd d d dd d ddd d ddd d d dd d d d!dd d"ddd d# d$dd d%ddd d& d'did d( d)d d*dudd d+ d,dd d- d.d̐dd d/ d0d d1 d2 d3d d4 d5 d6d d7 d8 d9d d: d; d<d d= d5 d6d d> d?ddda d@dd dA dB d6ddBddddKd5dՐddx dCdddddՐdiddddd dDddd dE dFdd| dGddddddd dH dIdddddd dJdՐd dK dL dMdddddddddd dN dOdd dP dQdd dddd ddddddddxdddidyddddi dRdՐddddddΐd#dddАddddddՐddddddB dCdddHddȐdd dSddd dTddd1dddd dU dVd dW dXdՐddO dYdddj dZ d[dZ d\S(] absxXoutOut)phi_nameinputsoutputsaccuracyIndicesLabel)rindiceslabelAccuracyCorrectTotal)r correcttotalacosacoshadadelta adadelta_ParamGradAvgSquaredGradAvgSquaredUpdate LearningRate MasterParam)paramgradavg_squared_gradavg_squared_update learning_rate master_paramParamOutAvgSquaredGradOutAvgSquaredUpdateOutMasterParamOut) param_out moment_out inf_norm_outmaster_param_outadagradadagrad_Moment)rrmomentr"r# MomentOut)r(r)r+adamadam_Moment1Moment2 Moment2MaxBeta1PowBeta2Pow SkipUpdate) rrr"moment1moment2 moment2_max beta1_pow beta2_powr# skip_update Moment1Out Moment2Out Moment2MaxOut Beta1PowOut Beta2PowOut)r( moment1_out moment2_outmoment2_max_out beta1_pow_out beta2_pow_outr+float Beta1Tensor) data_type tensor_name Beta2Tensor EpsilonTensor)beta1beta2epsilon)rrr scalaradamaxadamax_InfNorm)rrr"r/inf_normr<r# InfNormOutadamwadamw_elementwise_addaddY)ryScale_xScale_y Scale_out)scale_xscale_y scale_out)rrr attrssumadd_nradd_position_encodingaddmmInput)inputrr]AlphaBeta)alphabetaaffine_channelScaleBias)rscalebias affine_gridrjThetaoutputOutput output_shapeint OutputShape)rrr int_array reduce_allalldimkeep_dim)axiskeepdimallcloseOtherz std::stringRtolAtol)rtolatol reduce_amaxamax reduce_aminaminanchor_generatorAnchors Variances)anchors variances_outangle reduce_anyanyrangearangeStartEndStep)startendstepdoubleTrue)rKsupport_tensorarg_maxargmaxrint64_targ_minargminargsort)rr tensor_array_to_tensorarray_to_tensorOutIndex)r out_index as_complexas_realasinasinhassertCondData)conddata)rrassign assign_pos assign_value)rr atanatan2X1X2atanhattention_lstmC0H0AttentionWeight AttentionBiasAttentionScalarAttentionScalarBias LSTMWeightLSTMBias) rc0h0attention_weightattention_biasattention_scalarattention_scalar_bias lstm_weight lstm_biasHiddenCell AttentionedXAttentionFCOutLSTMXLSTMOUT)hiddencell attentioned_xattention_fc_outlstm_xlstm_outaucPredictStatPosStatNeg InsTagWeight)rrstat_posstat_negins_tag_weightAUC StatPosOut StatNegOut)r stat_pos_out stat_neg_outbaddbmmbarrierbatch_fcW)rjwrs batch_normMeanVariance)rmeanvariancerrrsMeanOut VarianceOut SavedMean SavedVariance ReserveSpace)rmean_out variance_out saved_meansaved_variance reserve_space data_format data_layoutbce_loss)rjrbeam_search_decodeIdsScores)idsscores SentenceIdsSentenceScores) sentence_idssentence_scores bernoullibicubic_interp_v2bicubic_interpOutSize SizeTensor)rout_size size_tensor scale_tensorbilinear_tensor_productbilinearWeight)rr]weightrsbilinear_interp_v2bilinear_interpbincountWeights)rweights minlengthbipartite_matchdist_matDistMatColToRowMatchIndicesColToRowMatchDist)col_to_row_match_indicescol_to_row_match_dist bitwise_and bitwise_not bitwise_or bitwise_xorbmm bn_act_xpu)rrd box_coderPriorBox PriorBoxVar TargetBox) prior_box prior_box_var target_box output_box OutputBoxbroadcast_tensorsc_concat c_embedding)rrc_softmax_with_cross_entropyLogits)logitsrSoftmaxLoss)softmaxlossc_splitcastceilcelucheck_finite_and_unscalecheck_finite_and_unscale_)rrr FoundInfinite)rfound_infinitecholeskycholesky_solveclass_center_sampler RemappedLabelSampledLocalClassCenter)remapped_labelsampled_local_class_centerclipMinMax)minmax clip_by_normcoalesce_tensor FusedOutput)rv fused_output size_of_dtypeuser_defined_size_of_dtypecollect_fpn_proposalsMultiLevelRoisMultiLevelScoresMultiLevelRoIsNum)multi_level_roismulti_level_scoresmulti_level_rois_numFpnRoisRoisNum)fpn_roisrois_num post_nms_topn post_nms_topNcomplex)realimagconcat AxisTensor)rrr rdrRconditional_blockrconjconv2dFilter)rjfilterconv2d_transpose)rrfrs output_sizeconv2d_transpose_biasconv3dconv3d_transpose)rrf correlationInput1Input2)input1input2coscosh crop_tensorcropShape ShapeTensor)rKrL tensors_nameOffsets OffsetsTensor)shapeoffsetscrosssoftmax_with_cross_entropycross_entropy_with_softmaxcumprodcumsumcvmCVM)rr data_norm decode_jpegdeformable_convOffsetMask)roffsetrfmaskdepthwise_conv2dScale_inScale_in_eltwise Scale_weights)scale_inrcscale_in_eltwise scale_weightsdepthwise_conv2d_transpose dequantizeShift)rrshiftdequantize_abs_maxdequantize_linear ZeroPointInAccumInState)rrr zero_pointin_accumin_stateOutScaleOutAccumOutState)r] out_scale out_accum out_statedequantize_logDict)rdict determinantdetdgc_clip_by_norm dgc_momentumVelocity current_stepnranks)rrvelocityr"r#current_step_tensor nranks_tensor VelocityOutGrad_out)r( velocity_outr+grad_outdiag_v2diag diag_embeddiagonaldigamma dirichletrmdist div_scale ScaleTensorFalse)rrrselementwise_divdividedotdropoutSeed)r seed_tensor)rr dropout_probis_testdropout_implementationseedfix_seed)prmoderrrr dropout_nd edit_distanceHypsRefs HypsLength RefsLength)hypsrefs hypslength refslength SequenceNum) sequencenumreig Eigenvalues Eigenvectors)out_wout_veigheigvalseigvalsh) eigenvalues eigenvectorsuploUPLOeinsumOperands InnerCacheXShape)r inner_cachexshapeelementwise_powelulookup_table_v2 embedding)rrsparse is_sparseemptyrzShapeTensorList)rr r{equal equal_allerferfinvexp expand_v2expandexpand_shapes_tensor)rrr rdr{ expand_as_v2 expand_asexpm1 exponential exponential_lamlambdaeye)num_rows num_columns)rr rR$fake_channel_wise_dequantize_max_absScales)rscales"fake_channel_wise_quantize_abs_max)rr-fake_channel_wise_quantize_dequantize_abs_maxfake_dequantize_max_absfake_quantize_abs_max fake_quantize_dequantize_abs_max/fake_quantize_dequantize_moving_average_abs_maxInScale)rin_scalerr)rrrr$fake_quantize_moving_average_abs_maxfake_quantize_range_abs_maxIter)rr iter OutScales)rr out_scalesfaster_tokenizerVocabTextTextPair)vocabtext text_pairInputIds SegmentIds) input_ids segment_idsfc)rrcrfeed fetch_barrierfft_c2cfft_c2rfft_r2cfill_anyfillvalue fill_diagonalfill_diagonal_tensorflash_attn_unpadded) max_seqlen_q max_seqlen_k)rrRflash_attn_v3_varlenflash_attn_varlen_qkvpackedflatten_contiguous_rangeflatten)rr start_axis stop_axis)r1r2flipfloorelementwise_floordiv floor_divideelementwise_fmaxfmaxelementwise_fminfminfoldframefrobenius_norm fill_constantfull fill_any_like full_likefull_with_tensor)rr{ fused_adam fused_adam_ParamsGradsMoments1Moments2 Moments2Max Beta1Pows Beta2Pows MasterParams) paramsgradsr"moments1moments2 moments2_max beta1_pows beta2_pows master_paramsr> ParamsOut Moments1Out Moments2OutMoments2MaxOut Beta1PowsOut Beta2PowsOutMasterParamsOut) params_out moments1_out moments2_outmoments2_max_outbeta1_pows_outbeta2_pows_outmaster_params_outfused_attentionLnScaleLnBiasQKVWQKVBiasCacheKVSrcMask OutLinearW OutLinearBiasLn2ScaleLn2Bias) rln_scaleln_bias qkv_weightqkv_biascache_kvsrc_maskout_linear_weightout_linear_bias ln_scale_2 ln_bias_2ln_meanLnMeanln_var LnVarianceln_outLnOutqkv_outQKVOut qkv_bias_out QKVBiasOuttranspose_out_2 TransposeOut2qk_outQKOutqktv_outQKTVOut softmax_out SoftmaxOutattn_dropout_mask_outAttnDropoutMaskOutattn_dropout_outAttnDropoutOut src_mask_out SrcMaskOutfmha_outFMHAOutout_linear_out OutLinearOutdropout_mask_outDropoutMaskOut ln_mean_2Ln2Meanln_var_2 Ln2VarianceBiasDropoutResidualOut CacheKVOut)bias_dropout_residual_out cache_kv_outrfused_batch_norm_act&fused_bias_dropout_residual_layer_normResidual)rresidualrsrnro)rrrx ln_variancer]fused_bn_add_activationfused_bn_add_activation_Z)rzrrrrrs fused_conv2d ResidualData)rjrfrsresidual_paramfused_conv2d_add_act)rjrfrs residual_dataOutputs)rvr fused_conv3dfused_elementwise_addfused_elementwise_divfused_elementwise_mulfused_elementwise_sub!fused_embedding_eltwise_layernormEmbs)rembsrsrrfused_embedding_fc_lstm EmbeddingsWeightH)r embeddingsweight_hrsrrXX BatchedInput BatchedHidden BatchedCell ReorderedH0 ReorderedC0)rrxx batched_inputbatched_hidden batched_cell reordered_h0 reordered_c0fused_fc_elementwise_layernormBias0Bias1)rrr]bias0rrbias1)rrrfused_feedforward Dropout1Seed Dropout2Seed Linear1Weight Linear1Bias Linear2Weight Linear2BiasLn1ScaleLn1Bias) r dropout1_seed dropout2_seedlinear1_weight linear1_biaslinear2_weight linear2_bias ln1_scaleln1_bias ln2_scaleln2_bias Dropout1Mask Dropout2MaskLn1Mean Ln1Variance Linear1OutLn1Out Dropout1Out Dropout2Out) r dropout1_mask dropout2_maskln1_mean ln1_varianceln2_mean ln2_variance linear1_outln1_out dropout1_out dropout2_outrr dropout1_rate dropout2_rate)dropout1_seed_valdropout2_seed_val dropout1_prob dropout2_probfused_gate_attentionQueryKey QueryWeight KeyWeight ValueWeight QKVWeightNonbatchedBias GateWeightGateBiasOutLinearWeight) querykey query_weight key_weight value_weightrpnonbatched_biasrs gate_weight gate_biasrtruQueryTransposeOutKeyTransposeOutValueTransposeOutQKVTransposeOut SoftmaxLseGateOut) query_transpose_outkey_transpose_outvalue_transpose_outqkv_transpose_outr softmax_lsergate_outrfused_gemm_epilogue)rr]rs)rrfused_gemm_epilogue_gradDOut)rr]rout_gradDXDYDBias)x_grady_grad bias_gradfused_multi_transformer_int8rnroqkv_wrqrr time_stepTimeSteprs out_linear_wru ffn_ln_scale FFNLnScale ffn_ln_bias FFNLnBias ffn1_weight FFN1Weight ffn1_biasFFN1Bias ffn2_weight FFN2Weight ffn2_biasFFN2Bias qkv_out_scale QKVOutScaleOutLinearOutScale FFN1OutScale FFN2OutScale)out_linear_out_scaleffn1_out_scaleffn2_out_scale)rrfused_seqpool_cvmfused_transpose fusion_gruWeightX)rrweight_xrrs BatchedOut)rrr batched_outr Scale_data Shift_data) scale_data shift_datar fusion_lstm)rrr<rrsr CheckedCell) rrrrrrrrr checked_cellfusion_repeated_fc_relu)rrrsReluOut)relu_outrfusion_seqconv_eltadd_reluColMat)rcol_mat contextLength contextStart contextStride)context_length context_startcontext_stridefusion_seqpool_concatfusion_transpose_flatten_concatgatherIndex)rindexAxis gather_nd gather_treeParents)rparentsgaussian_randomgaussiangelugenerate_proposals_v2generate_proposals BboxDeltasImShape)r bbox_deltasim_shaper variancesRpnRois RpnRoiProbs RpnRoisNum)rpn_rois rpn_roi_probs rpn_rois_num pre_nms_topN) pre_nms_top_npost_nms_top_n global_gatherglobal_scattergrad_addgraph_khop_samplerRowCol_PtrEids)rowcolptrreidsOut_SrcOut_Dst Sample_Index Reindex_XOut_Eids)out_srcout_dst sample_index reindex_xout_eidsgraph_sample_neighbors Perm_Buffer)rvrwrrx perm_buffer Out_Count)r out_countr greater_equal greater_than grid_sampler grid_sampleGrid)rgrid group_norm)r]rrgumbel_softmax hard_shrink hardshrink hard_sigmoid hardsigmoid hard_swish hardswishbreluhardtanhhash runtime_shape&ALL_KERNELS_MUST_COMPUTE_RUNTIME_SHAPEelementwise_heaviside heaviside hinge_lossLabels)r1labelsr5 histogram)rjrhierarchical_sigmoid hsigmoid_loss PathTablePathCode)rrrrspathcodePreOutW_Out)rpre_outw_out huber_loss)rr im2sequencer_ increment index_addAddValue)rrV add_valueindex_elementwise_getrV input_dims input_strides index_dims index_stride)rrVrrrr slice_offset accumulate is_combined)rrrindex_elementwise_put!index_elementwise_put_with_tensor index_sample index_select instance_norm)r]rrinverseis_emptyisclose isfinite_v2isfiniteisinf_v2isinfisnan_v2isnan kldiv_lossTarget)rrkronkthvaluel1_norm label_smooth PriorDist)r prior_distlamblamb_) rrr"r9r:r<r=r#r>)r(rDrErGrHmaster_param_outs layer_norm leaky_relunegative_slopelegacy_bilinear_interp legacy_expand expand_times ExpandTimesexpand_times_tensorlegacy_generate_proposalsImInfo)rrcim_inforrematmul legacy_matmulDDXDDY)rr]r x_grad_grad y_grad_grad)rrr transpose_X transpose_Y) transpose_x transpose_ynearest_interplegacy_nearest_interpreshapelegacy_reshapelerp)rr]r less_equal less_thanlgammalinear_interp_v2 linear_interp linear_v2linspaceStopNum)rstopnumber lod_resetloglog10log1plog2log_loss Predicted log_softmax logcumsumexp logical_and logical_not logical_or logical_xorlogit logsigmoid logsumexp lookup_table)rrlrnMidOut)rmid_outlstsqSolution ResidualsRankSingularValues)solution residualsranksingular_valuesrcond lu_unpackPivotsPmatLU)pmatlumargin_cross_entropy masked_select)rrmatch_matrix_tensor)rr]rTmp)rtmp matmul_v2trans_xtrans_ymulmatmul_with_flatten matrix_nmsBBoxes)bboxesr)rrVroisnum matrix_power matrix_rank TolTensor)r tol_tensor reduce_maxrImax_pool2d_with_index kernel_sizeksizemax_pool3d_with_indexelementwise_maxmaximummaxout reduce_meanrmean_allmemory_efficient_attentionmerge_selected_rows merged_adam_) rrr"r9r:r;r<r=r#merged_momentummerged_momentum_)rrrr"r#)r(rr+meshgrid reduce_minrHelementwise_minminimummish threshold)rrrmomentum momentum_moving_average_abs_max_scale)rrr multi_dot multi_gru)rr<rrsrr)rArBmulticlass_nmsmulticlass_nms3)r)rrZ NmsRoisNum)rrV nms_rois_nummultihead_matmulBiasQK)rjrrsbias_qk transpose_Q transpose_K transpose_V) transpose_q transpose_k transpose_v multinomial num_samples multiplex)rrVelementwise_mulmultiplymvVec)rvec nanmedian MedianIndex)rmediansrKnearest_interp_v2nll_loss)rjrr Total_weight)r total_weightnmsBoxes KeepBoxesIdxs iou_threshold where_indexnonzero condition ConditionnormNorm)rrm not_equalsizenumel one_hot_v2one_hotdepth depth_tensor overlap_addp_normpad pad_valuepad2dpad3dpaddingsPaddingspartial_allgatherpartial_concat partial_recv partial_sum pixel_shufflepixel_unshufflepoissonpool2dpool3dpowr]factor FactorTensorprelu)rrmprintinInr'Image)rjimage)rvar reduce_prodprod psroi_poolROIs)rboxes boxes_numput_along_axisValue)arrr valuesResultReduce Include_self)rreduce include_selfpylayerqrQR)qrquantize)rrrrquantize_linearrandintrandpermrange_v2r^ reciprocalrelurelu6elementwise_mod remainderrenormrepeat_interleaveRepeats)repeatsr#repeat_interleave_with_tensor_index RepeatTensor)rr requantizeShift_in Shift_out)rrcshift_in shift_outreshape2resnet_basic_blockfilter1Filter1scale1Scale1rmean1Mean1var1Var1filter2Filter2scale2Scale2bias2Bias2mean2Mean2var2Var2filter3Filter3scale3Scale3bias3Bias3mean3Mean3var3Var3conv1Conv1 saved_mean1 SavedMean1 saved_invstd1 SavedInvstd1 mean1_outMean1Outvar1_outVar1Outconv2Conv2 conv2_input Conv2Input saved_mean2 SavedMean2 saved_invstd2 SavedInvstd2 mean2_outMean2Outvar2_outVar2Outconv3Conv3 saved_mean3 SavedMean3 saved_invstd3 SavedInvstd3 mean3_outMean3Outvar3_outVar3Out MaxInput1 MaxFilter1 MaxInput2 MaxFilter2 MaxInput3 MaxFilter3) max_input1 max_filter1 max_input2 max_filter2 max_input3 max_filter3 resnet_unitFilterXScaleXBiasXMeanXVarXFilterZScaleZBiasZMeanZVarZ) rfilter_xrabias_xmean_xvar_xrfilter_zscale_zbias_zmean_zvar_zBitMaskConvX SavedMeanX SavedInvstdX RunningMeanX RunningVarXConvZ SavedMeanZ SavedInvstdZ RunningMeanZ RunningVarZ) rbit_maskconv_x saved_mean_xsaved_invstd_xrunning_mean_x running_var_xconv_z saved_mean_zsaved_invstd_zrunning_mean_z running_var_zreversermsproprmsprop_ MeanSquareMeanGrad)r mean_square mean_gradr"rr/r# MeanSquareOut MeanGradOut)r(r)mean_square_out mean_grad_outrrnnPreState WeightListSequenceLength)r pre_state weight_listsequence_length DropoutStateStateReserve)rdropout_state_outstatereserve roi_alignroi_poolArgmax)rrrollshifts ShiftsTensorroundrow_convrsqrt save_combinerrscatterUpdates)rrVupdatesscatter_nd_add searchsortedSortedSequenceValues)sorted_sequencer segment_pool)rr SummedIds)r summed_idsself_dp_attentionselugraph_send_recv send_u_recv Src_index Dst_index)r src_index dst_index Dst_count)r dst_countr Out_sizegraph_send_ue_recv send_ue_recv)rr]rbrc graph_send_uvsend_uvsequence_expand sequence_maskmax_lenmaxlen MaxLenTensorsequence_softmaxsgdsgd_)rr"rr#)r(r+ shard_index share_bufferXOut)rxout share_data share_data_ shuffle_batch)rr ShuffleIdxSeedOut)r shuffle_idxseed_outshuffle_channelgroup)rrsigmoidsignsilusinsinhslice StartsTensorStartsTensorList EndsTensorEndsTensorList)startsendsslogdeterminantslogdet soft_relur4softplus softshrinksoftsignsolvesparse_batch_normsparse_reshape sparse_slice sparse_sumsparse_sync_batch_norm spectral_normV)rrvsplitsections)rrr rRr{split_with_num)rKrrLsqrtsquaresqueeze2squeezeaxesstackstanhstraight_through_estimator_grad strided_slice StridesTensorStridesTensorList)rrstrideselementwise_subsubtract reduce_sum out_dtype)rrdtypesvdSVH)rsvhswishsync_batch_norm)rrrrsrrtake_along_axis)rr tantanh tanh_shrink tdm_childTreeInfo child_numsr)r tree_inforrChildLeafMask)child leaf_mask tdm_samplerTravelLayer)rtravellayer)rrrthresholded_relutile repeat_times RepeatTimesrepeat_times_tensortop_k_v2topkkKtop_ktopk_v1trace transpose2 transposepermtriangular_solve tril_triutrilinear_interp_v2trilinear_interptrunctruncated_gaussian_randomunbindunfolduniform_randomuniform)rr rRr{uniform_random_inplaceuniform_inplaceuniqueCounts)rr rcountsunique_consecutive)rrVrunpool)rr paddingunpool3d unsqueeze2 unsqueeze AxesTensorAxesTensorListunstackupdate_loss_scalingupdate_loss_scaling_PrevLossScaling InGoodSteps InBadSteps)rr=prev_loss_scaling in_good_steps in_bad_steps LossScaling OutGoodSteps OutBadSteps)r loss_scalingout_good_steps out_bad_steps stop_updatebool StopUpdate view_shapeviterbi_decode TransitionLength) potentialstransition_paramslengthsPath)rrwarpctc LogitsLength LabelLength)r1r logits_length labels_length WarpCTCGrad) warpctcgradr5where)rkrr]whileyolo_boxImgSize)rimg_size)rr yolo_box_head yolo_box_postBoxes0Boxes1Boxes2 ImageShape ImageScale)boxes0boxes1boxes2 image_shape image_scale)rrL yolov3_loss yolo_lossGTBoxGTLabelGTScore)rgt_boxgt_labelgt_scoreObjectnessMask GTMatchMask)r5objectness_mask gt_match_maskbox_clip)rjrc_allreduce_sum c_identity c_scatterchannel_shuffle chunk_eval Inference SeqLength) inferencer seq_length PrecisionRecallzF1-ScoreNumInferChunksNumLabelChunksNumCorrectChunks) precisionrecallf1_scorenum_infer_chunksnum_label_chunksnum_correct_chunks comm_init_all crf_decodingEmission)emission transitionrlength viterbi_path ViterbiPath cross_entropycross_entropy2MatchX)rx_shapematch_x ctc_align InputLength)rj input_length OutputLength)rv output_length cudnn_lstmInitHInitC)rinit_hinit_crr?r@StateOutLastHLastC)rF state_outrlast_hlast_cdecayed_adagrad)rrr/r")r(r)dependDep)rdepdgc)rrrrU_outV_out EncodeGrad GatherBuff)u_outv_out encode_gradr gather_buffdistribute_fpn_proposals MultiFpnRois RestoreIndex)multi_fpn_roisrV restore_indexdistributed_fused_lamb_init)rrfp32_fused_paramFP32FusedParamfp32_fused_grad FP32FusedGradfp16_fused_paramFP16FusedParamfp16_fused_grad FP16FusedGradr9r:r<r=fused_param_offsetsFusedParamOffsetsfp32_shard_fused_param_offsetsFP32ShardFusedParamOffsetsfp16_shard_fused_param_offsetsFP16ShardFusedParamOffsets param_info ParamInfo param_order ParamOrderr(r+rGradOut global_scale GlobalScalerdpsgd)rrr"fetch_v2fetchflatten2)rrKftrlSquaredAccumulatorLinearAccumulator)rsquared_accumulatorlinear_accumulatorrr"SquaredAccumOutLinearAccumOut)r(squared_accum_outlinear_accum_outfill_constant_batch_size_likefull_batch_size_likefused_elemwise_activationIntermediateOut)rintermediate_outfused_elemwise_add_activation fused_matmul)rr]rfused_reshape_Xfused_transpose_Xfused_reshape_Yfused_transpose_Yfused_reshape_Outfused_transpose_Out) rarbrcrfused_reshape_xfused_transpose_xfused_reshape_yfused_transpose_yfused_reshape_outfused_transpose_outfused_softmax_maskfused_softplusfused_token_pruneAttnNewMask)attnrrnew_maskSlimmedXCLSInds) slimmed_xcls_inds fusion_groupInputsoutsOutsfusion_seqpool_cvm_concatfusion_squared_mat_subSquaredXSquaredY SquaredXY) squared_x squared_y squared_xyrget_tensor_from_selected_rowsgru)rjrrrs BatchGateBatchResetHiddenPrev BatchHidden) batch_gatebatch_reset_hidden_prev batch_hiddenrgru_unit HiddenPrev)rj hidden_prevrrsGateResetHiddenPrev)gatereset_hidden_prevr identity_loss lars_momentumlars_momentum_ legacy_cropr{limit_by_capacitylod_array_lengthlogspaceBase)rrnumbaselookup_table_dequantlstm)rjrrrrsBatchCellPreAct)rrrbatch_cell_pre_actluInfos)rpivotsinfospivotrmemcpy memcpy_d2hmp_allreduce_sumnce SampleWeightCustomDistProbsCustomDistAliasCustomDistAliasProbs)rjrrrs sample_weightcustom_dist_probscustom_dist_aliascustom_dist_alias_probsCost SampleLogits SampleLabels)cost sample_logits sample_labelsnop number_countnumbers partial_sendprune_gate_by_capacityGateIdx ExpertCount)gate_idx expert_count out_gate_idx NewGateIdx pyramid_hash WhiteList BlackList)rr white_list black_listDropPos X_Temp_Out)rdrop_pos x_temp_outrandom_routingProb TopK_ValueTopK_Idx)prob topk_valuetopk_idxrank_attention RankOffset RankParam)r rank_offset rank_param InputHelpInsRank) input_helprins_rankMaxRankMaxSize)max_rankmax_sizeread_from_arrayI)arrayirecv_v2 graph_reindex reindex_graph NeighborsCountHashTable_ValueHashTable_Index)r neighborscounthashtable_valuehashtable_index Reindex_Src Reindex_Dst Out_Nodes) reindex_src reindex_dst out_nodesrreluNoise)rnoisesend_v2 sequence_conv PaddingData)r padding_datarfpaddingTrainable)padding_trainablerOrPrQ sequence_poolMaxIndex)r max_index set_value)rKrwStepsTensorList)rrstepsset_value_with_tensor!sigmoid_cross_entropy_with_logitsskip_layernorm)rr]rrrssparse_attentionColumnsKeyPaddingMaskAttnMask)rrrrcolumnskey_padding_mask attn_mask SparseDotSdd)rsparse_dot_sddr4sparse_momentum)rrrrVrr"r#squared_l2_normstftWindow)rwindowsync_calc_streamsync_comm_streamtemporal_shifttransfer_layoutuniform_random_batch_size_likewrite_to_array)rr) r<r=r>r?rHrIrJc_sync_calc_streamc_sync_comm_streamrOrPrQrRzTensor xz Tensor(out))argsrvz&Tensor x, Tensor indices, Tensor labelz0Tensor(accuracy), Tensor(correct), Tensor(total)accuracy_checkzZTensor x, Tensor y, str fn_name, double rtol=1e-5, double atol=1e-8, bool equal_nan=falsezTensor param, Tensor grad, Tensor avg_squared_grad, Tensor avg_squared_update, Tensor learning_rate, Tensor master_param, float rho = 0.95f, float epsilon = 1.0e-6f, bool multi_precision = falsezUTensor(param_out), Tensor(moment_out), Tensor(inf_norm_out), Tensor(master_param_out)zTensor param, Tensor grad, Tensor moment, Tensor learning_rate, Tensor master_param, float epsilon = 1.0e-6f, bool multi_precision = falsez?Tensor(param_out), Tensor(moment_out), Tensor(master_param_out)aTensor param, Tensor grad, Tensor learning_rate, Tensor moment1, Tensor moment2, Tensor moment2_max, Tensor beta1_pow, Tensor beta2_pow, Tensor master_param, Tensor skip_update, Scalar beta1 = 0.9f, Scalar beta2 = 0.999f, Scalar epsilon = 1.0e-8f, bool lazy_mode = false, int64_t min_row_size_to_use_multithread = 1000, bool multi_precision = false, bool use_global_beta_pow = false, bool amsgrad = falsezTensor(param_out), Tensor(moment1_out), Tensor(moment2_out), Tensor(moment2_max_out), Tensor(beta1_pow_out), Tensor(beta2_pow_out), Tensor(master_param_out)zTensor param, Tensor grad, Tensor learning_rate, Tensor moment, Tensor inf_norm, Tensor beta1_pow, Tensor master_param, float beta1 = 0.9f, float beta2 = 0.999f, float epsilon = 1.0e-8f, bool multi_precision = falseaTensor param, Tensor grad, Tensor learning_rate, Tensor moment1, Tensor moment2, Tensor moment2_max, Tensor beta1_pow, Tensor beta2_pow, Tensor master_param, Tensor skip_update, Scalar beta1 = 0.9f, Scalar beta2 = 0.999f, Scalar epsilon = 1.0e-8f, float lr_ratio = 1.0f, float coeff = 0.01f, bool with_decay = false, bool lazy_mode = false, int64_t min_row_size_to_use_multithread = 1000, bool multi_precision = false, bool use_global_beta_pow = false, bool amsgrad = falsez/Tensor x, float alpha = 1.0f, float beta = 1.0fz Tensor (out)zATensor input, Tensor x, Tensor y, float beta=1.0, float alpha=1.0zBTensor x, Tensor scale, Tensor bias, str data_layout = "AnyLayout"z?Tensor input, IntArray output_shape={}, bool align_corners=truezTensor(output)z/Tensor x, int64_t[] axis={}, bool keepdim=false all_gatherz'Tensor x, int ring_id = 0, int nranks=0 all_reducez.Tensor x, int ring_id = 0, int reduce_type = 0 all_to_allzTensor x, int ring_id = 0z\Tensor x, Tensor y, Scalar(double) rtol=1e-5, Scalar(double) atol=1e-8, bool equal_nan=falseTensor ap_facadezTensor[] xs, int64_t num_outputs, str custom_op_name, str infer_meta_func_name, str infer_symbolic_func_name, str serialized_attributeszTensor[](out){num_outputs}ap_trivial_fusion_beginz Tensor[] xsap_trivial_fusion_end ap_variadiczTensor[] xs, int num_outputs, str code_module_lambda, str infer_symbolic_lambda, str infer_meta_lambda, str rnel_dispatch_lambda, str kernel_dispatch_const_data_lambdaapply_per_channel_scalezTensor x, Tensor scaleszmTensor x, Scalar(int64_t) axis, bool keepdims = false, bool flatten = false, DataType dtype = DataType::INT64z?Tensor x, int axis=-1, bool descending=false, bool stable=falsezTensor(out), Tensor(indices) as_stridedzLTensor input, int64_t[] dims = {}, int64_t[] stride = {}, int64_t offset = 0asgd_z~Tensor param, Tensor grad, Tensor learning_rate, Tensor d, Tensor y, Tensor n, Tensor master_param, bool multi_precision=falsezITensor(param_out), Tensor(d_out), Tensor(y_out), Tensor(master_param_out) assign_out_zTensor x, Tensor outputz.Tensor x, Tensor cum_count, Tensor eff_num_len assign_value_zMTensor output, int[] shape, DataType dtype, Scalar[] values, Place place = {}zTensor x, Tensor ya Tensor x, Tensor c0, Tensor h0, Tensor attention_weight, Tensor attention_bias, Tensor attention_scalar, Tensor attention_scalar_bias, Tensor lstm_weight, Tensor lstm_bias, str gate_activation = "sigmoid", str cell_activation = "tanh", str candidate_activation = "tanh"zuTensor (hidden), Tensor (cell), Tensor (attentioned_x), Tensor (attention_fc_out), Tensor (lstm_x), Tensor (lstm_out)zTensor x, Tensor label, Tensor stat_pos, Tensor stat_neg, Tensor ins_tag_weight, str curve = "ROC", int num_thresholds = (2 << 12) - 1, int slide_steps = 1z7Tensor(auc), Tensor(stat_pos_out), Tensor(stat_neg_out)average_accumulates_zTensor param, Tensor in_sum_1, Tensor in_sum_2, Tensor in_sum_3, Tensor in_num_accumulates, Tensor in_old_num_accumulates, Tensor in_num_updates, float average_window = 0, int64_t max_average_window = INT64_MAX, int64_t min_average_window = 10000LzTensor(out_sum_1), Tensor(out_sum_2), Tensor(out_sum_3), Tensor(out_num_accumulates), Tensor(out_old_num_accumulates), Tensor(out_num_updates)zTensor x, int ring_id=0z#Tensor input, Tensor w, Tensor biaszTensor input, Tensor label beam_searchz~Tensor pre_ids, Tensor pre_scores, Tensor ids, Tensor scores, int level, int beam_size, int end_id, bool is_accumulated = truezDTensor (selected_ids), Tensor (selected_scores), Tensor (parent_idx)zTensor x, Tensor out_size, Tensor[] size_tensor, Tensor scale_tensor, str data_format="NCHW", int out_d=0, int out_h=0, int out_w=0, double[] scale={}, str interp_method="bilinear", bool align_corners=true, int align_mode=1z.Tensor x, Tensor y, Tensor weight, Tensor biasz3Tensor x, Tensor weights, Scalar(int) minlength = 0binomialzTensor count, Tensor probzITensor dist_mat, str match_type = "bipartite", float dist_threshold = 0.5zATensor (col_to_row_match_indices), Tensor (col_to_row_match_dist)bitwise_left_shiftz-Tensor x, Tensor y, bool is_arithmetic = truebitwise_right_shiftzTensor input, Tensor im_infozTensor (output)zTensor prior_box, Tensor prior_box_var, Tensor target_box, str code_type = "encode_center_size", bool box_normalized = true, int axis = 0, float[] variance = {}zTensor(output_box) broadcastz'Tensor x, int ring_id = 0, int root = 0zTensor[] inputzTensor[]{input.size()}"build_src_rank_and_local_expert_idzWTensor expert_num_global_tensor, int64_t[] expert_num_global, int64_t num_local_expertsz'Tensor(vector), Tensor(local_expert_id)zDTensor x, int ring_id, bool use_calc_stream, bool use_model_parallelzZTensor x, int rank, int nranks, int ring_id, bool use_calc_stream, bool use_model_parallelzUTensor x, int ring_id = 0, int root = 0, int nranks = 0, bool use_calc_stream = falsez`Tensor logits, Tensor label, int64_t ignore_index=-100, int ring_id=0, int rank=0, int nranks=0zTensor(softmax), Tensor(loss)zWTensor x, int rank = 0, int nranks = 1, int ring_id = 0, bool use_model_parallel = true cal_aux_losszTensor gate_prob, Tensor dispatch_mask, Tensor tokens_mask, Tensor dispatch_tokens_mask, int64_t num_experts, bool use_group, int64_t moe_k, float clip_minz4Tensor(l_aux_loss), Tensor(seqlen_float), Tensor(ce)calc_reduced_attn_scoresz&Tensor q, Tensor k, Tensor softmax_lsezTensor(reduced_scores)zTensor x, DataType dtypezTensor x, float alpha = 1.0z,Tensor x, int groups, str data_format="NCHW"zTensor[] x, Tensor scalez/Tensor[](out){x.size()}, Tensor(found_infinite)check_numericszTensor tensor, str op_type = "", str var_name = "", int check_nan_inf_level = 0, int stack_height_limit = -1, str output_dir = ""zTensor(stats), Tensor(values)zTensor x, bool upper=falsez$Tensor x, Tensor y, bool upper=falsezTensor label, int num_classes, int num_samples, int ring_id = 0, int rank = 0, int nranks = 1, bool fix_seed = false, int seed = 0z:Tensor(remapped_label), Tensor(sampled_local_class_center)z.Tensor x, Scalar(float) min, Scalar(float) maxzTensor x, float max_normaTensor[] input, DataType dtype, bool copy_data = false, bool set_constant = false, bool persist_output = false, float constant = 0.0, bool use_align = true, int align_size = -1, int size_of_dtype = -1, int64_t[] concated_shapes = {}, int64_t[] concated_ranks = {}z4Tensor[](output){input.size()}, Tensor(fused_output)zhTensor[] multi_level_rois, Tensor[] multi_level_scores, Tensor[] multi_level_rois_num, int post_nms_topnz$Tensor (fpn_rois), Tensor (rois_num)zTensor real, Tensor imagzTensor[] x, Scalar axis=0zTensor input, Tensor filter, int[] strides={1, 1}, int[] paddings={0, 0}, str padding_algorithm="EXPLICIT", int[] dilations={1, 1}, int groups=1, str data_format="NCHW"zTensor x, Tensor filter, int[] strides={1, 1}, int[] paddings={0, 0}, int[] output_padding={}, IntArray output_size={}, str padding_algorithm="EXPLICIT", int groups=1, int[] dilations={1, 1}, str data_format="NCHW"zTensor x, Tensor filter, Tensor bias, int[] strides={1, 1}, int[] paddings={0, 0}, int[] output_padding={}, IntArray output_size={}, str padding_algorithm="EXPLICIT", int groups=1, int[] dilations={1, 1}, str data_format="NCHW"zTensor input, Tensor filter, int[] strides={1, 1, 1}, int[] paddings={0, 0, 0}, str padding_algorithm="EXPLICIT", int groups=1, int[] dilations={1, 1, 1}, str data_format="NCDHW"zTensor x, Tensor filter, int[] strides={1, 1, 1}, int[] paddings={0, 0, 0}, int[] output_padding={}, int[] output_size={}, str padding_algorithm="EXPLICIT", int groups=1, int[] dilations={1, 1, 1}, str data_format="NCHW"copy_toz$Tensor x, Place place, bool blockingcopysignzTensor input1, Tensor input2, int pad_size, int kernel_size, int max_displacement, int stride1, int stride2, int corr_type_multiply=1z?Tensor emission, Tensor transition, Tensor label, Tensor lengthzTensor (viterbi_path)z4Tensor x, IntArray shape = {}, IntArray offsets = {}z Tensor x, Tensor y, int axis = 9zTensor input, Tensor label, bool soft_label=false, bool use_softmax=true, bool numeric_stable_mode=true, int ignore_index=-100, int axis=-1)cross_entropy_with_softmax_bwd_w_downcastz.Tensor label, Tensor softmax, Tensor loss_gradzTensor(input_grad)zcTensor input, Tensor input_length, int blank = 0, bool merge_repeated = true, int padding_value = 0z'Tensor (output), Tensor (output_length)zTensor x, Tensor init_h, Tensor init_c, Tensor w, Tensor[] weight_list, Tensor sequence_length, float dropout_prob = 0.0, bool is_bidirec = false, int hidden_size = 100, int num_layers = 1, bool is_test = false, int seed = 0zTTensor (out), Tensor (last_h), Tensor (last_c), Tensor (reserve), Tensor (state_out)cummaxz7Tensor x, int axis=-1, DataType dtype = DataType::INT64cumminzTensor value, IntArray shape, DataType dtype=DataType::FLOAT32znTensor x, Tensor scale, Tensor bias, Tensor mean, Tensor variance, float momentum, float epsilon, str act_typezvTensor(out), Tensor(mean_out), Tensor(variance_out), Tensor(saved_mean), Tensor(saved_variance), Tensor(reserve_space)zxTensor x, Tensor z, Tensor scale, Tensor bias, Tensor mean, Tensor variance, float momentum, float epsilon, str act_typefused_rms_norm_quantzTensor x, Tensor bias, Tensor residual, Tensor norm_weight, Tensor norm_bias, float epsilon, int begin_norm_axis, float quant_scale, int quant_round_type, float quant_max_bound, float quant_min_boundz2Tensor(out), Tensor(residual_out), Tensor(inv_var)zTensor x, Tensor mask!fused_softmax_mask_upper_trianglezTensor Xz Tensor(Out) gammainccgammalnz%Tensor x, Tensor index, Scalar axis=0zTensor x, Tensor indexzTensor ids, Tensor parentszOIntArray shape, float mean, float std, int seed, DataType dtype, Place place={}gaussian_inplacez1Tensor x, float mean=0, float std=1.0, int seed=0z#Tensor x, bool approximate = falsezTensor scores, Tensor bbox_deltas, Tensor im_shape, Tensor anchors, Tensor variances, int pre_nms_top_n, int post_nms_top_n, float nms_thresh, float min_size, float eta, bool pixel_offset=truez=Tensor(rpn_rois), Tensor(rpn_roi_probs), Tensor(rpn_rois_num)zBTensor x, Tensor local_count, Tensor global_count, int ring_id = 0zVTensor row, Tensor colptr, Tensor x, Tensor eids, int[] sample_sizes, bool return_eidsz[Tensor(out_src), Tensor(out_dst), Tensor(sample_index), Tensor(reindex_x), Tensor(out_eids)z~Tensor row, Tensor colptr, Tensor x, Tensor eids, Tensor perm_buffer, int sample_size, bool return_eids, bool flag_perm_bufferz0Tensor(out), Tensor(out_count), Tensor(out_eids)zcTensor x, Tensor grid, str mode = "bilinear", str padding_mode = "zeros", bool align_corners = truezeTensor x, Tensor scale, Tensor bias, double epsilon = 1e-5, int groups = -1, str data_format = "NCHW"z)Tensor(y), Tensor(mean), Tensor(variance)zTensor input, Tensor h0, Tensor weight, Tensor bias, str activation = "tanh", str gate_activation = "sigmoid", bool is_reverse = false, bool origin_mode = false, bool is_test=falsez]Tensor (batch_gate), Tensor (batch_reset_hidden_prev), Tensor (batch_hidden), Tensor (hidden)zTensor input, Tensor hidden_prev, Tensor weight, Tensor bias, int activation = 2, int gate_activation = 1, bool origin_mode = falsez:Tensor (gate), Tensor (reset_hidden_prev), Tensor (hidden)zCTensor x, float temperature = 1.0, bool hard = false, int axis = -1zTensor x, float threshold = 0.5z/Tensor x, float slope = 0.2, float offset = 0.5z'Tensor x, float t_min=0, float t_max=24zTensor logits, Tensor labelsz Tensor (loss)zgTensor input, Tensor weight, int64_t bins = 100, float min = 0.0, float max = 0.0, bool density = falsezhTensor x, Tensor label, Tensor w, Tensor bias, Tensor path, Tensor code, int num_classes, bool is_sparsez+Tensor(out), Tensor(pre_out), Tensor(w_out)z'Tensor input, Tensor label, float deltazTensor(out), Tensor(residual)i0i0ei1i1ezTensor x, int reduction = 1zsTensor x, Tensor y, int[] kernels, int[] strides = {1, 1}, int[] paddings = {0, 0, 0, 0}, int[] out_stride = {1, 1}zTensor x, float value = 1.0z7Tensor x, Tensor index, Tensor add_value, int axis = 0zTensor x, Tensor[] index, int64_t[] input_dims, int64_t[] input_strides, int64_t[] index_dims, int64_t[] index_stride, int64_t slice_offset = 0, bool accumulate = true, bool is_combined = falsezTensor x, Tensor[] index, Scalar value, int64_t[] input_dims, int64_t[] input_strides, int64_t[] index_dims, int64_t[] index_strides, int64_t slice_offsetzTensor x, Tensor[] index, Tensor value, int64_t[] input_dims, int64_t[] input_strides, int64_t[] index_dims, int64_t[] index_strides, int64_t slice_offset index_putz?Tensor x, Tensor[] indices, Tensor value, bool accumulate=falsez$Tensor x, Tensor index, int axis = 0index_select_stridedz%Tensor x, int64_t index, int axis = 0z7Tensor x, Tensor scale, Tensor bias, float epsilon=1e-5z5Tensor(y), Tensor(saved_mean), Tensor(saved_variance)interp_antialiasz]Tensor x, Tensor y, Scalar(double) rtol=1e-5, Scalar(double) atol=1e-8, bool equal_nan=falsezGTensor x, Tensor label, str reduction = "mean", bool log_target = falsezTensor x, Tensor alpha, str data_format="NCHW", str mode="all"zTensor input, Tensor image, float[] min_sizes, float[] max_sizes = {}, float[] aspect_ratios = {}, float[] variances = {}, bool flip=true, bool clip=true, float step_w=0.0, float step_h=0.0, float offset=0.5, bool min_max_aspect_ratios_order=falsezTensor(out), Tensor(var)z6Tensor x, IntArray axis, bool keepdim, bool reduce_allzLTensor gate_idx, Tensor expert_count, int64_t n_expert=0, int64_t n_worker=0zTensor(out_gate_idx)zTensor x, Tensor boxes, Tensor boxes_num, int pooled_height=1, int pooled_width=1, int output_channels=1, float spatial_scale=1.0zdTensor arr, Tensor indices, Tensor values, int axis, str reduce = "assign", bool include_self = truea=Tensor x, Tensor w, Tensor white_list, Tensor black_list, int num_emb = 0, int space_len = 0, int pyramid_layer = 2, int rand_len = 0, float drop_out_percent = 0, int is_training = 0, bool use_filter = true, int white_list_len = 0, int black_list_len = 0, int seed = 0, float lr = 0.0, str distribute_update_vars = ""z4Tensor (out), Tensor (drop_pos), Tensor (x_temp_out)zTensor x, str mode = "reduced"zTensor(q), Tensor(r)radam_zTensor param, Tensor grad, Tensor learning_rate, Tensor beta1_pow, Tensor beta2_pow, Tensor rho, Tensor moment1, Tensor moment2, Tensor master_param, float beta1 = 0.9f, float beta2 = 0.999f, float epsilon = 1.0e-8f, bool multi_precision = falsezTensor(param_out), Tensor(beta1_pow_out), Tensor(beta2_pow_out), Tensor(rho_out), Tensor(moment1_out), Tensor(moment2_out), Tensor(master_param_out)zQint low, int high, IntArray shape, DataType dtype=DataType::INT64, Place place={}randomz"Tensor x, int64_t from, int64_t toz/Tensor prob, Tensor topk_value, Tensor topk_idxz%int n, DataType dtype, Place place={}zSTensor x, Tensor rank_offset, Tensor rank_param, int max_rank = 3, int max_size = 0z1Tensor(input_help), Tensor(out), Tensor(ins_rank) read_filezIstr filename = "", DataType dtype=DataType::UINT8, Place place=CPUPlace()rz?Tensor x, int ring_id = 0, int root_id = 0, int reduce_type = 0 reduce_aszTensor x, Tensor targetreduce_scatterz)Tensor x, int ring_id = 0, int nranks = 1zXTensor x, Tensor neighbors, Tensor count, Tensor hashtable_value, Tensor hashtable_indexz;Tensor(reindex_src), Tensor(reindex_dst), Tensor(out_nodes)z+Tensor x, float p, int axis, float max_normz9Tensor x, int repeats, int axis, int64_t output_size = -1zint rows, int cols, int offset, DataType dtype, Place place={}triu triu_indiceszTensor x, DataType dtype=DataType::UNDEFINED, Place place = {} batched_gemmzMTensor lhs, Tensor rhs, int64_t[] batch_sizes, bool trans_lhs, bool trans_rhszTensor inference, Tensor label, Tensor seq_length, int num_chunk_types, str chunk_scheme = "IOB", int[] excluded_chunk_types = {}zTensor (precision), Tensor (recall), Tensor (f1_score), Tensor (num_infer_chunks), Tensor (num_label_chunks), Tensor (num_correct_chunks)fast_lnz2Tensor x, Tensor scale, Tensor bias, float epsilonz'Tensor(y), Tensor(mean), Tensor(invvar) fast_rms_normz%Tensor x, Tensor scale, float epsilonzTensor(y), Tensor(invvar)fp8_gemm_blockwise_aTensor A, Tensor A_scale, Tensor B, Tensor B_scale, Tensor input_result, Tensor bias, Tensor pre_gelu, Tensor workspace, bool transa, bool transb, bool grad, bool accumulate, bool use_split_accumulator, int math_sm_count, bool is_A_1d_scaled, bool is_B_1d_scaledz>Tensor (output), Tensor (pre_gelu_out), Tensor (workspace_out)fp8_quant_blockwisezTensor x, float epsilon, bool using_1x128_vec_quant, bool input_transpose, bool output_scale_transpose, bool return_transpose_only, bool using_e5m2, bool using_pow2_scale, bool using_ue8m0_scalezLTensor(out), Tensor(scale), Tensor(out_transposed), Tensor(scale_transposed)fused_rms_norm_ext int_bincountz2Tensor x, int64_t low, int64_t high, int64_t dtypezTensor numbers, int upper_rangerms_normzKTensor x, Tensor scale, int64_t[] normalized_shape={}, double epsilon= 1e-5zETensor start, Tensor end, Tensor step, DataType dtype, Place place={}zETensor weight, Tensor x, int64_t start_index=0, int64_t vocab_size=-1zsTensor fpn_rois, Tensor rois_num, int min_level, int max_level, int refer_level, int refer_scale, bool pixel_offsetzTensor[](multi_fpn_rois){max_level - min_level + 1}, Tensor[](multi_level_rois_num){max_level - min_level + 1}, Tensor(restore_index)zTensor x, Scalar scale=1.0zTensor[] x, str equationzHTensor(out), Tensor[](inner_cache){x.size()}, Tensor[](xshape){x.size()}zBTensor x, Tensor weight, int64_t padding_idx=-1, bool sparse=falseembedding_grad_densezSTensor x, Tensor weight, Tensor out_grad, int64_t padding_idx=-1, bool sparse=falsezTensor(weight_grad)anTensor[] params, Tensor[] grads, Tensor learning_rate, Tensor[] moments1, Tensor[] moments2, Tensor[] moments2_max, Tensor[] beta1_pows, Tensor[] beta2_pows, Tensor[] master_params, Tensor skip_update, Scalar beta1, Scalar beta2, Scalar epsilon, int chunk_size, float weight_decay, bool use_adamw, bool multi_precision, bool use_global_beta_pow, bool amsgrad = falseaTensor[](params_out){params.size()}, Tensor[](moments1_out){params.size()}, Tensor[](moments2_out){params.size()}, Tensor[](moments2_max_out){params.size()}, Tensor[](beta1_pows_out){params.size()}, Tensor[](beta2_pows_out){params.size()}, Tensor[](master_params_out){params.size()}zKTensor x, Tensor y, Tensor bias, bool trans_x, bool trans_y, str activationz"Tensor(out), Tensor(reserve_space)zFTensor x, Tensor y, bool transpose_x = false, bool transpose_y = falsezTensor x, IntArray starts, IntArray ends, IntArray steps, int64_t[] axes, int64_t[] decrease_axes, int64_t[] none_axes, int64_t[] shape, Scalar[] valueszTensor x, int axiszTensor[] x, int ring_id = 0zTensor[](out){x.size()} tensor_unfoldz6Tensor input, int64_t axis, int64_t size, int64_t stepz$Tensor x, IntArray repeat_times = {}zpTensor x, bool return_index, bool return_inverse, bool return_counts, int[] axis, DataType dtype=DataType::INT64z=Tensor(out), Tensor(indices), Tensor(inverse), Tensor(counts)N)op_mapop_infod/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/incubate/autograd/phi_ops_map.pyrsWf     5   Wf    #     Wf .    5   /Wf @    5 AWf R 0"4+)   $-1 0   SWf t+)   $% 0  uWf R +  '##)'   $''.** 0  %, %, %.   /% % SWf ^ +!#)  $%( 0   _Wf B +  '##)'   $''.** 0  %, %, %.   /%%CWf N  5 ! $  OWf l  c  5   mWf ~+   5 Wf P   5   QWf n$  5   oWf D! W  h  ", EWf b   5 !    cWf |  5 +% +%   }Wf Wf d   5 !    eWf ~   5 !    Wf X & W !(   Y Wf l     5 m Wf ~    5 !     Wf X    5 &"( &"( &"(   Y Wf J    5  &"( K Wf h    5  &"( i Wf F       G Wf Z %  #   [ Wf n    5 o Wf @    5 A Wf R     5   S Wf d     5 e Wf v    w Wf D    5 EWf V   5 WWf Wf Wf h" 5 iWf t    5   uWf F   5  GWf Z    5 [Wf l$ 1- 1%:'#   + 0!   mWf X !!,   ((    YWf v  5   wWf T   5 UWf f  5   gWf | "   !)%-+    = #}Wf f  5  gWf z(  */   {Wf P   5 QWf b$!'#    e  = cWf @    5   AWf X%!'#    e  = YWf v   5  ""( wWf Wf Wf V%   )?%8   WWf j!  5  kWf ~!   5 Wf P   5  QWf d!  5  eWf x   5  yWf L = MWf X#*%  +   YWf n' S  5 oWf @   5 AWf R!  5  SWf f#2  !  % %gWf |   5 }Wf N    5   OWf `    5   aWf r    5   sWf D/  -  ! !EWf Wf Wf Z   5 [Wf l$  5  mWf @) W .*C   AWf T    5 %$ %$     UWf z"   5 {Wf L% W )  9   MWf f+ 0"4$7  "!  _ gWf D  5  EWf X    5  F  "+ YWf |'}Wf B    5   CWf T   8  UWf h&  8  ""( iWf J+  8  ""( KWf l   8  mWf @ &  8  A Wf T !  8  U Wf Wf Wf h     5   i Wf z     5   { Wf L!   5 #& - #( /   M!Wf v!   5  E   w!Wf P"!0  !  # #Q"Wf f"   5  5   g"Wf ~"    5  ""( "Wf \#   3  ]#Wf p#Kq#Wf v#!   5 w#Wf H$%    8   I$Wf `$&  8 #$ 2,   a$Wf @%!0  8  ""( ##A%Wf b% W  h     c%Wf |%(  5  }%Wf P&'%!!   ###   Q&Wf p&$  5  q&Wf Wf Wf D'   5 E'Wf V'&   5 W'Wf h'""+)#1%  $) 0"   i'Wf L(   5 M(Wf ^( W  5 _(Wf p(   5 q(Wf B)   5 C)Wf T) W  5 U)Wf f)   5  g)Wf z)   5 %, %")   {)Wf `*  5  a*Wf t*   5  u*Wf H+!      ,"     & #I+Wf v+Lw+Wf |+#&&   )    }+Wf V,   ##   W,Wf j,   ##   k,Wf Wf Wf ~,   5 ,Wf P-  )*  F   Q-Wf j-   '   k-Wf @.%  5  A.Wf T.    5   U.Wf f.  5  k   g.Wf @/  5  &, 1  A/Wf Z/   5  [/Wf n/  5  o/Wf B0    5   C0Wf T0    5 U0Wf f0    5   g0Wf x0   5  W  "& 6 y0Wf ^1  5  _1Wf r1    5 s1Wf D2"   5  8   E2Wf \2  5 !&!&    ]2Wf Wf Wf x2+:  5 - -y2Wf L3)8  #  + +M3Wf `34C  #  6 6a3Wf t3-  5  u3Wf H4+  #   I4Wf \4'6  #  ) )]4Wf p46E!!!   ###   88q4Wf N5+:!!!   ###   --O5Wf l5"1!  #%   $ $m5Wf F6&#  $'    G6Wf ^6   5 #$,    _6Wf ~6  5   6Wf J7#   5 K7Wf \7   5 ]7Wf n7   5 o7Wf @8   5 A8Wf R8   5  $"( S8Wf Wf Wf p8#   5 q8Wf B9*  5  C9Wf V9)'"( '"(     W9Wf p9*'"( '"(     q9Wf J:"1'"( '"(    $ $K:Wf d:    '$   ! !e:Wf @;    5   A;Wf R;    5 S;Wf d;"  5  e;Wf x;  5  y;Wf L<  5  M& &"( U>Wf Wf Wf f>!+"")%%+'   &)) 0,,!2  g>Wf V?%! !!!!-.$"    x l  g  x  L     g     <  $%9   0  L     n   0 ! "  # $*B()   %%W?Wf b@*"   !)%-+   c@Wf FA-<"!   *B 0'   //GAWf hA."   !)%-+     iAWf NB",    h #$ 2,   OBWf rB*+        sBWf LC",    h #$ 2,   MCWf pC+  5  qCWf DD+  5  EDWf XD+  5  YDWf lD+  5  mDWf @E(7    5  * *AEWf XE-&!   +-)))     YEWf BF%4   "  ''CFWf bF'++-)-)#!#!   ++!)!)'))   "1!0,,   9""cFWf hG*)%)%/!'#!2.   $7!2#6!2''!!   !iGWf Wf Wf `H)  +    aHWf xH.+       ! !yHWf TI#2     x  V            L    L  ;  <    < ! " ]# $%8,,)   .)  1%%UIWf NJ'  5  OJWf bJ%   5 cJWf tJ !!   *+'   '&,  !uJWf `K!!!   +-))))   '&,  -aKWf XL-  "    YLWf pL!0    .+-  ##qLWf RM+   5 SMWf dM&5   5 ((eMWf vM   5  "% wMWf VN  5  WNWf jN!   5  kNWf ~N 5  &, 1  NWf XO    5   YOWf jO('! $   "*(  ,-  kOWf Wf Wf PP#   5 QPWf bP$   5 cPWf tP  5  uPWf HQ(   ! *$"   IQWf hQ,(   $"  iQWf FR#  5  GRWf ZR"  5  [RWf nR!  8  oRWf BS   "  = CSWf bS$   5 cSWf tS   5 uSWf FT!   5 GTWf XT   5 YTWf jT    5 kTWf |T    5  E   }TWf TU  5  UUWf hU   F  iUWf Wf Wf |U  5  }UWf PV#     QVWf pV   "   qVWf FW!  5  GWWf ZW    5   [WWf lW   5 mWWf ~W#  5   WWf TX+&,&*    5 +&(  UXWf zX+{XWf @Y(7 5 **AYWf LY"  5  MYWf `Y"  5  E   aYWf zY#  %-    {YWf TZ   8 UZWf fZ   5 gZWf xZ  5 +% +%   yZWf `[   5 a[Wf Wf Wf r[   5 s[Wf D\   5 E\Wf V\   6  W\Wf j\   5  k\Wf ~\      \Wf R]   5 S]Wf d]"%  5  e]Wf x] +  ##)'   $''**!1     y]Wf d^   "    e^Wf ~^   5  g   ^Wf V_,!'#    e  = W_Wf t_ #   5  ^  ", 5 u_Wf Z`/' $   "*(  ,-  [`Wf @a #      )(  AaWf fa+!'#    e  = gaWf Db$    "& - EbWf fb   5   gbWf Wf Wf |b   5  }bWf Pc  5  QcWf dc    5 ecWf vc#!'#    e  = wcWf TdKUdWf Zd  5   [dWf pd  5  qdWf De    5   EeWf Ve    5 WeWf he    5 ieWf ze    5   {eWf Lf   6  MfWf `f!   5 afWf rf"   5 sfWf Dg!  5  EgWf Xg!   5 YgWf jg   5  kgWf Wf Wf ~g!  5  gWf Rh    5 ShWf dh   5 ehWf vh   5 whWf Hi"  5  IiWf \i      ]iWf pi   #$/    $"( qiWf Vj     WjWf nj*  !   ojWf Dk#  3  EkWf Xk)      YkWf pk  5 %$    qkWf Ll )  5  MlWf `l       alWf xl"   5 ylWf Jm!%  5  KmWf ^m   5 !  ""( _mWf Wf Wf Dn+    7   EnWf ^n+    7   _nWf xn  5  ynWf Lo    5 MoWf ^o   5 !  ""( _oWf Dp    5   EpWf Vp!0'"( '"(    # #WpWf pp)   5 qpWf Bq"+  '##)   $''.** 0  %"( %"( %"(   -$$CqWf Lr&"+)   $) 0  MrWf jr c  5 krWf |r   5 !  ""( }rWf bs  5  csWf vs !  5  wsWf Jt       KtWf ^t"+)   $) 0  _tWf |t#2!!  ###    % %}tWf Wf Wf Xu   5 YuWf ju!!,    h '&  kuWf Lv$  5  MvWf `v%!  (    avWf zv&    5 )((  {vWf \w!   5  ""( ]wWf zw  5  {wWf Nx  5  OxWf bx   5  cxWf vx  $  U wxWf Ty$!'#    e  = UyWf ry  *    syWf Jz    ?     KzWf bz   5 czWf tz      uzWf H{  5  I{Wf \{    E   ]{Wf Wf Wf n{   5  "- o{Wf L|!   5 M|Wf ^|    5 _|Wf p|    5  $"(   q|Wf N} GO}Wf T}    5    ") U}Wf x}'   5 y}Wf J~$   5 K~Wf \~" 5 ]~Wf h~!   5 i~Wf z~#   5 {~Wf L%   5 MWf ^   5 _Wf p    5  7  ""( qWf T@    5  7   U@Wf l@    5    $-   m@Wf PA   5  QAWf Wf Wf dA  $  5 eAWf vA     wAWf LB   5 !  ""( MBWf rB "  5   sBWf HC$  8 *  ICWf hCIiCWf nC      oCWf BD W  h *    CDWf ^D%%!!   ###   _DWf ~D 5  &, 1  DWf XE 5 YEWf dE  5 &"( &"( &"(   eEWf VF    5   WFWf hF   5 iFWf zF    5   {FWf LG    5 MGWf ^G  5  _GWf Wf Wf rG    5 sGWf DH'   5 !    EHWf ^H*9%  5  E  , ,_HWf xH W  h #$"$   yHWf VI    "& - WIWf xI(  y  h  W  W  F   y  h  W  W  F  y  h  W  W F! $ 3 W  <  ^       W  <  <  ^       W  <  ^ ! "  # $&'%'%'/   )--yIWf TK!!!   !(,,*(,,*   !UKWf RL   5  ""( SLWf pL'#+)  $%.*!1   qLWf VM #'/   !/     WMWf tM"  5   uMWf JN"      KNWf bN    5  &-   cNWf @O    5 AOWf RO  5  SOWf fO    5 gOWf xO"  yOWf Wf Wf DP    5 %, %")   EPWf jP   5   kPWf @Q$   5   AQWf VQ"/  5  WQWf jQ  5   kQWf vQ"'  %   wQWf LR'   5 MRWf ^R    5   _RWf pR!$$  $  &) qRWf TS"$$   $  &) USWf zSI{SWf @T%  5  ATWf TT#     x  "- UTWf xT&   5 yTWf JU +)   $ 0    KUWf dU GeUWf jU! S  5 kUWf Wf Wf |U"     }UWf PV!   5 QVWf bV#  '!   cVWf zV%  5  {VWf NW   5 OWWf `W    5   aWWf rW    5   sWWf DX    5   EXWf VX    5   WXWf hX  W  5 #- 2 #+ 0   iXWf RY   5 SYWf dY   5 eYWf vY   5 wYWf HZ   5 IZWf ZZ   5     [ZWf rZ   5 sZWf D[   5  E[Wf Wf Wf X[' = Y[Wf d[$ &, 1   e[Wf x["#- 2 #+ 0   y[Wf V\ "+ W\Wf h\, = i\Wf t\#  5   u\Wf J]    5  ""(  ""( K]Wf t]$ ""(+   u]Wf H^    5   I^Wf Z^    5 [^Wf l^    F  ""( m^Wf R_    3 S_Wf d_    5 e_Wf v_&5   5 ((w_Wf H`#   5 #- 2 #+ 0 #. 3  I`Wf |`  5  }`Wf Pa   5 !   ""( QaWf Wf Wf xa      yaWf Nb    5 ObWf `b%"   !)%-+    = #abWf Jc%  8  F   KcWf dc    5   ecWf vc    5   wcWf Hd!   5 IdWf Zd#&   #    [dWf td!      udWf Ne&   5 OeWf `e    5  ", 5   aeWf @f     "" AfWf `f      "" afWf @g    5 AgWf Rg   5  F   SgWf jg&  5  kgWf ~g   5 gWf Wf Wf Ph&!'#    e  = QhWf nh  S  5 ohWf @i / 5 ""AiWf Li  S  5 MiWf ^i    3 _iWf pi 5 %"( %"(    &, 1 qiWf ^j%   5 _jWf pj        qjWf Hk(     IkWf ^k    5  z  ""( _kWf Dl   5  ElWf Xl    F  "+ 0 YlWf @m   3 AmWf Rm*-!2*(   ),*    #+ SmWf ~mLmWf Dn$!!-      EnWf \n+*   )    ]nWf Wf Wf vn $  5   wnWf Lo GMoWf Ro!     SoWf ho#   5 ioWf zo#''   (    {oWf Vp!!   /*    WpWf rp  h  spWf Fq%   5 GqWf Xq   5 YqWf jq   5 kqWf |q%   5 }qWf Nr $%  %" 0 0"4   OrWf nrOorWf tr""&    M   urWf Ls#  3  MsWf `s$     asWf xs)  +   ysWf Wf Wf Nt '/   !#   OtWf rt%+   $%    stWf Lu   5  MuWf `u    '"'     auWf @v.!!  -$7+  ! !AvWf Xv"1    0    0    y  y       "#6  -.J  -.J  +  <     0  ! " M# $ F%  $$YvWf Nw +     OwWf dw   5 ewWf vw     wwWf Jx #7"5+   $!2 0    KxWf hx$* W  5 &&ixWf zx /   1  " "{xWf Py$3   1  & &QyWf fy"+  5 ! $ 20!40!4!4#8   gyWf Tz(  5  UzWf hz$   5 izWf zz'!   $!    {zWf Wf Wf T{" h  F U{Wf f{ /  5 " "g{Wf z{,  $#%    {{Wf T|$3   5 &&U|Wf f|    &'=)     g|Wf D}'   !2    E}Wf `}#   5 a}Wf r}$"+)   $) 0  s}Wf P~ !  5  "(   Q~Wf p~' 5 q~Wf |~&   5 }~Wf N    5   OWf f*  5  gWf z    %"3     {Wf Z@     X   [@Wf v@    5 w@Wf HA   5 IAWf Wf Wf ZA&   5 [AWf lA +!2!2'=   ++    mAWf PB    5   QBWf bB" y  5 cBWf tB"  uBWf @C,!)  L  ACWf TC"%%   !&    UCWf pC$&"  5   qCWf FD$'%  &!  "!  GDWf hD%  5  iDWf |D 5 }DWf HE#$00   )($  IEWf fE      gEWf zE  {EWf FF#)  5 "4-+-   GFWf hF#  #   iFWf |F   5 ' 2 ' 0 ' 1   }FWf Wf lG,   5 ' 2 ' 0 ' 1   08  5 * *%    5   ' 0#  ,   $&"+)  $) 0  F  "% '6&   5   5  '   5 '   5 %   5 &   5 5 W  5 ''%  5  [LWf Wf Wf pLA#    A#  8D A# lA#    A# " #A# *Ui+A# 2]S3A# : gq;A# BjiCA# J lqKA# RA SA# Z S[A# bV cA# jQ"kA# r A  sA# z9{A# B@CA# A# J+KA# RnSA# Z A  [A# b A  cA# j kA# r A  sA# zZ.{A# B  CA# JKA# Rz.SA# Z)  [A# b cA# j kA# rQ0sA# z{A# BCA# J^KA# A# A# R Q]SA# Z   [A# b cA# j)kA# r@sA# z_{A# B   CA# J $KA# R SA# ZfJ[A# b pK  cA# jJckA# rSsA# z){A# B5CA# J,KA# RQXSA# A# A# Z[A# bv"cA# j@kA# rv"sA# zE{A# B+CA# J]UKA# R$SA# Z?[A# bcA# j$kA# r?sA# z${A# B $  CA# J.#KA# Ru&SA# Z9[A# A# A# b *cA# j)i;++kA# rVsA# zl{A# B VC A# J gK A# R #r1%%S A# Z i[ A# b nHc A# j 8*!!k A# r  *  s A# z    { A# B  -  C A# J @K A# R  *C""S A# Z Z1[ A# b ,c A# A# A# j 6k A# r UNs A# z  @  { A# B *C A# J ZHK A# R z8S A# Z *[ A# b  +c A# j     k A# r  s A# z m{ A# B zC A# J  IK A# R sS A# Z 6[ A# b $c A# j Xk A# A# A# r    s A# z    { A# B Q)C A# J  F  K A# R  2S A# Z !^1##[ A# b 0@&22c A# j u;k A# r shs A# z  I0{ A# B I0CA# JNKA# R hSA# Z ;   [A# b G  cA# j~9kA# r1sA# A# A# zj{A# B ( CA# JKA# RLSA# Z!m##[A# bVcA# j9kA# r'sA# z   {A# B w  CA# J_KA# R]kSA# Z E  [A# bLcA# jHkA# rsA# z{A# A# A# B"($$CA# J 3  KA# R $  SA# Z R%[A# b^-cA# ji4kA# r 0  sA# z ,0  {A# BCA# JB=KA# R .  SA# ZJ)[A# b%A''cA# j ZkA# rRsA# z!(##{A# B$CA# A# A# J   KA# R SA# Z   [A# b /cA# jAkA# r G)""sA# z {A# B%CA# J g  KA# R+o--SA# Z)l2++[A# b4V266cA# j9  kA# rB2sA# z'B2)){A# B6eX88CA# J+eX--KA# A# A# R"QF$$SA# ZK[A# becA# jZkA# r 2  sA# zH{A# BTCA# JMZKA# R{ZSA# ZoZ[A# b_4cA# jN4kA# r"xZ$$sA# zYZ{A# BD4CA# JAKA# R &   SA# A# A# Z [A# b $  cA# j $  kA# r s  sA# zx-{A# B{-CA# J IKA# RKSA# Z mZ  [A# b p  cA# j kA# rQsA# z[{A# B`CA# JPKA# RAKSA# ZKK  [A# A# A# bZFcA# j'kA# r(**sA# z${A# BCA# J 7KA# R(SA# Z,[A# bacA# jCkA# r 5  sA# zSQ{A# BTCA# JTKA# RhoSA# ZQD[A# bycA# A# A# jy=kA# r Kq  sA# zVN{A# BUCA# J1 KA# RA SA# Z9[A# b$cA# j.!kA# rysA# zz?{A# B91CA# J   KA# R   SA# Z   [A# b   cA# j-kA# A# A# rF sA# z    {A# B-CA# JIKA# RT SA# Zm [A# b(m **cA# jQkA# r(sA# z6{A# B7CA# JIIKA# Rv"SA# Z[A# bcA# jokA# rsA# A# A# z {A# B  C A# J [K A# R  $  S A# Z N0[ A# b c A# j G k A# r  sYs A# z d?{ A# B!8C!A# J! 3  K!A# R! S!A# Z!D[!A# b!v"c!A# j!Wk!A# r!Ws!A# z!`{!A# A# A# B"   C"A# J" K"A# R" S"A# Z"   ["A# b";c"A# j")k"A# r"es"A# z"${"A# B#C#A# J#$K#A# R#$S#A# Z# -[#A# b#c#A# j#dk#A# r#Vs#A# z#@ {#A# B$~C$A# A# A# J$ Cd  K$A# R$ L^S$A# Z$ ->  [$A# b$?c$A# j$Z6k$A# r$Q1s$A# z$5 {$A# B%"nT$$C%A# J%' K%A# R%=.S%A# Z%f?[%A# b%!c%A# j%Vk%A# r%Js%A# z%_{%A# B& @  C&A# J&j-K&A# A# A# R&q-S&A# Z&[3[&A# b& 4c&A# j& @  k&A# r&s&A# z& U0{&A# B'.C'A# J'.K'A# R'!}N##S'A# Z'['A# b']ac'A# j'UFk'A# r'!0s'A# z'[3{'A# B( (  C(A# J( A0  K(A# R(HS(A# A# A# Z(H[(A# b(`c(A# j(kwk(A# r("AM$$s(A# z(kw{(A# B).T_00C)A# J) qw""K)A# R)]bS)A# Z)sC[)A# b)KUc)A# j)+k)A# r)s)A# z)PD{)A# B*QC*A# J*/K*A# R* &  S*A# Z* wy[*A# A# A# b*U0c*A# j* dk*A# r*v"s*A# z*${*A# B+r5C+A# J+ 2  K+A# R+"S+A# Z+ A-  [+A# b++c+A# j+  k+A# r+3s+A# z+ Z  {+A# B,NC,A# J,7K,A# R, }S,A# Z, <  [,A# b, {c,A# A# A# j,Ak,A# r,Bs,A# z,B{,A# B-JC-A# J-LK-A# R-S-A# Z-![-A# b- Vc-A# j- Wk-A# r- )  s-A# z- T{-A# B.J,C.A# J. H  K.A# R.^(S.A# Z.T[.A# b.xc.A# j.RHk.A# A# A# r. 2(  s.A# z. Hi{.A# B/cC/A# J/ 4K/A# R/AS/A# Z/7[/A# b/eEc/A# j/]k/A# r/    s/A# z/{/A# B0 QC0A# J0)K0A# R0;S0A# Z0jO[0A# b0   c0A# j0 k0A# r0 =s0A# A# A# z0K{0A# B1*N,,C1A# J1*K1A# R1: S1A# Z1)[1A# b1   c1A# j1FEk1A# r1 Vn  s1A# z1h{1A# B2|0C2A# J2 A  K2A# R2 -S2A# Z2 il[2A# b2 V.c2A# j2 k2A# r2 Ys2A# z2M{2A# A# A# B38C3A# J3cK3A# R3D3S3A# Z3 x  [3A# b3p2c3A# j3O2k3A# r3bs3A# z3b {3A# B4CC4A# J4a4K4A# R4 i   S4A# Z4X[4A# b4 r?  c4A# j4 k4A# r4s4A# z4]{4A# B5 C5A# A# A# J5;FK5A# R5)S5A# Z5[5A# b5(h**c5A# j5   k5A# r5   s5A# z5   {5A# B6   C6A# J6 ~K6A# R6S6A# Z60[6A# b6Fc6A# j61k6A# r6s6A# z6 ${6A# B7xKC7A# J7iK7A# A# A# R7 ?-S7A# Z75![7A# b7   c7A# j7 k7A# r7s7A# z7,{7A# B8 * C8A# J8K8A# R8 FS8A# Z8 j  [8A# b8 d   c8A# j8Xk8A# r8 d  s8A# z8 64  {8A# B9C9A# J9 $K9A# R9 S9A# A# A# Z9DK[9A# b9c9A# j96k9A# r9   s9A# z9   {9A# B:C:A# J:^6K:A# R:d=S:A# Z:^[:A# b:Dc:A# j:zTk:A# r: e0  s:A# z: H{:A# B;&C;A# J;&K;A# R;eS;A# Z; *  [;A# A# A# b;Pc;A# j;v"k;A# r; *  s;A# z;N{;A# B< CC=A# J= |K=A# R=]S=A# Z=.[=A# b=1&c=A# A# A# j=lpk=A# r= j  s=A# z=A{=A# B>.C>A# J>3K>A# R>BS>A# Z>n0[>A# b>E5c>A# j>E6k>A# r>^s>A# z>B{>A# B?_.C?A# J? DN""K?A# R? 6S?A# Z?d1[?A# b?8c?A# j?s5k?A# A# A# r?jPs?A# z? Z{?A# B@PC@A# J@_"K@A# R@V^S@A# Z@D;[@A# b@7-c@A# j@YRk@A# r@U`s@A# z@7-{@A# BADCAA# JA1KAA# RA]-SAA# ZA $  [AA# bA !cAA# jA WkAA# rA sAA# A# A# zADK{AA# BBWCBA# JBFZ!!KBA# RB,SBA# ZB $[BA# bB *\cBA# jB$kBA# rBTsBA# zBe'{BA# BC $CCA# JC$KCA# RCAoSCA# ZC]6[CA# bC$cCA# jC$kCA# rCsCA# zC${CA# A# A# BD$CDA# JD XKDA# RD$SDA# ZD @  [DA# bD$cDA# jD$kDA# rD$sDA# zDW{DA# BE$ CEA# JEkKEA# RE$SEA# ZE$[EA# bE-+cEA# jEHkEA# rE 6  sEA# zE CQ{EA# A# r