RЦivSrSSKrSSKrSSKJr SSKJrJrJrJ r J r SSKJ r SSKrSSKJr SSKJr SSKJrJr SSKJrJrJrJrJrJrJrJrJr S S K J!r! S S K"J#r# S S K$J%r%J&r& S S K'J(r(J)r) S SK*J+r+ S/r,\RZ"\.5r/"SS\R`5r1"SS\R`5r2"SS\R`5r3"SS\R`5r4S8Sjr5S9Sjr6\("\6"SSSS9\6"SSS9\6"S SS!9\6"S"SS!9\6"S#SS!9\6"S$SS!9\6"S%SS!9\6"S&SS!9\6"5\6"S'SS!9\6"5\6"S(SS!9\6"5S). 5r7\)S8S*\44S+jj5r8\)S8S*\44S,jj5r9\)S8S*\44S-jj5r:\)S8S*\44S.jj5r;\)S8S*\44S/jj5r<\)S8S*\44S0jj5r=\)S8S*\44S1jj5r>\)S8S*\44S2jj5r?\)S8S*\44S3jj5r@\)S8S*\44S4jj5rA\)S8S*\44S5jj5rB\)S8S*\44S6jj5rC\)S8S*\44S7jj5rDg!\ a SSK J r GNf=f):zRelative Position Vision Transformer (ViT) in PyTorch NOTE: these models are experimental / WIP, expect changes Hacked together by / Copyright 2022, Ross Wightman N)partial)ListOptionalTupleTypeUnion)Literal)FinalIMAGENET_INCEPTION_MEANIMAGENET_INCEPTION_STD) PatchEmbedMlp LayerScaleDropPathcalculate_drop_path_rates RelPosMlp RelPosBiasuse_fused_attn LayerType)build_model_with_cfg)feature_take_indices) named_apply checkpoint)generate_default_cfgsregister_model)get_init_weights_vitVisionTransformerRelPosc^\rSrSr%\\\S'SSSSSS\RSS4 S\ S\ S \S \S \ \ \RS \ S \ S\ \R4U4SjjjrSS\ \R 4SjjrSrU=r$)RelPosAttention, fused_attnFNdim num_headsqkv_biasqk_norm rel_pos_cls attn_drop proj_drop norm_layerc >XS.n [T U]5 X-S:XdS5eX lX-UlURS-Ul[ 5Ul[R"XS-4SU0U D6Ul U(aU"UR40U D6O[R"5Ul U(aU"UR40U D6O[R"5Ul U(a U"SSU0U D6OSUl [R"U5Ul[R"X40U D6Ul[R"U5Ulg) Ndevicedtyperz$dim should be divisible by num_headsgbiasr')super__init__r'head_dimscalerr#nnLinearqkvIdentityq_normk_normrel_posDropoutr+projr,) selfr&r'r(r)r*r+r,r-r0r1dd __class__s d/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/timm/models/vision_transformer_relpos.pyr6RelPosAttention.__init__/s / !#K%KK#"( ]]d* (*99S'??B?9@j5"5bkkm 9@j5"5bkkm AL{=Y="=RV I.IIc-"- I.shared_rel_poscURup4nURU5RX4SURUR5R SSSSS5nUR S5upxn URU5nURU5nUR(aURbURR5n OUbUn OSn [RRRXxU U UR (aUR"R$OSS9nOjXpR&-nXxR)SS 5-n URbURXS 9n OUbX-n U R+S S 9n UR#U 5n X-nUR)SS5RX4U5nUR-U5nUR/U5nU$) Nr2rrr%) attn_mask dropout_prHr&)shaper;reshaper'r7permuteunbindr=r>r#r?get_biastorchr9 functionalscaled_dot_product_attentiontrainingr+pr8 transposesoftmaxrAr,) rBxrHBNCr;qkv attn_biasattns rEforwardRelPosAttention.forwardLs''ahhqk!!!4>>4==IQQRSUVXY[\^_`**Q-a KKN KKN ??||' LL113 +*  ##@@a#.2mm$..**AA JJA{{2r**D||'||D|H+,<>$'DA KK1  % %aA . IIaL NN1 rG) r+r#r7r>r'rAr,r=r;r?r8N)__name__ __module__ __qualname____firstlineno__r bool__annotations__r9 LayerNormintrrModulefloatr6rWTensorrg__static_attributes__ __classcell__rDs@rEr!r!,sd  "!59!!*,,,/// /  / "$ryy/2 ///RYY//:"%,,)?""rGr!c&^\rSrSrSSSSSSSS\R \R SS4 S\S\S\S \ S \ S \ \ \RS \ \S \S\S\S\ \RS\ \R4U4Sjjjr SS\ \R4SjjrSrU=r$) RelPosBlockq@FNr%r&r' mlp_ratior(r)r* init_valuesr,r+ drop_path act_layerr-c H>XS.n[TU]5 U "U40UD6Ul[UU4UUUU UU S.UD6UlU(a[ U4SU0UD6O[ R"5UlU S:a [U 5O[ R"5Ul U "U40UD6Ul [SU[X-5U US.UD6UlU(a[ U4SU0UD6O[ R"5UlU S:a[U 5Ulg[ R"5Ulg)Nr/r(r)r*r+r,r-r}r% in_featureshidden_featuresrdropr4)r5r6norm1r!rfrr9r<ls1r drop_path1norm2rrqmlpls2 drop_path2rBr&r'r|r(r)r*r}r,r+r~rr-r0r1rCrDs rEr6RelPosBlock.__init__ss%" / *r* #    #!     FQ:cA{AbAVXVaVaVc1:R(9-R[[]*r*  0    FQ:cA{AbAVXVaVaVc1:R(9-R[[]rGrHc XRURURURU5US955-nXR UR UR URU5555-nU$NrP)rrrfrrrrrrBr^rHs rErgRelPosBlock.forwardsb 4::a=Q_)` ab b $**Q-)@ AB BrG)rfrrrrrrrri)rjrkrlrmr9GELUrprqrsrnrrrrr6rWrtrgrurvrws@rEryryqs ""!59+/!!!)+*,,,,S,S,S ,S  ,S  ,S"$ryy/2,S"%,S,S,S,SBII,SRYY,S,S\%,,)?rGryc,^\rSrSrSSSSSSSS\R \R SS4 S\S\S\S \ S \ S \ \ \RS \ \S \S\S\S\ \RS\ \R4U4Sjjjr SrSS\ \R 4SjjrSrU=r$)ResPostRelPosBlockr{FNr%r&r'r|r(r)r*r}r,r+r~rr-c >XS.n[TU]5 Xpl[UU4UUUU UU S.UD6UlU "U40UD6UlU S:a [ U 5O[R"5Ul [SU[X-5U US.UD6Ul U "U40UD6Ul U S:a [ U 5O[R"5UlUR5 g)Nr/rr%rr4)r5r6r}r!rfrrr9r<rrrqrrr init_weightsrs rEr6ResPostRelPosBlock.__init__s" / &#    #!      *r* 1:R(9-R[[] 0     *r* 1:R(9-R[[] rGcURb}[RRURR UR5 [RRUR R UR5 ggri)r}r9init constant_rweightrrBs rErResPostRelPosBlock.init_weightss[    ' GG  djj//1A1A B GG  djj//1A1A B (rGrHc XRURURXS955-nXRUR UR U555-nU$r)rrrfrrrrs rErgResPostRelPosBlock.forwardsN  499Q9+V WX X  488A; 78 8rG)rfrrr}rrrri)rjrkrlrmr9rrprqrsrnrrrrr6rrWrtrgrurvrws@rErrs ""!59+/!!!)+*,,,--- -  -  -"$ryy/2-"%----BII-RYY--^C %,,)?rGrc8^\rSrSrSrSSSSSSS S S S S S S S SSS SSSSSS \SS\SS4S\\\ \\44S\\\ \\44S\S\S\ SS\S\S\S\ S\ S\ S\ \ S\ S \ S!\S"\ \S#\ S$\ S%\ S&\ S'\ S(\ S)S*\ S+\\R"S,\ \S-\ \S.\\R"46U4S/jjjrSJS1jrSKS2\S3\ S0S4S4jjr\R.R0S55r\R.R0SLS6j5r\R.R0SMS7j5r\R.R0S0\R"4S8j5rSNS\S\ \4S9jjrSOS:\R<S;\ \\\\4S<\ S=\ S>\ S?\S@\ S0\\\R<\ \R<\\R<444SAjjr SPS;\\\\4SB\ SC\ 4SDjjr!SEr"SLSF\ 4SGjjr#SHr$SIr%U=r&$)QraOVision Transformer w/ Relative Position Bias Differing from classic vit, this impl * uses relative position index (swin v1 / beit) or relative log coord + mlp (swin v2) pos embed * defaults to no class token (can be enabled) * defaults to global avg pool for head (can be changed) * layer-scale (residual branch gain) enabled r2avg r{TFư>rNr%resetimg_size patch_sizein_chans num_classes global_pool)rtokenmap embed_dimdepthr'r|r(r)r} class_tokenfc_norm rel_pos_type rel_pos_dimrH drop_rateproj_drop_rateattn_drop_ratedrop_path_rate weight_init)skiprjaxmocorfix_init embed_layerr-rblock_fncj>[T%U]5 UUS.nUS;deU (dUS:wdeU=(d [[RSS9nU=(d [R nX@lX0lXPlU=Ul =Ul Ul U (aSOSUl SUl U"SUUUUS .UD6UlURRn[!URS 5(aURR#5OUn [%UURS 9n!UR'S 5(a(U(aUU!S 'SU;aSU!S'[[(40U!D6n"O[[*40U!D6n"SUlU(aU""SSU0UD6UlSn"U (a7[R."[0R2"SURU40UD65OSUl[7UU5n#[R8"[;U5V$s/sHn$U"SUUU U U U"U UUU#U$UUS. UD6PM sn$5Ul[;U5V$s/sHn$[%SU$3UU S9PM sn$UlU(d U"U40UD6O[R@"5Ul!U(a U"U40UD6O[R@"5Ul"[RF"U5Ul$US:a"[RJ"URU40UD6O[R@"5Ul&US:XaSOUUl'UUl(US:waURSSS9 ggs sn$fs sn$f)am Args: img_size: input image size patch_size: patch size in_chans: number of input channels num_classes: number of classes for classification head global_pool: type of global pooling for final sequence (default: 'avg') embed_dim: embedding dimension depth: depth of transformer num_heads: number of attention heads mlp_ratio: ratio of mlp hidden dim to embedding dim qkv_bias: enable bias for qkv if True qk_norm: Enable normalization of query and key in attention init_values: layer-scale init values class_token: use class token (default: False) fc_norm: use pre classifier norm instead of pre-pool rel_pos_type: type of relative position shared_rel_pos: share relative pos across all blocks drop_rate: dropout rate proj_drop_rate: projection dropout rate attn_drop_rate: attention dropout rate drop_path_rate: stochastic depth rate weight_init: weight init scheme fix_init: apply weight initialization fix (scaling w/ layer index) embed_layer: patch embedding layer norm_layer: normalization layer act_layer: MLP activation layer r/rrrrr)epsrrF)rrrr feat_ratio) window_size prefix_tokensr hidden_dimswinmodeNr') r&r'r|r(r)r*r}r,r+r~r-rzblocks.)modulenum_chs reductionrr needs_resetr4)*r5r6rr9rprrrr num_featureshead_hidden_sizernum_prefix_tokensgrad_checkpointing patch_embed grid_sizehasattrrdict startswithrrrH ParameterrWzeros cls_tokenr ModuleListrangeblocks feature_infor<normrr@ head_dropr:headweight_init_moderr)&rBrrrrrrrr'r|r(r)r}rrrrrHrrrrrrrr-rrr0r1rC feat_sizer rel_pos_argsr*dprirDs& rEr6 VisionTransformerRelPos.__init__sx  /2222kW444B72<mm 5\!%# "  ##!''((a&%#  "!%#$ $QVV[P\^P\1D'! yA FP\^7>Jy/B/BKKM 7>z)2r22;;= I.DORSOBIIdnnk@R@Y[YdYdYf +6&+@k  &   %  0 !;%#"^s 2"L+-L0returnc[R"5 [UR5Hup[R "SUS--5nUR RRRU5 URRRRU5 M SSS5 g!,(df  g=f)z9Apply weight initialization fix (scaling w/ layer index).g@rN) rWno_grad enumeratermathsqrtrfrArdiv_rfc2)rBlayer_idlayerr8s rEfix_init_weight'VisionTransformerRelPos.fix_init_weighttsy ]]_#,T[[#9 #A"67 &&++E2 $$))%0$:__s BB88 CrrcfU=(d URnUS;deSU;a![R"UR5*OSnURb([ R RURSS9 [[XUS9U5 UR(aUR5 gg)a(Initialize model weights. Args: mode: Weight initialization mode ('jax', 'jax_nlhb', 'moco', or ''). needs_reset: If True, call reset_parameters() on modules (default for after to_empty()). If False, skip reset_parameters() (for __init__ where modules already self-initialized). )rjax_nlhbrrrnlhbr%Nr)stdr) rrlogrrr9rnormal_rrrr)rBrr head_biass rEr$VisionTransformerRelPos.init_weights|s,t,,????39T>TXXd..//r >> % GGOODNNO 5(kRTXY ==  " rGcS1$)Nrr4rs rEno_weight_decay'VisionTransformerRelPos.no_weight_decays }rGc[SSS/S9$)Nz^cls_token|patch_embed)z^blocks\.(\d+)N)z^norm)i)stemr)r)rBcoarses rE group_matcher%VisionTransformerRelPos.group_matchers*-/CD  rGcXlgri)r)rBenables rEset_grad_checkpointing.VisionTransformerRelPos.set_grad_checkpointings"(rGcUR$ri)rrs rEget_classifier&VisionTransformerRelPos.get_classifiers yyrGcX4S.nXlUbUS;deX lUS:a([R"URU40UD6Ulg[R "5Ulg)Nr/rr)rrr9r:rr<r)rBrrr0r1rCs rEreset_classifier(VisionTransformerRelPos.reset_classifiers] /&  ""66 66* DORSOBIIdnnk@R@ Y[YdYdYf rGr^indicesreturn_prefix_tokensr stop_early output_fmtintermediates_onlyc US;dS5eUS:Hn/n [[UR5U5upURuppUR U5nUR b?[ R"UR RURSSS5U4SS9nURbURR5OSn[ RR5(dU(d URnOURSU S-n[U5H~unnUR(a/[ RR5(d [UUUS 9nOU"UUS 9nUU ;dMUU R!U(aUR#U5OU5 M UR$(aJU Vs/sHnUSS2SUR$24PM nnU Vs/sHnUSS2UR$S24PM n nU(acURR'X45unnU Vs/sH7nUR)U UUS5R+SS SS 5R-5PM9 n n[ RR5(dU(a[/[1U W55n U(aU $UR#U5nX4$s snfs snfs snf) aForward features that returns intermediates. Args: x: Input image tensor indices: Take last n blocks if int, all if None, select matching indices if sequence return_prefix_tokens: Return both prefix and spatial intermediate tokens norm: Apply norm layer to all intermediates stop_early: Stop iterating over blocks when last desired intermediate hit output_fmt: Shape of intermediate feature outputs intermediates_only: Only return intermediate features Returns: )NCHWNLCz)Output format must be one of NCHW or NLC.rNrrOrrQrPr2rJ)rlenrrRrrrWcatexpandrHrVjit is_scriptingrrrappendrrdynamic_feat_sizerSrT contiguouslistzip)rBr^rrrrrrrS intermediates take_indices max_indexr__heightwidthrHrrblkyrHWs rEforward_intermediates-VisionTransformerRelPos.forward_intermediatessf._,Y.YY,& "6s4;;7G"Q  ggf   Q  >> % 4>>00RDaHaPA;?;N;N;Z,,557`d 99 ! ! # #:[[F[[)a-0F'FAs&&uyy/E/E/G/GsAnE.9L $$TTYYq\qA(  ! !ERS]Qq!D$:$:"::;]MSDQRMqQq$"8"8"99:MMR ##55voFDAq^kl^kYZQYYq!Q3;;Aq!QGRRT^kMlyy%%'',@ ]M!BCM  IIaLTRms6KK&>K  prune_norm prune_headc[[UR5U5upEURSUS-UlU(a[R"5UlU(a,[R"5UlURSS5 U$)z?Prune layers not required for specified intermediates. Nrrr)rrrr9r<rrr)rBrr1r2r&r's rEprune_intermediate_layers1VisionTransformerRelPos.prune_intermediate_layerssh#7s4;;7G"Q kk.9q=1  DI ;;=DL  ! !!R (rGcURU5nURb?[R"URR UR SSS5U4SS9nUR bUR R5OSnURHInUR(a/[RR5(d [X1US9nMCU"XS9nMK URU5nU$)NrrOrrQrP)rrrWrrrRrHrVrrrrrr)rBr^rHr+s rEforward_features(VisionTransformerRelPos.forward_featuress   Q  >> % 4>>00RDaHaPA;?;N;N;Z,,557`d;;C&&uyy/E/E/G/GsnE9  IIaLrG pre_logitscUR(a;URS:Xa"USS2URS24RSS9OUSS2S4nURU5nUR U5nU(aU$UR U5$)NrrrQr)rrmeanrrr)rBr^r9s rE forward_head$VisionTransformerRelPos.forward_head s~   =A=M=MQV=V!T++,,-22q29\]^_ab^b\cA LLO NN1 q0DIIaL0rGcJURU5nURU5nU$ri)r7r<)rBr^s rErgVisionTransformerRelPos.forwards'  ! !! $   a rG)rrrrrrrrrrrrrrrrrrHr)rN)rTF)T)NNN)NFFFrF)rFT)'rjrkrlrm__doc__rryrrqrr rsrnrstrrr9rrrr6rrrWrignorerrr rrrtrr/r4r7r<rgrurvrws@rErrs5868#>C !!!+/ %! %)-#(!$&$&$&GN"+5.2-1(3=D1CsCx01D1c5c?23D1 D1  D1 !!:; D1D1D1D1D1D1D1"%D1D1D1 !D1""##D1$!%D1&'D1(")D1*"+D1,"-D1.!!CD/D101D12bii3D14!+5D16 *7D18299o9D1D1L1####& YY YY   YY)) YY gCghsmg8<).$$',B ||B eCcN34B #' B  B  B B !%B  tELL!5tELL7I)I#JJ KB L./$# 3S >* " 1$1rGc `URSS5n[[X4S[USS90UD6nU$)N out_indicesr2 feature_cfggetter)rE feature_cls)poprrr)variant pretrainedkwargsrEmodels rE!_create_vision_transformer_relposrNsA**]A.K  [hG   E LrGrc 4USSSSSS[[SSSS . UE$) Nr)r2rrg?bicubicTzpatch_embed.projrz apache-2.0) urlr input_size pool_sizecrop_pct interpolationfixed_input_sizer;r first_conv classifierlicenser )rQrLs rE_cfgrZ$s5=t'0F(    rGzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_replos_base_patch32_plus_rpn_256-sw-dd486f51.pthztimm/)r2r[)rQ hf_hub_idrR)r2r])rQrRzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_relpos_small_patch16_224-sw-ec2778b4.pth)rQr\zhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_relpos_medium_patch16_224-sw-11c174af.pthzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_relpos_base_patch16_224-sw-49049aed.pthzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_srelpos_small_patch16_224-sw-6cdb8849.pthzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_srelpos_medium_patch16_224-sw-ad702b8c.pthzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_relpos_medium_patch16_cls_224-sw-cfe8e259.pthzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_relpos_base_patch16_gapcls_224-sw-1a341d6c.pthzhttps://github.com/rwightman/pytorch-image-models/releases/download/v0.1-tpu-weights/vit_relpos_medium_patch16_rpn_224-sw-5d2befd8.pth) z,vit_relpos_base_patch32_plus_rpn_256.sw_in1kz*vit_relpos_base_patch16_plus_240.untrainedz$vit_relpos_small_patch16_224.sw_in1kz%vit_relpos_medium_patch16_224.sw_in1kz#vit_relpos_base_patch16_224.sw_in1kz%vit_srelpos_small_patch16_224.sw_in1kz&vit_srelpos_medium_patch16_224.sw_in1kz)vit_relpos_medium_patch16_cls_224.sw_in1kz)vit_relpos_base_patch16_cls_224.untrainedz*vit_relpos_base_patch16_clsgap_224.sw_in1kz*vit_relpos_small_patch16_rpn_224.untrainedz)vit_relpos_medium_patch16_rpn_224.sw_in1kz)vit_relpos_base_patch16_rpn_224.untrainedrc X[SSSS[S9n[SSU0[U40UD6D6nU$)z_ViT-Base (ViT-B/32+) w/ relative log-coord position and residual post-norm, no class token r)rrrr'rrK)$vit_relpos_base_patch32_plus_rpn_256rrrNrKrL model_argsrMs rErbrbXsGs"UghJ -. e;E eIMjIc\bIc eE LrGc N[SSSSS9n[SSU0[U40UD6D6nU$)zHViT-Base (ViT-B/16+) w/ relative log-coord position, no class token rr`rra)rrrr'rK) vit_relpos_base_patch16_plus_240rrNrds rErgrgbsDs"KJ -* a7A aEI*E_X^E_ aE LrGc R[SSSSSSS9n[S SU0[U40UD6D6nU$) GViT-Base (ViT-B/16) w/ relative log-coord position, no class token rrFTrrrr'r(rrK)vit_relpos_small_patch16_224rhrds rErnrnlsJs"TYcghJ -& ]3= ]AEjA[TZA[ ]E LrGc R[SSSSSSS9n[S SU0[U40UD6D6nU$) rjrrr$FTrmrK)vit_relpos_medium_patch16_224rhrds rErqrqvsMB!eUY[J -' ^4> ^BFzB\U[B\ ^E LrGc R[SSSSSSS9n[SSU0[U40UD6D6nU$) rjrrrFTrmrK)vit_relpos_base_patch16_224rhrds rErsrssMB"uVZ\J -% \2< \@DZ@ZSY@Z \E LrGc V[SSSSSSSSS9n[S SU0[U40UD6D6nU$) NViT-Base (ViT-B/16) w/ shared relative log-coord position, no class token rrkrrlFTrrrr'r(rrrHrK)vit_srelpos_small_patch16_224rhrds rErwrwsSB!eUZ.J .' ^4> ^BFzB\U[B\ ^E LrGc V[SSSSSSSSS9n[S SU0[U40UD6D6nU$) rurrprr$FTrvrK)vit_srelpos_medium_patch16_224rhrds rEryrysSB!eUZ.J .( _5? _CG C]V\C] _E LrGc X[SSSSSSSSSS 9 n[S S U0[U40UD6D6nU$) zLViT-Base (ViT-M/16) w/ relative log-coord position, class token present rrprr$Fr[Tr) rrrr'r(rrrrrK)!vit_relpos_medium_patch16_cls_224rhrds rEr{r{sVB!eUZTw@J .+ b8B bFJ:F`Y_F` bE LrGc T[SSSSSSSS9n[S SU0[U40UD6D6nU$) zLViT-Base (ViT-B/16) w/ relative log-coord position, class token present rrrFTr)rrrr'r(rrrK)vit_relpos_base_patch16_cls_224rhrds rEr}r}sPB"uZ^lsuJ -) `6@ `DHD^W]D^ `E LrGc T[SSSSSSSS9n[SSU0[U40UD6D6nU$) aViT-Base (ViT-B/16) w/ relative log-coord position, class token present NOTE this config is a bit of a mistake, class token was enabled but global avg-pool w/ fc-norm was not disabled Leaving here for comparisons w/ a future re-train as it performs quite well. rrrFT)rrrr'r(rrrK)"vit_relpos_base_patch16_clsgap_224rhrds rErrsP B"uVZhlnJ -, c9C cGKJGaZ`Ga cE LrGc Z[SSSSS[S9n[SSU0[U40UD6D6nU$) ^ViT-Base (ViT-B/16) w/ relative log-coord position and residual post-norm, no class token rrkrrlFrrrr'r(rrK) vit_relpos_small_patch16_rpn_224rcrds rErrsMB!eVhjJ -* a7A aEI*E_X^E_ aE LrGc Z[SSSSS[S9n[SSU0[U40UD6D6nU$) rrrprr$FrrK)!vit_relpos_medium_patch16_rpn_224rcrds rErrsMB!eVhjJ -+ b8B bFJ:F`Y_F` bE LrGc Z[SSSSS[S9n[SSU0[U40UD6D6nU$)rrrrFrrK)vit_relpos_base_patch16_rpn_224rcrds rErrsMB"uWikJ -) `6@ `DHD^W]D^ `E LrGr@)r)ErAloggingr functoolsrtypingrrrrrr ImportErrortyping_extensionsrWtorch.nnr9 torch.jitr timm.datar r timm.layersrrrrrrrrr_builderr _featuresr _manipulaterr _registryrrvision_transformerr__all__ getLoggerrj_loggerrrr!ryrrrNrZ default_cfgsrbrgrnrqrsrwryr{r}rrrrr4rGrErs  55* E   ++0<4 $ %   H %BbiiBJ3"))3l::zsbiisl  %48 X 5"372-2X,0 P-.2 Q.,0 O,.2 Q./3 R/26 U22626 V337&15 U226I%&% PH_D[@WAX?VAXBYE\CZ F]  D[E\CZc*))*sG88 HH