Ցi `%SSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r J r SSK J r SSKJr SSKJrJr SS KJrJrJrJrJrJr SS KJrJr SSKrSSKrSS KJ r J!r!J"r" SS K#J$r$ S SK%J&r& S SK'J(r(J)r) S SK*J+r+J,r,J-r-J.r.J/r/ S SK0J1r1J2r2 S SK3J4r4J5r5J6r6J7r7J8r8J9r9 S SK:J;r;Jr> S SK?J@r@ \R"S\R5rC\ "SS55rD\ "SS\D55rE\ "SS\D55rF\G"\R5rI\\JS'"SS\I5rK"SS \R\KS!9rL"S"S#\RR5rO"S$S%\RR5rPS&\QS'\Q4S(jrRS)\QS'\Q4S*jrSS+\QS,\\TS'\4S-jrUS.\LS+\QS/\QS0\VS1\Q4 S2jrWS3rX\L"5rYg)4N)deque) ExitStack)deepcopy) dataclassfield)datetime)chain)Path PurePosixPath)AnyIterableIteratorNoReturnOptionalUnion)quoteunquote)_DEFAULT_CALLBACK NoOpCallback TqdmCallback) isfilelike) constants)CommitOperationCopyCommitOperationDelete)BucketNotFoundErrorEntryNotFoundErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundError) hf_hub_urlhttp_get) BucketFile BucketFolderHfApiLastCommitInfoRepoFile RepoFolder)HFValidationErrorhf_raise_for_status http_backoffhttp_stream_backoff)md5zy (^refs\/convert\/\w+) # `refs/convert/parquet` revisions | (^refs\/pr\/\d+) # PR revisions c<\rSrSr%Sr\\S'\\S'S\4SjrSrg) HfFileSystemResolvedPath.z_Top level Data structure containing information about a resolved Hugging Face file system path.rootpathreturncVURSUR3RS5$)N/)r1r2rstripselfs ^/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/huggingface_hub/hf_file_system.py unresolve"HfFileSystemResolvedPath.unresolve5s&))Adii[)0055N) __name__ __module__ __qualname____firstlineno____doc__str__annotations__r:__static_attributes__r=r<r9r/r/.si I I636r<r/c\rSrSr%Sr\\S'\\S'\\S'\\S'\"SS9r\\S '\"SS9r \\S '\"S SS 9r \ \\S 'Sr Sr g )"HfFileSystemResolvedRepositoryPath9zLData structure containing information about a resolved path in a repository. repo_typerepo_idrevision path_in_repoFinitr1r2N)defaultrepr _raw_revisioncl[RRURS5UR-nUR (aUSUR 3UlODUR[R:wa US[UR53UlOXlURUl g)N@) rREPO_TYPES_URL_PREFIXESgetrIrJrQr1rKDEFAULT_REVISION safe_revisionrLr2)r8 repo_paths r9 __post_init__0HfFileSystemResolvedRepositoryPath.__post_init__Gs5599$.."MPTP\P\\   $+Qt'9'9&:;DI ]]i88 8$+Q}T]]'C&DEDI!I%% r<)r2r1)r>r?r@rArBrCrDrr1r2rQrrZrEr=r<r9rGrG9sTVN LM5!D#!5!D#!$)E#BM8C=B&r<rGc@\rSrSr%Sr\\S'\"SS9r\\S'Sr Sr g ) HfFileSystemResolvedBucketPathRzHData structure containing information about a resolved path in a bucket. bucket_idFrMr1c,SUR-Ulg)Nzbuckets/)r_r1r7s r9rZ,HfFileSystemResolvedBucketPath.__post_init__Ys/ r<)r1N) r>r?r@rArBrCrDrr1rZrEr=r<r9r]r]RsRN5!D#!0r<r] _cached_basec2^\rSrSrSrU4SjrSrSrU=r$)_Cachedaa Metaclass for caching HfFileSystem instances according to the args. This creates an additional reference to the filesystem, which prevents the filesystem from being garbage collected when all *user* references go away. A call to the :meth:`AbstractFileSystem.clear_instance_cache` must *also* be made for a filesystem instance to be garbage collected. This is a slightly modified version of `fsspec.spec._Cached` to improve it. In particular in `_tokenize` the pid isn't taken into account for the `fs_token` used to identify cached instances. The `fs_token` logic is also robust to defaults values and the order of the args. Finally new instances reuse the states from sister instances in the main thread. c4>[TU]"U0UD6 0UlgN)super__init___cache)clsargskwargs __class__s r9ri_Cached.__init__qs $)&) r<cURSS5nUR"U[R"5/UQ70UD6nUR"U[R"5R /UQ70UD6nU(d5UR (a$X@R;aX@lURU$[R"U/UQ70UD6nU(dbUR (aQXPR;aBURUR5nUR5Hup[XhU 5 M XFlXlX&lUR (aU(dX@lX`RU'U$)Nskip_instance_cacheF)pop _tokenize threading get_ident main_threadidentcachablerj_latesttype__call___get_instance_stateitemssetattr _fs_token_ storage_argsstorage_options) rkrlrmskipfs_tokenfs_token_main_threadobjinstance_stateattr state_values r9r{_Cached.__call__yszz/7==i&9&9&;MdMfM"}}S)2G2G2I2O2OaRVaZ`a ZZ)?"K::h' '--5d5f5CCLL-AZZ-O!$,@!A!U!U!W)7)=)=)?%DC{3*@%N# "( ||D& '* 8$Jr<r=) r>r?r@rArBrir{rE __classcell__rns@r9rdrdas r<rdc^\rSrSrSrSrSrSSSSS.S\\S\ \ \S4S \\ S \\ 4U4S jjjr \ S \ S \4Sj5rS\S\S\\S \\ \\44SjrS\S \\ \\44SjrS8S\S\\S \ \\44SjjrS8S\\S S4SjjrS9S\S\S \\ S\\S \ S4 SjjrS8S\S\\S S4SjjrS:S\S\ S\\ S\\S S4 SjjrS;S\S\ S \ S\\S \\ \\\\444 S!jjrSS\S \ S\\S \\\44S-jjr*S.r+S/r,S0r-S\S \4S1jr.\/S4S?U4S2jjjr0\1S35r2S4r3S5r4S6r5S7r6U=r7$)@ HfFileSystema Access a remote Hugging Face Hub repository as if were a local file system. > [!WARNING] > [`HfFileSystem`] provides fsspec compatibility, which is useful for libraries that require it (e.g., reading > Hugging Face datasets directly with `pandas`). However, it introduces additional overhead due to this compatibility > layer. For better performance and reliability, it's recommended to use `HfApi` methods when possible. The file system supports paths for the `hf://` protocol, which follows those URL schemes: * Models, Datasets and Spaces repositories: ``` hf://[@]/ hf://datasets/[@]/ hf://spaces/[@]/ ``` * Buckets (generic storage): ``` hf://buckets// ``` Note: when using the [`HfFileSystem`] directly, passing the `hf://` protocol prefix is optional in paths. Args: endpoint (`str`, *optional*): Endpoint of the Hub. Defaults to . token (`bool` or `str`, *optional*): A valid user access token (string). Defaults to the locally saved token, which is the recommended method for authentication (see https://huggingface.co/docs/huggingface_hub/quick-start#authentication). To disable authentication, pass `False`. block_size (`int`, *optional*): Block size for reading and writing files. expand_info (`bool`, *optional*): Whether to expand the information of the files. **storage_options (`dict`, *optional*): Additional options for the filesystem. See [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.__init__). Usage: ```python >>> from huggingface_hub import hffs >>> # List files >>> hffs.glob("my-username/my-model/*.bin") ['my-username/my-model/pytorch_model.bin'] >>> hffs.ls("datasets/my-username/my-dataset", detail=False) ['datasets/my-username/my-dataset/.gitattributes', 'datasets/my-username/my-dataset/README.md', 'datasets/my-username/my-dataset/data.json'] >>> # Read/write files >>> with hffs.open("my-username/my-model/pytorch_model.bin") as f: ... data = f.read() >>> with hffs.open("my-username/my-model/pytorch_model.bin", "wb") as f: ... f.write(data) ``` Specify a token for authentication: ```python >>> from huggingface_hub import HfFileSystem >>> hffs = HfFileSystem(token=token) ``` rShfN)endpointtoken block_size expand_inforrrrc>[TU]"U0UD6 U=(d [RUlX l[ XS9UlX0lX@l 0Ul 0Ul 0Ul g)N)rr) rhrirENDPOINTrrr%_apirr_repo_and_revision_exists_cache_bucket_exists_cachedircache)r8rrrrrlrrns r9riHfFileSystem.__init__sg $2/2 6I$6$6  89 $&  ,RT!:< r<threading_identr3c0URS5=(d [RUS'URS5US'[U5Vs0sHoDX4_M nnXX#4n[ [ U5R 55nUR5$s snf)zDeterministic token for cachingrr)rVrrsortedr-rCencode hexdigest)rkrrlrmkey tokenize_argshs r9rsHfFileSystem._tokenizes$ZZ 3Iy7I7Iz **W-w.4Vn=nsv{"n=t< M"))+ ,{{} >s BrIrJrKcXU4UR;aLURRX#U[RS9 SURXU4'SURXS4'URXU4$![ [ 4a0nSU4URXU4'SU4URXS4'SnANLSnAf[a.nSU4URXU4'SURXS4'SnANSnAff=f)N)rKrItimeoutTNF)rr repo_inforHF_HUB_ETAG_TIMEOUTrr)r )r8rIrJrKes r9_repo_and_revision_exist%HfFileSystem._repo_and_revision_exists  )1U1U U ^ ##)YMjMj$Xb44i(5STS]44i$5OP33Y4RSS,->? \W\^_W_44i(5STSXZ[S[44i$5OP( ^W\^_W_44i(5STS]44i$5OP ^s#)A00C&&B++ C&8$C!!C&r_cXR;a+URRU5 SURU'URU$![anSU4URU'SnAN/SnAff=f)NrF)rr bucket_infor)r8r_rs r9_bucket_existsHfFileSystem._bucket_existssr 55 5 B %%i08B)))4((33 ' @7._align_revision_in_path_with_revision3sS##/4D4P$78H7IIijrist-- O,Or<z)**7>>?OPE(X$ 9N-N'B'F'FrK['\'c'cdg'h +0;;=(9I9O9OPSUV9W6(,#%L@IYAZ\de/3/L/LYai/j,'.)$4#' ),$**S/"12E)F&.1hhtzz#qr7J.K+,0JJsOA,>)14$**S/!":M1N.0: /3/L/LYai/j,'.!#(?AR'STT";'E 595R5RS\go5p2/61$<-d8GLd{,0JJsA,>)@IYAZ\de#' )-)F)Fy[c)d & #Q*)*\]]'389S9S1 FV  r<cU(d5URR5 URR5 gURU5nUR 5nU(a6URR US5 UR U5nU(aM6UR(d[U[5(aqURR URURS4S5 URR URURUR4S5 gURR URS5 gg)a3 Clear the cache for a given path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.invalidate_cache). Args: path (`str`, *optional*): Path to clear from cache. If not provided, clear the entire cache. N)rclearrrr:rr_parentr2rrGrIrJrKrr_)r8r2 resolved_paths r9invalidate_cacheHfFileSystem.invalidate_caches MM   !  0 0 6 6 8 --d3M **,D !!$-||D)$ !%%m-OPP88<<&00-2G2GNPT88<<&00-2G2GI_I_`bf--11-2I2I4P&r<mode)HfFileSystemFileHfFileSystemStreamFilec UbUO URnUbX5S'SU;a [S5eUS:Xa[X4X$S.UD6$[X4X$S.UD6$)Nraz/Appending to remote files is not yet supported.r)rrK)rrrr)r8r2rrrKrms r9_openHfFileSystem._opensh$.#9Zt  !#-< $;%&WX X ?)$]4]V\] ]#DWTWPVW Wr<c URXS9n[U[5(a0URR UR UR /S9 OoURRURURURURURURS5URS5S9 URUR5S9 g)NrKdeletecommit_messagecommit_description)rLrJrrIrKrrr2)rrr]rbatch_bucket_filesr_r2 delete_filerLrJrrIrKrVrr:)r8r2rKrmrs r9_rmHfFileSystem._rms))$)B m%C D D II ( ()@)@-J\J\I] ( ^ II ! !*77%--jj'11&//%zz*:;#)::.B#C "  =#:#:#<=r< recursivemaxdepthc TURXS9nURXX4S9n[U[5(agUVs/sH5oR U5(aMURU5R PM7 nnUR RURUS9 OUVs/sH5oR U5(aMURU5R PM7 n nU V s/sH n [U S9PM n n SWS3n X(aSOS- n XbS US3OS- n UR RURURURU URURS U 5URS 5S 9 UR!UR#5S9 g s snfs snfs sn f)ad Delete files from a repository. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.rm). > [!WARNING] > Note: When possible, use `HfApi.delete_file()` for better performance. Args: path (`str`): Path to delete. recursive (`bool`, *optional*): If True, delete directory and all its contents. Defaults to False. maxdepth (`int`, *optional*): Maximum number of subdirectories to visit when deleting recursively. revision (`str`, *optional*): The git revision to delete from. r)rrrKr)rLzDelete  z recursively rSNz up to depth rr)rJrIr operationsrKrrr)r expand_pathrr]isdirr2rrr_r create_commitrJrIrrKrVrr:) r8r2rrrKrmrpathsr paths_in_reporLrrs r9rmHfFileSystem.rms6))$)B   X a m%C D D?D]utJJW[L\2d''-22uF] II ( ()@)@ ( PFKdedS]S]^bSc9T..t499eMd_lm_l|/\J_lJm&tfA.N  nr AN 

[!WARNING] > Note: When possible, use `HfApi.list_repo_tree()` for better performance. Args: path (`str`): Path to the directory. detail (`bool`, *optional*): If True, returns a list of dictionaries containing file information. If False, returns a list of file paths. Defaults to True. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to list from. Returns: `list[Union[str, dict[str, Any]]]`: List of file paths (if detail=False) or list of file information dictionaries (if detail=True). r)rrKNnamer)rr:_ls_treerr2rrlen) r8r2rrrKrmroutos r9lsHfFileSystem.lss4))$)B &&( 2--SgSFSCs:c":cV9c"::" 2 %%%dD1-- T 2aGaZ`aC!7cvY$%61c7C73x1}%dD1 2#;s*AC"AC# B:3B:9#CCc | UbUOURb UROSnURXS9nUR5nURnU(aUOSn/n XR;GaU(GdURUn U R U 5 /n U(aSn [ U V s/sHoSS:XdM X4PM sn 5nU(aUR5upUbX::a}USUR;aU RUS5 OUURUSn U R U 5 UR U V s/sHn U SS:XdMU S-U 4PM sn 5 U(aM/nU(aA[U[5(a,U Vs/sHnUSbM URUS5PM! nnU(aU (dU(Ga_U(GaW[RRU U-5nURS 5(dUU:XdU[!U U5;aUR#S 5OURU5nUb"U[%U5SR'S 5nUU-nU Vs/sH#nUSR)US -5(aM!UPM% n n[+UR5H:nUR)US -5(dMURR-US5 M< URR-US5 U R UR/UUS UUUS 95 U $[U[05(a&UR3UR4URUS 9nOFUR6R9UR:URUUUR<UR>S 9nUGHun US -U R-n[U [@5(aHUU RBSU RDU RFU RHU RJU RLS.nO[U [N5(a2UU RBSU RHU RPU RRS.nOC[U [T5(aUSSU RVU RJS.nOUSSU RRS.nURUS5nURRYU/5RU5 U[%U5SR'S 5n UbX::dGMdU RU5 GMx U $s sn fs sn fs snfs snf)NFrrrrz directoryr last_commitr5T)rrrKrr)prefixr)rexpandrKrIfilersizerzblob_idlfsxet_hashrsecurity)rrrzr mtime uploaded_atrrrrztree_idr)rrrzr)-rrr:r1rextendrpopleftappendrrGrosr2 commonprefixendswithr r6rr startswithlistrrrr]_list_bucket_tree_with_foldersr_rlist_repo_treerJrKrIr'rr r r rr r#r rr(r setdefault)r8r2rrrKrrr root_pathrcached_path_infosdirs_not_in_dircachedepth path_info dirs_to_visitdir_infodirs_not_expandedr common_prefix common_pathcommon_path_depth cached_pathtree cache_pathcache_path_info parent_paths r9rHfFileSystem._ls_tree$s'2KTM]M]Mi9I9Iot ))$)B &&(!&& (8a ==  $ d 3  JJ( )#%  %9Jo9JIX^N_cnNn'e'9Jo! $&3&;&;&=OE'5+<#F+4==@0778HI04 hv>N0O-JJ'89)006G!"5F '0'8K'G%;UQY $:5F!"$m !# z-9[\\FI$fcQ}M]% T/ T/ T4T4+ T9T9rcURRXUS9n0nU(aSURS5-OSn/nUHnURU5 U(dM[ [ UR 5R5SU*S- Hn [S[U 5URS9n U R U;a!URU 5 XU R 'MRU RcMaXZR n U RbU RU R:dMU RU l M M U(d[SUS US 35eU$) z# URXRS5S9R5n[TU]"U/UQ70UD6ShvN gN7f)a Return all files below the given path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.walk). Args: path (`str`): Root path to list files from. Returns: `Iterator[tuple[str, list[str], list[str]]]`: An iterator of (path, list of directory names, list of file names) tuples. rKrN)rrVr:rhwalk)r8r2rlrmrns r9r:HfFileSystem.walksI   :0F GQQS7<6t6v666sAAA Ac >URXRS5S9R5n[TU]"U4SU0UD6$)a( Find files by glob-matching. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.glob). Args: path (`str`): Path pattern to match. Returns: `list[str]`: List of paths matching the pattern. rKrr)rrVr:rhglob)r8r2rrmrns r9r=HfFileSystem.globsC   :0F GQQSw|D>8>v>>r<withdirsc PUbUS:a [S5eURXS9nUR5nUR"U4SXRS.UD6n U(dU V s/sHoSS:wdM U PM n n O$UR"U40UD6n U SS:XaU /U -OU n U V s0sHoSU _M n n [U 5n U(dU $U V s0sHoX_M sn $s sn fs sn f![ a; UR"U4S U0UD6SS :XaU00n N`0n Nd![ a 0n Nsf=ff=fs sn f) aE List all files below path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.find). Args: path (`str`): Root path to list files from. maxdepth (`int`, *optional*): Maximum depth to descend into subdirectories. withdirs (`bool`, *optional*): Include directory paths in the output. Defaults to False. detail (`bool`, *optional*): If True, returns a dict mapping paths to file information. Defaults to False. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to list from. Returns: `Union[list[str], dict[str, dict[str, Any]]]`: List of paths or dict of file information. rzmaxdepth must be at least 1rT)rrrrzrrrKr)rrr:rinforFileNotFoundErrorr)r8r2rr?rrrKrmrrrr namesrs r9findHfFileSystem.finds]@  HqL:; ;))$)B &&( .--cgc\bcC"%B#Q6k)Aq#B!IId5f5 +4V+< +KykC'QT),-AV9a<C-s L056#)O6 6C .!"  99T?H??G6Q*CC$   *7sGC C&CCD# D & D D  DD DD path1path2c 4URXS9nURX#S9n[U[5(d[U[5(a [S5eURUR:H=(a UR UR :HnU(aSUSU3nUR RUR URURURSU5URSS5[URURURS9/S 9 OURUS URS9n U R5n S S S 5 SUSU3nUR RW URUR URURURURSU5URS5S 9 UR!UR#5S 9 UR!UR#5S 9 g !,(df  N=f)aB Copy a file within or between repositories. > [!WARNING] > Note: When possible, use `HfApi.upload_file()` for better performance. Args: path1 (`str`): Source path to copy from. path2 (`str`): Destination path to copy to. revision (`str`, *optional*): The git revision to copy from. rz)Copy from/to buckets is not available yetzCopy z to rrrS)src_path_in_reporL src_revision)rJrIrKrrrrbNpath_or_fileobjrLrJrrIrKrrr)rrr]rrIrJrrrKrVrrLopenread upload_filerrr:) r8rFrGrKrmresolved_path1resolved_path2 same_reporfcontents r9cp_fileHfFileSystem.cp_file6s **5*D**5*D n&D E E :J J &&QR R  $ $(@(@ @ u^E[E[_m_u_uEu  $UG4w7N II # #&..(22'00%zz*:NK#)::.BB#G')7)D)D%3%@%@%3%<%< $ 5$1H1HIQ&&(J$UG4w7N II ! ! '+88&..jj(22'00%zz*:NK#)::.B#C "  >#;#;#=> >#;#;#=>JIs <H  Hc UR"U400UESS0ED6nSU;a$USc[SUS35eUSR$SU;aUS(aUS$SU;aUS(aUS$[SUS US 35e) a+ Get the last modified time of a file. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.modified). Args: path (`str`): Path to the file. Returns: `datetime`: Last modified time of the file. rTrz9'modified' is not implemented for repository paths like 'r.r rz'Cannot determined 'modified' for path 'z ' (info: ))rArdate)r8r2rmrAs r9modifiedHfFileSystem.modifiedrsyyA!@F!@M4!@A D M"*),efjekkl*mnn &++ + _g= d "tM': & &%(OPTvU^_c^dde&fg gr<c &URXS9nUR5nURSURb UROS5nUR(dUSSS.n[ U[ 5(aSUS'[ U[ 5(asU(alURRURURURS 9S n0UES[URURURS 9S .EnGOw[ U[ 5(acUR#U5n UR%XS 9 UR&U V s/sHoSU:XdM U PM n n U (d [)US5 U SnGOSnUR#U5n U(d XR&;aUR%U 5 XR&;aAUR&U V s/sHoSU:XdM U PM n n U (d [)US5 U SnU(dUbU(GacU(Ga[USGcTURR+URUR,UURURS9n U (d [)US5 U Sn [ URURURSUR.S9R5n[ U [05(aXUS-U R-U R2SU R4U R6U R8U R:U R<S.nO,US-U R-SSU R>U R:S.nU(dSVs0sHoX_M nnUceU$s sn fs sn fs snf)a Get information about a file or directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.info). > [!WARNING] > Note: When possible, use `HfApi.get_paths_info()` or `HfApi.repo_info()` for better performance > (or `HfApi.get_bucket_paths_info()` or `HfApi.bucket_info()` for buckets) Args: path (`str`): Path to get info for. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to get info from. Returns: `dict[str, Any]`: Dictionary containing file information (type, size, commit info, etc.). rrNFrr)rrrzr)rIrK)oidtitlerZ)rr)rr)rrKrIrS)rLrQr5rrr) rr:rVrr2rrGrlist_repo_commitsrJrIrKr& commit_idr` created_atr]rrrrget_paths_inforLrQr'rr r r rr r)r8r2rrKrmrrrrr+rout1 paths_infor rks r9rAHfFileSystem.infos^,))$)B &&(jj t/?/?/K4++QV !!#C -)KLL%)M"-)KLLQ\"ii99!))]5L5LWdWmWm: ##1'119J9JQ\QgQg$ 'E F F,,t,K GGKG 1#}}[9O9!vY$=NA9DO%dD1q'CC,,t,K;mm#C $mm+#'==#=S#=a6dAR#=S)$51g#++##mBTB\!YY55!))!..&*33+55 6 ")$5&qM >!++!))!**!#"/"="=  )+ i22 )C).. @ ) &#,#4#4(}}$-$6$6'0'<'<$-$6$6 C!*C).. @ ! +#,#4#4'0'<'< C#.FG.Fcf9.FCG qPTTHs NN N (N -Nc URSS5(aURU5 UR"U40UD6 g! g=f)aq Check if a file exists. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.exists). > [!WARNING] > Note: When possible, use `HfApi.file_exists()` for better performance. Args: path (`str`): Path to check. Returns: `bool`: True if file exists, False otherwise. rFT)rVrrA)r8r2rms r9existsHfFileSystem.existssD  zz)U++%%d+ IId %f % s ;>AcRURU5SS:H$![a gf=f)a) Check if a path is a directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.isdir). Args: path (`str`): Path to check. Returns: `bool`: True if path is a directory, False otherwise. rzrF)rAOSErrorr8r2s r9rHfFileSystem.isdirs1 99T?6*k9 9  s  &&c@URU5SS:H$! g=f)a  Check if a path is a file. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.isfile). Args: path (`str`): Path to check. Returns: `bool`: True if path is a file, False otherwise. rzrF)rArns r9isfileHfFileSystem.isfile$s) 99T?6*f4 4 scURU5n[U[5(a2URSURS[ UR 53nO?[URURURURURS9nURU5(aURSSS5nU$)z Get the HTTP URL of the given path. Args: path (`str`): Path to get URL for. Returns: `str`: HTTP URL to access the file or directory on the Hub. z /buckets/z /resolve/)rIrKrz/tree/r)rrr]rr_rr2r!rJrLrIrKrreplace)r8r2rurls r9ruHfFileSystem.url6s))$/ m%C D D]]O9]-D-D,EYuUbUgUgOhNijC%%**'11&// C ::d  ++k8Q7C r<c >URS5n[UR55S1- n[U[[ 45(a[ U5S:a[T U] "X4X4S.UD6$[U5(aUnO,URU5(a[R"USS9 g[U[[45(a2[R"[RR!U5SS9 SnUc[#US5nSnUR%5n UR'XS 9n UR)XS 9S n UR+U 5 [-UR/U R155UUU SUR2R55[U[ 5(a UR6OSS 9 UR9U 5 U(aUR;5 gg!U(aUR;5 ff=f) a Copy single remote file to local. > [!WARNING] > Note: When possible, use `HfApi.hf_hub_download()` or `HfApi.download_bucket_files` for better performance. Args: rpath (`str`): Remote path to download from. lpath (`str`): Local path to download to. callback (`Callback`, *optional*): Optional callback to track download progress. Defaults to no callback. outfile (`IO`, *optional*): Optional file-like object to write to. If provided, `lpath` is ignored. rKr)callbackoutfileT)exist_okNFwbrr)ru temp_filedisplayed_filename expected_size resume_sizeheaders _tqdm_bar)rVsetkeysrrrrrhget_filerrrmakedirsrCr r2dirnamerNtellrrAset_sizer"rur:r_build_hf_headerstqdmseekclose) r8rpathlpathrxryrmrKunhandled_kwargs close_file initial_posresolve_remote_pathr~rns r9rHfFileSystem.get_filePs$::j)v{{}- <(\<$@AASIYEZ]^E^7#E_8_X^_ _ e  G ZZ   KK - ec4[ ) ) KK. > ?5$'GJlln #///I % ;FC -( HH0::<=!#(+ 335+5h +M+M(--SW  LL % z s A6GG8c[S5e)zA context within which files are committed together upon exit Requires the file class to implement `.commit()` and `.discard()` for the normal and exception cases. (Transactional commits are not supported.rr7s r9 transactionHfFileSystem.transactions""LMMr<c[S5e)z@Begin write transaction for deferring files, non-context versionrrr7s r9start_transactionHfFileSystem.start_transactions""LMMr<cp[[U5URURUR 544$rg) make_instancerzrrr|r7s r9 __reduce__HfFileSystem.__reduce__s9 J      $ $ &    r<c[UR5[UR5[UR5S.$)N)rrr)rrrrr7s r9r| HfFileSystem._get_instance_states4 //78\8\/]$,T-F-F$G  r<)rrrrrrrrrg)rKNN)FNN)TFN)FFNNN)NFFFN)FNr3N)8r>r?r@rArB root_markerprotocolrrCrboolintri classmethodrstuple ExceptionrrrGr]rrrrrrdictr rrr r#r$rrr:r=rDrVrr[rArjrrqrurrpropertyrrrr|rErrs@r9rrs@DKH #'(,$(&* <3-<T3_% < SM < d^ <<6    TT'*T6>smT tXi(( )T&44dHY>x}>$>& "&"& 0>0>0>3- 0> 3- 0> 0>f`d&;&;!%&;7;&;OWX[}&; eCc3h'( )&;V "&&*"&KKK K 3- K d^ K3-KZ&&&)&6:& % L01 2&P77(5d3iQUVYQZAZ;[2\7 ?? ?4PS9??&#'"&;7;73-;7 ;7  ;7  ;73-;7 tCy$sDcN233 4;7z:?S:?:? :?[_:?xhShxh2lltlx}lbfgjlogobpl\2$$4/@< < |NNN    r<r) metaclassc^\rSrSrSS\S\S\\4U4SjjjrU4SjrS\ S \ S \ 4S jr SS jr SS \ S S4SjjrSU4SjjrS \4SjrSrU=r$)riNfsr2rKc >URX#S9Ul[TU]"XRR 540UD6 U g![a+nSURSS5;a[US35UeeSnAff=f)NrwrrSB. Make sure the repository and revision exist before writing data.)rrrBrVrhrir:)r8rr2rKrmrrns r9riHfFileSystemFile.__init__s !#!ID  //99;FvF ! fjj,,'c\]   sA A8 &A33A8cD>[US5(dg[TU] 5$Nr)hasattrrh__del__r8rns r9rHfFileSystemFile.__del__s t_-- w  r<startendr3cSSUSUS- 30URRR5EnUR5n[ SXC[ R S9n[U5 UR$)Nrangebytes=-rGETrr) rrrrur+rHF_HUB_DOWNLOAD_TIMEOUTr*rU)r8rrrrurs r9 _fetch_rangeHfFileSystemFile._fetch_rangesk veWAcAgY/ ggll,,. hhj i>_>_ `Ayyr<c8[R"SSS9Ulg)Nzhffs-F)rr)tempfileNamedTemporaryFiler|r7s r9_initiate_upload!HfFileSystemFile._initiate_uploads!44GERr<finalc NURRS5 URR5nURR U5 U(GaURR 5 [ UR[5(adURRRURRURRURR4/S9 OURRRURRURR URR"URR$URR&URR(UR*R-S5UR*R-S5S9 [.R0"URR5 URR3URR55S9 gg)Nr)addrrrLr)bufferrrOr|writerrrr]rrrr_rr2rPrLrJrrIrKrmrVrremoverr:)r8rblocks r9 _upload_chunkHfFileSystemFile._upload_chunks    " U#  NN "$,,.LMM //&&008K8KTM_M_MdMd7e6f0 (($(NN$7$7!%!3!3!@!@ ..66''--"00::!//88#';;??3C#D'+{{7K'L)  IIdnn)) * GG $ $''113 % % r<cT>URS:XaxUbUS:XaoURS:Xa_URRURSSS9nUR 5nU=R[ U5- slUsSSS5 $[TU]U5$!,(df  N=f)zRead remote file. If `length` is not provided or is -1, the entire file is downloaded and read. On POSIX systems the file is loaded in memory directly. Otherwise, the file is downloaded to a temporary file and read from there. rKNr^r)r)rlocrrNr2rOrrh)r8lengthrTrrns r9rOHfFileSystemFile.reads 99 &.FbLdhhRSmdii!<ffhCH$=<w|F## =r?r@rArrCrrirrbytesrrrrrOrurErrs@r9rrst < s hsm  ! #CES4D4 $&S&&r<rc ^\rSrSrSS\S\S\S\\S\S\4 U4SjjjrSS \S \4S jjr SS \4S jjr SS\ \ S \S\ 4Sjjr S\4SjrU4SjrSrSrSrU=r$)rirr2rrKr cache_typec >US:wa[SU35eUS:wa[SU35eSU;a[SUS35eURX$S9UlURR 5SS .Ul[T U] "XRR 54X5US .UD6 SUl U [5Ul SUl [5Ulg![a/nSUR S S 5;a[US 35UeSnANSnAff=f)Nrz:HfFileSystemStreamFile only supports block_size=0 but got nonez?HfFileSystemStreamFile only supports cache_type='none' but got rz;HfFileSystemStreamFile only supports reading but got mode='r.rrrSr)rrrrr)rrrrBrVr:detailsrhriresponser _exit_stack_stream_iterator bytearray_stream_buffer) r8rr2rrKrrrmrrns r9riHfFileSystemStreamFile.__init__s1 ?YZdYefg g  ^_i^jkl l $;Z[_Z``abc c !#!ID !% 2 2 < < >M   "",,. 59]g kq 37  $;;?'k! fjj,,'c\]- sC D %DD rwhencec^US:XaUS:XagXR:XaUS:Xag[S5e)NrrzCannot seek streaming HF file)rr)r8rrs r9rHfFileSystemStreamFile.seeks0 !8!  ((?v{ 899r<rcURcUR5 SnURb URcgURURU5nU=R[ U5- slU$![ aD URbURR5 U(aeUR5 SnOf=fM)zRead the remote file. If the file is already open, we reuse the connection. Otherwise, open a new connection and read from it. If reading the stream fails, we retry with a new connection. FTr<)r_open_connectionr_read_from_streamrrrr)r8r retried_oncers r9rOHfFileSystemStreamFile.read&s ==  ! ! #  $==(D,A,A,I,,T-B-BFKCH$  $==,MM'')%%'#  $sA9;A99A CCiteratorr3cUS:XagUS:aT[UR5nURR5 UHnURU5 M [ U5$U[ UR5::a)[ URSU5nURSU2 U$[UR5nURR5 UHdnU[ U5- nU[ U5:aURU5 M3URUSU5 URRXFS5 O [ U5$)zRead up to `length` bytes from stream buffer and stream. If length < 0, read until EOF. If EOF is reached before length, fewer bytes may be returned. rr<N)rrrrrr)r8rrbufchunkresultneeds r9r(HfFileSystemStreamFile._read_from_streamBs# Q; A:D//0C    % % '! 5!":  S,,- -4..w78F##GVG,M++, !!#ECH$Dc%j  5! 5$<(##**5<8Szr<cLURRUR5$rgrr7s r9ruHfFileSystemStreamFile.urldrr<cx>[US5(dgURR5 [TU]5$r)rrrrhrrs r9rHfFileSystemStreamFile.__del__gs2t_--   w  r<c[URURURURUR R 44$rg)reopenrr2r blocksizecacherr7s r9r!HfFileSystemStreamFile.__reduce__ns0DIIt~~tzzWWWr<c @URR5 SUlUR5nURR R 5nURS:aSURS3US'URR[SUU[RS95Ul [UR5 URR#5Ulg![a,nURR S:Xa SUl SnAgeSnAff=f) z%Open a connection to the remote file.NrrrRangerri)rrrrurrrrr enter_contextr,rrrr*r status_code iter_bytes)r8rurrs r9r'HfFileSystemStreamFile._open_connectionqs !!# $hhj'',,002 88ar?r@rArrCrrrirrOrrrrurrrrErrs@r9rrs "& !* !*!* !* 3- !*  !*!*!*F::S:$3$8 (5/ 3 PU D&S&!X;;r<rrKr3cP[RU5(aU$[U5$rg)rr safe_quoters r9rXrXs#288BB8\ S[H\\r<sc[USS9$)NrS)safe)r)r s r9rrs  r<r2rcUn[U[5(aUS3nO5[U[5(aUS3nO[U[5(aUS3n[ U5Ue)Nz (repository not found)z (revision not found)z (invalid repository id))rrr r)rB)r2rmsgs r9rrse C#.//-. C. / /+, C* + +./ C c)r<rrrrc"URXX4S9$)Nr)rN)rr2rrrs r9rrs 774z7 QQr<c`U"U0UD6nUR5HupV[XEU5 M U$rg)r}r~)rkrlrmrrrrs r9rrs6 d f B+113+&4 Ir<)Zrrerrt collectionsr contextlibrcopyr dataclassesrrr itertoolsr pathlibr r typingr r rrrr urllib.parserrfsspechttpxfsspec.callbacksrrr fsspec.utilsrrSr _commit_apirrerrorsrrrrr file_downloadr!r"hf_apir#r$r%r&r'r(utilsr)r*r+r,utils.insecure_hashlibr-compileVERBOSErr/rGr]rzAbstractFileSystemrbrDrdrspecAbstractBufferedFilerrrCrXrrrrrrhffsr=r<r9r)s  ('EE' JJ#C0YY\\'!jj JJ  66 6 &)A& &0 0%=0 0223 c3/l/dZ 6,,Z z H&v{{77H&VR;V[[==R;j]C]C]##**(9*=*(*R|R3RcRsRPSR~r<