j:\UdZddlZddlZddlZddlZddlZddlmZmZddl m Z ddl m Z ddl mZmZmZmZmZmZmZddlZddlmZmZmZmZmZmZmZdd lmZm Z m!Z!d d l"m#Z#m$Z$erdd l%m&Z&e'Z(ee'e fZ)ee*ee)e(d e+e,fZ-ddhZ.ej/e0Z1e GddZ2Gdde*Z3dZ4dZ5ede-de3fdZ6ededdedfdZ6de-dzde3dzfdZ6de-de'fdZ7de-de'de'fdZ8de'dd fdZ9de*de:fd Z;de*ded#e*e>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` N mime_typer$ct||}||_t|tr| |j|_|SN)super__new__r3 isinstancer2)clsr$r3obj __class__s r0r7zMimeBytes.__new__SsFggooc4((! dI & & +9+< NCM r/r5) r&r'r(__doc__r)r*r-r7 __classcell__)r;s@r0r2r2Bsr  Tz5S4Zr/r2cHtstdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)r ImportErrornumpy)r@s r0 _import_numpyrA^s.   ecdddLLL Lr/cLtstdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr)rr?PILrrs r0_import_pil_imagerDgsA    `    Lr/contentreturncdSr5r.rEs r0_open_as_mime_bytesrIvs9<r/cdSr5r.rHs r0rIrIzsBE#r/c|dSt|trt|St|ttfrtt|St |drt d|}t |dr,tj t|j dnd}t|trtdt||St|tr|ds|d rt d |t|}|jd }|tj |d}t|j|St'|}|st+d |d t|t&rXt d|t|tj |dSt/rddlm}t||jrt dt5j}|jpd}|||t|d|StdtA|d)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r3https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rzConverting PIL Image to bytesPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r8r-r2 bytearray memoryviewhasattrloggerdebugrL mimetypes guess_typer)rM TypeError startswithrgetr%rErexistsFileNotFoundError read_bytesrrCrioBytesIOrQsavegetvaluelowertype)rEr$r3responserbufferrQs r0rIrI~s8 t'5!!"!!!'Iz233)w(((w4 4555||~~BI'SYBZBZdI(W\):):;;A>>`d dC  SQRR R3333'3   j ) ) DW-?-? -J-J D LL>W>> ? ? ?"}}((11H (,,^<>:S:STTT T  uT']] u u u  r/clt|}tj|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rIbase64 b64encodedecode)rE raw_bytess r0 _b64_encoderls,#G,,I  I & & - - / //r/default_mime_typect|tr|dr|St|}|jp|}t j|}d|d|S)N)rOrNdata:roz;base64,)r8r)rZrIr3rhrirj)rErmrkr3 encoded_datas r0_as_urlrqs'3G$6$67W$X$X$G,,I#8'8I#I..5577L 59 4 4l 4 44r/ encoded_imagect}|jtjt j|S)z/Parse a base64-encoded string into a PIL Image.)rDopenr_r`rh b64decode)rrrs r0 _b64_to_imagervs4   E 5:bj!1-!@!@AA B BBr/cNtj|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r#loadsrjrHs r0_bytes_to_listrz :gnn&& ' ''r/cNtj|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rxrHs r0_bytes_to_dictr}r{r/cbt}|jtj|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rDrtr_r`)rErs r0_bytes_to_imagers+   E 5:bj)) * **r/recXt|trtj|n|Sr5)r8r-r#ry)res r0_as_dictrs&#-h#>#> L4:h   HLr/ output_linesdetailsc#hK|D],} t||}n#t$rYdSwxYw||V-dS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrrlineoutputs r0 _stream_text_generation_responsersk  :4IIFF    EEE   LLL s  ((cvK|23d{V} t||}n#t$rYdSwxYw||WV36dS)z/Used in `AsyncInferenceClient.text_generation`.Nrrs r0&_async_stream_text_generation_responsers #d :4IIFF    EEE   LLLL #lls8 --rc|dsdS|dkrtd|dd}t j|}|d)t|d|dtj |}|s |j j n|S)Nro data: [DONE][DONE] signal received.z/nerror error_type) rZstriprlstriprstripr#ryr[_parse_text_generation_errorrparse_obj_as_instancetokentext)rrpayload json_payloadrs r0rrs ??7 # #t zz||~%%5666kk'""))$//G:g&&L  ,*<+@,BRBRS_B`B`aaa( =l K KF$+ 76<  7r/linesc#fK|D]+} t|}n#t$rYdSwxYw||V,dS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputrrrrs r0 _stream_chat_completion_responser3si :4@@FF    EEE   LLL s  ''ctK|23d{V} t|}n#t$rYdSwxYw||WV26dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrs r0&_async_stream_chat_completion_responser@sd :4@@FF    EEE   LLLL ees7 ,,c|dsdS|dkrtdtj|d}|d)t|d|dtj |S)Nrorrrr) rZrrr#ryrr[rrr)rrs r0rrMs ??7 # #t zz||~%%5666:dkk'2288::;;L  ,*<+@,BRBRS_B`B`aaa & ;L I IIr/clientcrK|23d{V}|WV6dSr5) aiter_linesr)rrers r0_async_yield_fromras_**,,djjll-,,s6#_UNSUPPORTED_TEXT_GENERATION_KWARGSr"unsupported_kwargscbt|g|dSr5)r setdefaultextend)r"rs r0'_set_unsupported_text_generation_kwargsr{s-'225"==DDEWXXXXXr/c8t|gSr5)rr[)r"s r0'_get_unsupported_text_generation_kwargsrs . 2 25" = ==r/ http_errorc|j| t|ddp|j}|d}|d}n#t$r|wxYw|t ||}|||)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. Nresponse_error_payloadrr)regetattrr#r[ Exceptionr)rrrr exceptions r0raise_text_generation_errorrs"*&>EEcI\IaIaIcIc G$$[[.. 0 CC Z' s AA A-rrc|dkrt|S|dkrt|S|dkrt|S|dkrt|St |S)N generationincomplete_generation overloaded validation)rrrrr)rrs r0rrsu\!!u%%%,,,(///\!!u%%%\!!u%%%   r/)Pr<rhr_r#loggingrWcollections.abcrr dataclassesrpathlibrtypingrrr r r r r httpxhuggingface_hub.errorsrrrrrrrutilsrrr_generated.typesrr PIL.Imagerr)UrlTPathTr-rRrSContentTTASKS_EXPECTING_IMAGES getLoggerr&rUrr2rArDrIrlrqrvr,rzr+r}rrboolrrrrrr AsyncClientResponserrr*rrrrr.r/r0rsLKK 33333333!!!!!!SSSSSSSSSSSSSSSSSS IHHHHHHHHHTTTTTTTT   c4i %w :M N*+;<  8 $ $  8    <3:>$s)>>>>Nx: d d Ob      r/