RЦi9' SrSSKrSSKJrJrJr SSKrSSKJrJ r SSK J r SSK J r JrJrJrJrJrJr \"SS 9r\"S S 9r\\\R."S S 94r\\\\R2"S S 94r\\\\R2"S S 94rS \SS4Sjr\R;SS/S9S\R<SS4S\S\ S\S\SS4 Sjj5r\R;SS/S9SSSSSSSSS.S\S\\\R2"SS 94S \\\R2"S!S 94S"\\\R2"S#S 94S$\\\R2"S%S 94S&\\\R2"S'S 94S(\\\R2"S)S 94S*\\\R2"S+S 94S\S,\\\\R2"S-S 94S\S.\\ \R2"S/S 94S0\\ \R2"S1S 94S2\\\ \R2"S3S 94S4\\\ \R2"S5S 94S6\\\!\R2"S7S 94SS4"S8jj5r"\R;SS9/S9SYS\\\R2"SS 94S\S"\\\\R2"S:S 94S\S\SS4 S;jj5r#SZS\SS4S<jjr$\R;S=S>/S9"\$5 \R;S?S@SA9"\$5 \RK\SBSC9 \R;SD/S9S[S\S\S\SS4SEjj5r&\R;SF/S9S\S\S\S\\\\R2"SS 94S"\\\\R2"S#S 94S$\\\\R2"S%S 94S&\\\\R2"S'S 94S \\\\R2"SGS 94SH\\\\R2"SIS 94S,\\\\R2"S-S 94S.\\\ \R2"S/S 94S0\\\ \R2"S1S 94S2\\\ \R2"S3S 94S4\\\ \R2"S5S 94S6\\\!\R2"S7S 94S\SS4 SJjj5r'\R;SK/S9S]S\S\SL\\(\R2"SMSNS 94S\SS4 SOjj5r)\R;SP/S9S[S\S\S\SS4SQjj5r*\R;SR/S9S]S\S\SS\\(\R2"STSUS 94S\SS4 SVjj5r+\R;SW/S9S[S\S\S\SS4SXjj5r,g)^z2CLI commands for Hugging Face Inference Endpoints.N) AnnotatedAnyOptional)InferenceEndpointInferenceEndpointScalingMetric)HfHubHTTPError) FormatOpt OutputFormatQuietOptTokenOpt get_hf_apiprint_list_output typer_factoryz(Manage Hugging Face Inference Endpoints.)helpz.Interact with the Inference Endpoints catalog.zEndpoint name.z_The namespace associated with the Inference Endpoint. Defaults to the current user's namespace.endpointreturncl[R"[R"URSSS95 g)NTindent sort_keys)typerechojsondumpsraw)rs f/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/huggingface_hub/cli/inference_endpoints.py_print_endpointr,s JJtzz(,,qDABzhf endpoints lsz"hf endpoints ls --namespace my-org)examplesF namespaceformatquiettokenc [US9nURXS9nUVs/sHowRPM nnS[[[4S[[4Sjn [UUUS /S QU S 9 g![aGn[R"SU35 [R "UR RS9UeSnAff=fs snf) z6Lists all Inference Endpoints for the given namespace.r%)r"r%zListing failed: codeNitemrc URS05nURS05nURS05nURS05n[URSS55[[U[5(aURSS5OS5[[U[5(aURSS5OS5[[U[5(aURS S5OS5[[U[5(aURS S5OS5[[U[5(aURS S5OS5[[U[5(aURS S5OS5[[U[5(aURS S55/$S5/$)Nstatusmodelcomputeprovidername repositorystatetask framework instanceTypevendorregion)getstr isinstancedict)r*r,r-r.r/s rrow_fnls..row_fnAsY(B'"%((9b)88J+ $ % z%/F/F ,+B O :fd+C+C 7B' L E4)@)@ &"%b I j.E.E +r*2 N :gt3L3L NB/RT U j4.H.H Xr*b Q j4.H.H Xr* Q  OQ Q  r r0)NAMEMODELSTATUSTASK FRAMEWORKINSTANCEVENDORREGION)itemsr#r$id_keyheadersr=)rlist_inference_endpointsrrrExitresponse status_coderr<r:rlistr) r"r#r$r%api endpointserrorrresultsr=s rlsrS0s 5 !CE0090R -66I||IG6 T#s(^ S  ` - E %eW-.jjenn889uDE7sA+B?+ B<5AB77B<deployzChf endpoints deploy my-endpoint --repo gpt2 --framework pytorch ...)r0r!)r"r4r% min_replica max_replicascale_to_zero_timeoutscaling_metricscaling_thresholdr0repozeThe name of the model repository associated with the Inference Endpoint (e.g. 'openai/gpt-oss-120b').r5z@The machine learning framework used for the model (e.g. 'vllm'). acceleratorz?The hardware accelerator to be used for inference (e.g. 'cpu'). instance_sizezNThe size or type of the instance to be used for hosting the model (e.g. 'x4'). instance_typezYThe cloud instance type where the Inference Endpoint will be deployed (e.g. 'intel-icl').r8zTThe cloud region in which the Inference Endpoint will be created (e.g. 'us-east-1').r7zVThe cloud provider or vendor where the Inference Endpoint will be hosted (e.g. 'aws').r4zCThe task on which to deploy the model (e.g. 'text-classification').rUzVThe minimum number of replicas (instances) to keep running for the Inference Endpoint.rVzRThe maximum number of replicas (instances) to scale to for the Inference Endpoint.rWzFThe duration in minutes before an inactive endpoint is scaled to zero.rXz!The metric reference for scaling.rYzeThe scaling metric threshold used to trigger a scale up. Ignored when scaling metric is not provided.ch[U S9nURUUUUUUUUUU U U U UUU S9n[U5 g)z3Deploy an Inference Endpoint from a Hub repository.r')r0r2r5r[r\r]r8r7r"r4r%rUrVrXrYrWN)rcreate_inference_endpointr)r0rZr5r[r\r]r8r7r"r4r%rUrVrWrXrYrOrs rrTrT[s^l 5 !C,, ## %+3!-H&Hr zChf endpoints catalog deploy --repo meta-llama/Llama-3.2-1B-InstructzPThe hardware accelerator to be used for inference (e.g. 'cpu', 'gpu', 'neuron').c[US9nURUUUUUS9n[U5 g![aGn[R"SU35 [R "UR RS9UeSnAff=f)z4Deploy an Inference Endpoint from the Model Catalog.r')repo_idr0r[r"r%zDeployment failed: r(N) r&create_inference_endpoint_from_catalogrrrrKrLrMr)rZr0r[r"r%rOrrQs rdeploy_from_catalogrcs& 5 !C E==# > H E (01jjenn889uDEs* A;AA66A;c6[US9nURUS9n[R"[R"SU0SSS95 g![aGn[R"SU35 [R "UR RS9UeSnAff=f) zList available Catalog models.r'zCatalog fetch failed: r(NmodelsrTr) rlist_inference_catalogrrrrKrLrMrr)r%rOrerQs r list_catalogrgs 5 !CE++%+8  JJtzz8V,Q$GH E +E734jjenn889uDEsA BABBrSzhf endpoints catalog lsz list-catalogT)r0hiddencatalog)r0z!hf endpoints describe my-endpointc[US9nURXUS9n[U5 g![aGn[R"SU35 [R "UR RS9UeSnAff=f)z+Get information about an existing endpoint.r'r0r"r%zFetch failed: r(N) rget_inference_endpointrrrrKrLrMrr0r"r%rOrrQs rdescribernsv 5 !CE--4TY-Z H E ^E7+,jjenn889uDE' A8AA33A8z/hf endpoints update my-endpoint --min-replica 2zBThe machine learning framework used for the model (e.g. 'custom').revisionzrThe specific model revision to deploy on the Inference Endpoint (e.g. '6c0e6080953db56375760c0471a8c5f2929baf11').c[US9nURUUUUUUUUUU U U U U US9n[U5 g![aGn[R"SU35 [R "UR RS9UeSnAff=f)zUpdate an existing endpoint.r')r0r"r2r5rpr4r[r\r]rUrVrWrXrYr%zUpdate failed: r(N) rupdate_inference_endpointrrrrKrLrMr)r0r"rZr[r\r]r5rpr4rUrVrWrXrYr%rOrrQs rupdaterss^ 5 !CE00#''##"7)/1 (H E _UG,-jjenn889uDEs4 BABBzhf endpoints delete my-endpointyesz--yeszSkip confirmation prompts.cU(dI[R"SUS35nX@:wa*[R"S5 [R"SS9e[ US9nUR XUS9 [R"S US 35 g ![ aGn[R"SU35 [R"URRS9UeS nAff=f) z)Delete an Inference Endpoint permanently.zDelete endpoint 'z'? Type the name to confirm.zAborted.rr(r'rkzDelete failed: Nz Deleted 'z'.) rpromptrrKrdelete_inference_endpointrrLrM)r0r"rtr% confirmationrOrQs rdeleteryys ||&7v=Y$Z[   JJz "**!$ $ 5 !CE %%4E%R  JJ4&#$ E _UG,-jjenn889uDEsB CACCzhf endpoints pause my-endpointc[US9nURXUS9n[U5 g![aGn[R"SU35 [R "UR RS9UeSnAff=f)zPause an Inference Endpoint.r'rkzPause failed: r(N) rpause_inference_endpointrrrrKrLrMrrms rpauser|sv 5 !CE//TV[/\ H E ^E7+,jjenn889uDErozhf endpoints resume my-endpointfail_if_already_runningz--fail-if-already-runningzWIf `True`, the method will raise an error if the Inference Endpoint is already running.c[US9nURUUUU(+S9n[U5 g![aGn[R"SU35 [R "UR RS9UeSnAff=f)zResume an Inference Endpoint.r')r0r"r% running_okzResume failed: r(N) rresume_inference_endpointrrrrKrLrMr)r0r"r}r%rOrrQs rresumers 5 !C E0022 1 H E _UG,-jjenn889uDEs. A?AA::A?z&hf endpoints scale-to-zero my-endpointc[US9nURXUS9n[U5 g![aGn[R"SU35 [R "UR RS9UeSnAff=f)z$Scale an Inference Endpoint to zero.r'rkzScale To Zero failed: r(N) r scale_to_zero_inference_endpointrrrrKrLrMrrms r scale_to_zerorsw 5 !CE77T^c7d H E +E734jjenn889uDEro)NNNN)N)NN)NNNNNNNNNNNNNN)NFN)-__doc__rtypingrrrr$huggingface_hub._inference_endpointsrrhuggingface_hub.errorsr _cli_utilsr r r r rrrie_cli catalog_appr:ArgumentNameArgOptionNameOpt NamespaceOptrcommandtablerSintfloatrTrcrg add_typerrnrsboolryr|rrr rrst 8 ++ b1 F G!QR   NN()+   SM LL&')   SM LL n C/CDC+-QRS"$** '' ' '  '  'T'TX)n(op\#  ei i   x   i  S  i  R  i(  a  )i4  l  5i@   g   AiL   i   MiZ[i\   V   ]ih iij  i  kiv  e  wiB%  Y  CiN/0 4  OiZ! x  [if giqiX (.s-tu "   x      c     !vF I  I  I )B(CD\RN40>9-=>?#       @  KLM# Wd dd   x   d  R  d  a  d*  l  +d6  U  7dB  F  CdN   V   OdZ  i  [df  e  gdr%  Y  sd~/0 4  dJ! x  KdV WdX YdNdN;<=# % %%   W#?@ B % % %>%4:;<#       =  ;<=#  '  'j    >6BCD#       E r