Ƒi",~SSKrSSKJr SSKJr SSKJr SSKrSSKrSSK J r J r J r J r SSKJrJr SSKJrJr SSKJrJrJrJrJrJr SS KJr SS KJr \"5r"S S \ 5r!"S S\ 5r""SS\ 5r#"SS\ 5r$"SS\ 5r%Sr&\ "SS\ 55r'\ "SS\ 55r(\ "SS\55r)\ "SS\)55r*\ "SS\)55r+\ "S S!\ 55r,"S"S#\5r-\ "S$S%\-55r.\ "S&S'\-55r/\ "S(S)\-55r0"S*S+\ 5r1g),N)ABC) HTTPStatus)Optional)asdictdefinefield validators)HubApiModelScopeConfig)API_RESPONSE_FIELD_DATAAPI_RESPONSE_FIELD_MESSAGE)NotLoginExceptionNotSupportError RequestErrorhandle_http_responseis_okraise_for_http_status) get_endpoint) get_loggerc\rSrSrSrSrSrg) AcceleratorcpugpuN)__name__ __module__ __qualname____firstlineno__CPUGPU__static_attributes__rU/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/modelscope/hub/deploy.pyrrs C Cr#rc\rSrSrSrSrg)VendoreasrN)rrrrEASr"rr#r$r&r&s Cr#r&c\rSrSrSrSrSrg) EASRegion!z cn-beijingz cn-hangzhourN)rrrrbeijinghangzhour"rr#r$r+r+!s GHr#r+c(\rSrSrSrSrSrSrSrSr g) EASCpuInstanceType&zTEAS Cpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.c6.2xlargezecs.c6.4xlargezecs.c6.6xlargezecs.c6.8xlargerN rrrr__doc__tinysmallmediumlarger"rr#r$r0r0&s D E F Er#r0c(\rSrSrSrSrSrSrSrSr g) EASGpuInstanceType/zTEAS Gpu Instance Type, ref(https://help.aliyun.com/document_detail/144261.html) zecs.gn5-c28g1.7xlargezecs.gn5-c8g1.4xlargezecs.gn6i-c24g1.12xlargezecs.gn6e-c12g1.3xlargerNr2rr#r$r9r9/s "D "E &F $Er#r9c^X R:a[SU<SUR<S35eg)Nz'min_replica' value: z- has to be smaller than 'max_replica' value: !) max_replica ValueError)instance attributevalues r$min_smaller_than_maxrB8s0 ###h** ,- -$r#c\rSrSr%Sr\"S\R"S5S9r\ \ S'\"S\R"S5\ /S9r \ \ S'Sr g) ServiceScalingConfig?zResource scaling config Currently we ignore max_replica Args: max_replica: maximum replica min_replica: minimum replica default validatorr= min_replicarN)rrrrr3rr ger=int__annotations__rBrJr"rr#r$rDrD?sJ Q*--2BCKCjmmA.0DEGKGr#rDc\rSrSr%Sr\\S'\\S'\"\ R\ R"\ R\ R/5S9r\\S'Srg) ServiceResourceConfigLzEas Resource request. Args: accelerator: the accelerator(cpu|gpu) instance_type: the instance type. scaling: The instance scaling config. instance_typescalingrG acceleratorrN)rrrrr3strrMrDrrr r in_r!rSr"rr#r$rOrOLsH !!..+//;??!CDFKFr#rOc\rSrSrSrg)ServiceProviderParameters\rN)rrrrr"rr#r$rWrW\sr#rWc\rSrSr%Sr\\S'\\S'\\S'Sr\\\S'\ "\ R\ R"\ R/5S9r\\S 'S rg) EASDeployParametersaa%Parameters for EAS Deployment. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' region access_key_idaccess_key_secretNresource_grouprGvendorr)rrrrr3rTrMr_rrr&r)r rUr`r"rr#r$rZrZasS K$(NHSM( jnnfjj\&BDFCDr#rZc\rSrSr%Sr\\S'\\S'Sr\\S'Sr\\S'\ "\ R\ R"\ R/5S9r\\S 'S rg) EASListParametersta$EAS instance list parameters. Args: resource_group: the resource group to deploy, current default. region: The eas instance region(eg: cn-hangzhou). access_key_id: The eas account access key id. access_key_secret: The eas account access key secret. vendor: must be 'eas' r]r^Nr\r_rGr`r)rrrrr3rTrMr\r_rr&r)r rUr`r"rr#r$rbrbtsTFCNC jnnfjj\&BDFCDr#rbcL\rSrSr%Sr\\S'\\S'\\S'\\S'\\S'Sr g ) DeployServiceParameterszDeploy service parameters Args: instance_name: the name of the service. model_id: the modelscope model_id revision: the modelscope model revision resource: the resource requirement. provider: the cloud service provider. instance_namemodel_idrevisionresourceproviderrN) rrrrr3rTrMrOrWr"rr#r$reres%MM##''r#rec\rSrSrSrSrSrg)AttrsToQueryStringz/Convert the attrs class to json string. Args: c[URSS9n[R"U5n[ U5 [ R RU5n[ U5 SU-nU$)Nc USL$)Nr)attrrAs r$1AttrsToQueryString.to_query_str..s e46Gr#)filterz provider=%s)rrkjsondumpsprinturllibparse quote_plus)self self_dictjson_strsafe_str query_params r$ to_query_strAttrsToQueryString.to_query_strsW MM"GI ::i( h<<**84 h#h. r#rN)rrrrr3rr"rr#r$rmrms  r#rmc<\rSrSr%\\S'Sr\\S'Sr\\S'Sr g) ListServiceParametersrkrskipdlimitrN) rrrrrWrMrrLrr"rr#r$rrs''D#ME3r#rc \rSrSr%\\S'Srg)GetServiceParametersrkrNrrrrrWrMr"rr#r$rr''r#rc \rSrSr%\\S'Srg)DeleteServiceParametersrkrNrrr#r$rrrr#rc \rSrSrSrSS\\4SjjrS\S\S\S \S \ 4 S jr S\S \ 4S jr S\S \ 4S jr SS \ S\\ S\\ 4SjjrSrg)ServiceDeployerzEFacilitate model deployment on to supported service provider(s). NtokencUbUO [5UlS[R"50Ul[ 5R USS9Ulg)Nz user-agentT) access_tokencookies_required)rendpointr get_user_agentheadersr get_cookiescookies)r{rrs r$__init__ServiceDeployer.__init__sF$,$8ln $&6&E&E&GH x++,7 r#rhrirgrjrkcUR[R:wa[SUR-5e[ UUUUUS9nUR S3n[ U5n[R"XxURURS9n [U [URS5 U R[R:auU R[R :aW[#U R%55(aU R%5[&n U $[)U R%5[*5e[-U 5 g)aDeploy model to cloud, current we only support PAI EAS, this is an async API , and the deployment could take a while to finish remotely. Please check deploy instance status separately via checking the status. Args: model_id (str): The deployed model id revision (str): The model revision instance_name (str): The deployed model instance name. resource (ServiceResourceConfig): The service resource information. provider (ServiceProviderParameters): The service provider parameter Raises: NotSupportError: Not supported platform. RequestError: The server return error. Returns: ServiceInstanceInfo: The information of the deployed service instance. z1Not support vendor: %s ,only support EAS current.)rgrhrirjrkz/api/v1/deployer/endpoint)rurrcreate_serviceN)r`r&r)rrerrrequestspostrrrlogger status_coderOKMULTIPLE_CHOICESrrur rr r) r{rhrirgrjrk create_paramspathbodyrdatas r$createServiceDeployer.creates* ??fjj (!C"# #0'  -- 9:m$ MM T\\4<< IQ 6FG ==JMM )ammj>Y>Y.YQVVXvvx 78 "1668,F#GHH !! $r#c[US9nUR<SU<SUR5<3n[R"X@R UR S9n[U[UR S5 UR[R:XaW[UR55(aUR5[nU$[UR5[ 5e[#U5 g)aQuery the specified instance information. Args: instance_name (str): The deployed instance name. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed from server. Returns: Dict: The information of the requested service instance. rk/api/v1/deployer/endpoint/?rr get_serviceN)rrrrgetrrrrrrrrrur rr rr{rgrkparamsrrrs r$rServiceDeployer.gets&x8 MM=&*=*=*?A LL||T\\ JQ mD ==JMM )QVVXvvx 78 "1668,F#GHH !! $r#c[US9nUR<SU<SUR5<3n[R"X@R UR S9n[U[UR S5 UR[R:XaW[UR55(aUR5[nU$[UR5[ 5e[#U5 g)aDelete deployed model, this api send delete command and return, it will take some to delete, please check through the cloud console. Args: instance_name (str): The instance name you want to delete. provider (ServiceProviderParameters): The cloud provider information, for eas need region(eg: ch-hangzhou), access_key_id and access_key_secret. Raises: RequestError: The request is failed. Returns: Dict: The deleted instance information. rrrrdelete_serviceN)rrrrdeleterrrrrrrrrur rr rrs r$rServiceDeployer.deletes)(; MM=&*=*=*?A OOD,, MQ 6FG ==JMM )QVVXvvx 78 "1668,F#GHH !! $r#rrc[XUS9nUR<SUR5<3n[R"XPR UR S9n[U[UR S5 UR[R:XaW[UR55(aUR5[nU$[UR5[ 5e[#U5 g)aList deployed model instances. Args: provider (ServiceProviderParameters): The cloud service provider parameter, for eas, need access_key_id and access_key_secret. skip (int, optional): start of the list, current not support. limit (int, optional): maximum number of instances return, current not support Raises: RequestError: The request is failed from server. Returns: List: List of instance information )rkrrz/api/v1/deployer/endpoint?rlist_service_instancesN)rrrrrrrrrrrrrrur rr r)r{rkrrrrrrs r$listServiceDeployer.list/s&'737==393F3F3HJ LL||T\\ JQ 6NO ==JMM )QVVXvvx 78 "1668,F#GHH !! $r#)rrr)NN)rr)rrrrr3rrTrrOrWrrrrLrr"rr#r$rrs7Xc]7,s,c,#,.,2,\0I:C3L@$%$'!0!C=!SM!!r#r)2rxabcrhttprtypingrrurattrsrrrr modelscope.hub.apir r modelscope.hub.constantsr r modelscope.hub.errorsrrrrrrmodelscope.hub.utils.utilsrmodelscope.utils.loggerrrobjectrr&r+r0r9rBrDrOrWrZrbrermrrrrrr#r$rs  337B::4. & V %%- G6 G G FF F F   D3DD$D1DD$(f(("". (-(((0((UfUr#