|-jQSbddlZddlZddlZddlZddlZddlZddlmZmZddl m Z ddl m Z ddl mZmZddlmZdd lmZdd lmZmZmZd d gZdd ZeZGdd ejZGddeZGdde Z!Gdde!Z"Gdde!Z#Gdde!Z$dS)N)flagslogging) get_cache_dir) parse_device)UnsupportedAPIErrorUnsupportedParamError)CachedProperty)Config)build_model_from_model_infobuild_runner_from_model_infoget_registered_model_info PaddleModel BaseModelc$||td||||jkrtdn | ||j} t|}n2#t$r%}t t |d|d}~wwxYwt ||S) _create_modelNz;At least one of `model_name` and `config` must be not None.zgIf both `model_name` and `config` are not None, `model_name` should be the same as `config.model_name`.z is not a registered model name.) model_infoconfig) ValueError model_namerKeyErrorr reprr )rrres \/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddlex/repo_apis/base/model.pyrr&sfnVWWW  F$6 * * *  +   2& .z:: #J A A A    '*V L L LLsA A> A99A>ceZdZdZdZdZdfd Zej dd Z ej dd Z ejdd Z ejd Z ejddZ ej ddZejdZejdZedZedZedZedZedZedZedZedZdZxZS) rz Abstract base class of Model. Model defines how Config and Runner interact with each other. In addition, Model provides users with multiple APIs to perform model training, prediction, etc. )trainevaluatepredictexportinfer compressionzsupported_{api_name}_optsNc0t||_t||_t |j|_|#tjdt|}||_ | dS)z Initialize the instance. Args: model_name (str): A registered model name. config (base.config.BaseConfig|None): Config. Default: None. NaWe strongly discourage leaving `config` unset or setting it to None. Please note that when `config` is None, default settings will be used for every unspecified configuration item, which may lead to unexpected result. Please make sure that this is what you intend to do.) super__init__namerrrrunnerrwarningr r _patch_apis)selfrr __class__s rr%zBaseModel.__init__Js  3J??34?CC > Ol    J''F  gpuFOFFTc  t)a Train a model. Args: batch_size (int|None): Number of samples in each mini-batch. If multiple devices are used, this is the batch size on each device. If None, use a default setting. Default: None. learning_rate (float|None): Learning rate of model training. If None, use a default setting. Default: None. epochs_iters (int|None): Total epochs or iterations of model training. If None, use a default setting. Default: None. ips (str|None): If not None, enable multi-machine training mode. `ips` specifies Paddle cluster node ips, e.g., '192.168.0.16,192.168.0.17'. Default: None. device (str): A string that describes the device(s) to use, e.g., 'cpu', 'gpu', 'gpu:1,2'. Default: 'gpu'. resume_path (str|None): If not None, resume training from the model snapshot corresponding to the weight file `resume_path`. If None, use a default setting. Default: None. dy2st (bool): Whether to enable dynamic-to-static training. Default: False. amp (str): Optimization level to use in AMP training. Choices are ['O1', 'O2', 'OFF']. Default: 'OFF'. num_workers (int|None): Number of subprocesses to use for data loading. If None, use a default setting. Default: None. use_vdl (bool): Whether to enable VisualDL during training. Default: True. save_dir (str|None): Directory to store model snapshots and logs. If None, use a default setting. Default: None. Returns: paddlex.repo_apis.base.utils.subprocess.CompletedProcess NotImplementedError) r* batch_size learning_rate epochs_itersipsdevice resume_pathdy2stamp num_workersuse_vdlsave_dirkwargss rrzBaseModel.traines b"!r,c t)a Evaluate a model. Args: weight_path (str): Path of the weights to initialize the model. batch_size (int|None): Number of samples in each mini-batch. If multiple devices are used, this is the batch size on each device. If None, use a default setting. Default: None. ips (str|None): If not None, enable multi-machine evaluation mode. `ips` specifies Paddle cluster node ips, e.g., '192.168.0.16,192.168.0.17'. Default: None. device (str): A string that describes the device(s) to use, e.g., 'cpu', 'gpu', 'gpu:1,2'. Default: 'gpu'. amp (str): Optimization level to use in AMP training. Choices are ['O1', 'O2', 'OFF']. Default: 'OFF'. num_workers (int|None): Number of subprocesses to use for data loading. If None, use a default setting. Default: None. Returns: paddlex.repo_apis.base.utils.subprocess.CompletedProcess r0)r* weight_pathr2r5r6r9r:r=s rrzBaseModel.evaluates @"!r,c t)a2 Make prediction with a pre-trained model. Args: weight_path (str): Path of the weights to initialize the model. input_path (str): Path of the input file, e.g. an image. device (str): A string that describes the device to use, e.g., 'cpu', 'gpu'. Default: 'gpu'. save_dir (str|None): Directory to store prediction results. If None, use a default setting. Default: None. Returns: paddlex.repo_apis.base.utils.subprocess.CompletedProcess r0)r*r? input_pathr6r<r=s rrzBaseModel.predict "!r,c t)a" Export a pre-trained model. Args: weight_path (str): Path of the weights to initialize the model. save_dir (str): Directory to store the exported model. Returns: paddlex.repo_apis.base.utils.subprocess.CompletedProcess r0)r*r?r<r=s rr zBaseModel.exports "!r,c t)a2 Make inference with an exported inference model. Args: model_dir (str): Path of the exported inference model. input_path (str): Path of the input file, e.g. an image. device (str): A string that describes the device(s) to use, e.g., 'cpu', 'gpu'. Default: 'gpu'. save_dir (str|None): Directory to store inference results. If None, use a default setting. Default: None. Returns: paddlex.repo_apis.base.utils.subprocess.CompletedProcess r0)r* model_dirrAr6r<r=s rr!zBaseModel.inferrBr,c t)ak Perform quantization aware training (QAT) and export the quantized model. Args: weight_path (str): Path of the weights to initialize the model. batch_size (int|None): Number of samples in each mini-batch. If multiple devices are used, this is the batch size on each device. If None, use a default setting. Default: None. learning_rate (float|None): Learning rate of QAT. If None, use a default setting. Default: None. epochs_iters (int|None): Total epochs of iterations of model training. If None, use a default setting. Default: None. device (str): A string that describes the device(s) to use, e.g., 'cpu', 'gpu'. Default: 'gpu'. use_vdl (bool): Whether to enable VisualDL during training. Default: True. save_dir (str|None): Directory to store the results. If None, use a default setting. Default: None. Returns: tuple[paddlex.repo_apis.base.utils.subprocess.CompletedProcess] r0) r*r?r2r3r4r6r;r<r=s rr"zBaseModel.compressions F"!r,c#|K|j}|jd}d|j|g}|dz}t jstjt5}tj ||}t|dd5 dddn #1swxYwY|VddddS#1swxYwYdStj t|}t|dd5 dddn #1swxYwY|VdS)Nr_z.ymldirwutf-8encoding r+rjoin__name__lowerrDEBUGtempfileTemporaryDirectoryrospathopen)r*clsrtagyaml_file_nametdrWs r_create_new_config_filez!BaseModel._create_new_config_filesn_\2 hh **,,j9::v{ ,AAA Rw||B77$g666                    7<< @@DdC'222                 JJJJJH73C*B8, C8B< <C?B< CCCD--D14D1c#|K|j}|jd}d|j|g}|dz}t jstjt5}tj ||}t|dd5 dddn #1swxYwY|VddddS#1swxYwYdStj t|}t|dd5 dddn #1swxYwY|VdS)NrrHz _test.jsonrIrKrLrMrO)r*rYrrZjson_file_namer\rWs r_create_new_val_json_filez#BaseModel._create_new_val_json_file#sn_\2 hh **,,j9::|+{ ,AAA Rw||B77$g666                    7<< @@DdC'222                 JJJJJr^c8|jddS)zsupported apissupported_apisNrgetr*s rrczBaseModel.supported_apis5s""#3T:::r,cj|j|jddS)zsupported train optsrapi_nameNrre_API_SUPPORTED_OPTS_KEY_PATTERNformatrfs rsupported_train_optszBaseModel.supported_train_opts:7""  0 7 7 7 I I4   r,cj|j|jddS)zsupported evaluate optsrrhNrjrfs rsupported_evaluate_optsz!BaseModel.supported_evaluate_optsAs7""  0 7 7 7 L Ld   r,cj|j|jddS)zsupported predcit optsrrhNrjrfs rsupported_predict_optsz BaseModel.supported_predict_optsHs7""  0 7 7 7 K KT   r,cj|j|jddS)zsupported infer optsr!rhNrjrfs rsupported_infer_optszBaseModel.supported_infer_optsOrnr,cj|j|jddS)zsupported copression optsr"rhNrjrfs rsupported_compression_optsz$BaseModel.supported_compression_optsVs8""  0 7 7 7 O OQU   r,c8|jddS)zsupported dataset typessupported_dataset_typesNrdrfs rrxz!BaseModel.supported_dataset_types]s""#._make_unavailable.._unavailable_apims8!Y %.)!BBhBBBr,) functoolswraps)rrr*s` r_make_unavailablez0BaseModel._patch_apis.._make_unavailablels? _Z ( (     ) ( $ #r,ctjfd}j}g|dkrj}|d|vr*t |ddd|vr(t |dd|vr(t|dn&|dkrdj}|Zd|vr*t |ddd|vr(t|dn|d kr8j }|.d|vr*t |dd n~|d kr8j }|.d|vr*t |dd n@|d kr8j }|.d|vr*t |ddnS|S) Nc2tj}|j|i|}|j}|jD](}|j|vr|j|j ur|j||j<)D]}| ||i|SN) inspect Signature from_callablebind arguments parametersvaluesr&defaultemptycheck) rr=sigbnd_args args_dictprrcheckss r_api_with_precheckszJBaseModel._patch_apis.._add_prechecks.._api_with_prechecksxs'55jAA#38T4V44$. ..0066AvY..19AG3K3K,-I !&)$++EKK ****!z426222r,rr6T)check_mcr8r9rrFr!r") rrrQrmappend _CheckDevice _CheckDy2St _CheckAMPrprrrtrv)rrrioptsrr*s` @r_add_prechecksz-BaseModel._patch_apis.._add_prechecksws0 _Z ( ( 3 3 3 3 3) ( 3 "*HF7""0#4'' l4>D&Q&Q&QRRR$ k$w-&@&@AAA}} iU &<&<===Z''3#4'' l4>D&Q&Q&QRRR}} iU &<&<===Y&&2#4'' l4>E&R&R&RSSSW$$0#4'' l4>E&R&R&RSSS]**6#4'' l4>D&Q&Q&QRRR!!& &r,)rcset_API_FULL_LISTgetattrsetattrr CHECK_OPTS)r*rrrc avail_api_setriapi decorated_apis` rr)zBaseModel._patch_apisks $ $ $ $ $7 '7 '7 '7 '7 'r,  % 344MM 344M+ ; ;H$))C},,!2 1# 6 6 h 6666#;%3N3$7$7MD(M::: ; ;r,r) NNNNr-NFr.NTN)NNr-r.N)r-N)NNNr-TN)rQ __module__ __qualname____doc__rrkr%abcabstractmethodrrrr r!r" contextlibcontextmanagerr]racached_propertyrcrmrprrrtrvrx staticmethodr|r) __classcell__r+s@rrr>sXN&A#6   0"0"0"0"d   """"B """""  " " " """"" """"""""H"";;_;  _   _   _   _   _ DD_DQQ\QX;X;X;X;X;X;X;r,) metaclassc"eZdZdZdZdZdZdS) _CheckFailedTc0||_||_||_dSr)arg_namearg_val legal_vals)r*rrrs rr%z_CheckFailed.__init__s   $r,c6d|jd|jd|jS)N`z*` is expected to be one of or conforms to z , but got )rrrrfs r__str__z_CheckFailed.__str__s(u4=uuDOuugkgsuuur,N)rQrrrcheck_failed_errorr%rr,rrrsE%%% vvvvvr,rc(eZdZdZfdZdZxZS)_APICallArgsCheckercVt||_dSr)r$r%r)r*rr+s rr%z_APICallArgsChecker.__init__s$ $r,ct)rr0)r*rs rrz_APICallArgsChecker.checks!!r,rQrrrr%rrrs@rrrsM%%%%%"""""""r,rc*eZdZdZdfd ZdZxZS)rFcXt|||_dSr)r$r%r)r*rrr+s rr%z_CheckDevice.__init__s& $$$  r,cRd|vsJ|d}|t|\}}|js!||jvrtd||jdS|dkr!||jvrtd||jdS|d}|d}|d}t |dkr7||jvr(||jvr!||jvrtd||jdSdSdSd|vsJ|d!||jvrtd||jdS||jvr||jvrtd||jdSdSdS) rr6Nr-_n1c1_n1cx_nxcxr r5)rrrrr{)r*rr6 device_typedev_ids n1c1_desc n1cx_desc nxcx_descs rrz_CheckDevice.checks4h  #/#7#7 K= Vdo55&xIII65%''"$/99*8VT_MMM:9$/ 5 5 5I#. 5 5 5I#. 5 5 5I7||q((%T_<< ) @ @ ) @ @".x"Q"QQ =< @ @ @ @ %}}}};2(??&28VT_&U&U U @? !* @ @$-T_$D$D&28VT_&U&U U!A @$D$D Dr,)Frrs@rrrsR!!!!!!*******r,rceZdZdZdZdS)rc d|vsJ|d}t|jtr5t|jdksJt |jd}nt |j}||r|st d||gdSdSdS)rr8r rN) isinstancerlistr{boolr)r*rr8 support_dy2sts rrz_CheckDy2St.checks$W  dot , , 2t''1,,,, !344MM 11M   D] D"7EM?CCC D D D D Dr,NrQrrrrrr,rrrs)     r,rceZdZdZdZdS)rcxd|vsJ|d}|)|dkr||jvrtd||jdSdSdS)rr9Nr.)rr)r*rr9s rrz_CheckAMP.check+sZ}}}}5k ?e||4? : :"5#t???| : : Dr,Nrrr,rrr(s(Or,r)NN)%rrrrrVrTutilsrr utils.cacher utils.devicer utils.errorsrr utils.miscr rrr registerr rr__all__rrABCMetar Exceptionrobjectrrrrrr,rrs;   ########((((((((((((FFFFFFFF;;;;;; + &MMMM* E;E;E;E;E;#+E;E;E;E;P v v v v v9 v v v " " " " "& " " "11111&111h%&     #     r,