{-jA DddlmZddlmZddlmZddlmZddlm Z m Z m Z m Z m Z ddlmZddlmZmZd d lmZd d lmZd d lmZmZmZmZmZd dlmZmZm Z d dl!m"Z"d dl#m$Z$d dl%m&Z&d dl'm(Z(d dl)m*Z*d dl+m,Z,d dl-m.Z.d dl/m0Z0d dl1m2Z2d dl3m4Z4d dl5m6Z6d dl7m8Z8d dl9m:Z:d dl;mZ>d dl?m@Z@d dlAmBZBmCZCmDZDd d lEmFZFd d!lGmHZHd d"lImJZJd d#lKmLZLd d$lMmNZNd d%lOmPZPd d&lQmRZRd d'lSmTZTd d(lUmVZVd d)lWmXZXd d*lYmZZZd d+l[m\Z\d d,l]m^Z^d d-l_m`Z`d d.lambZbdnd3Zcdod6Zdd d7lemfZfd8d9dpd=Zgdqd>Zhdrd@ZidsdBZjed8dtdDZkd8d8dEdudJZled KdvdMZmdwdNZndxdPZodydTZpdzdUZqd{dYZrd|d\Zsd}d`Ztd~deZud8d8d8d8d d8dfd8d8dg ddmZvd8S)) annotations)Mapping) lru_cache)Path)AnyDictOptionalTupleUnion) BaseModel)errorslogging)official_models) UadPredictor)BindingUnknownModelErrorUnsupportedEngineError get_bindingget_supported_engines) GenAIConfigneed_local_modeluses_server_backend)DocVLMPredictor)InferenceEngine)FaceFeaturePredictor)FormulaRecPredictor) ClasPredictor)ImageFeaturePredictor)MLClasPredictor) WarpPredictor)InstanceSegPredictor) KptPredictor)LayoutAnalysisPredictor)BEVDet3DPredictor)WhisperPredictor) DetPredictor)OVDetPredictor)OVSegPredictor) BasePredictorLocalModelPredictorRunnerPredictor) HPIConfig)PaddlePredictorOption) SegPredictor)TablePredictor)TextDetPredictor)TextRecPredictor)TextToPinyinPredictor)Fastspeech2Predictor)PwganPredictor) TSAdPredictor)TSClsPredictor) TSFcPredictor)&resolve_paddle_engine_from_model_files)VideoClasPredictor)VideoDetPredictor model_namestrreturnTuple[str, ...]cn t|S#t$r}td|d|d}~wwxYwNz(No engine bindings registered for model .)rr ValueError)r>es a/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddlex/inference/models/__init__.py_get_supported_enginesrHEsW$Z000  Fz F F F   s 4/4enginerc t||S#t$r}td|d|d}~wt$r"}tt ||d}~wwxYwrC)rrrErr?)r>rIrFs rG_get_predictor_bindingrKNs(:v...  Fz F F F    "(((Q  a'(s A0 AAA)resolve_model_nameN model_formats model_dir Optional[str]rc|#ttj||St|}|st |d|S)NrMz does not exist!)rrget_model_pathexistsFileNotFoundError)r>rOrNresolveds rG_resolve_model_dirrV\ss   *+      IH ??  @9 > > >??? Oct|}dD] }||vr|cS td|dt|d)N) paddle_staticpaddle_dynamiczModel z6 does not support engine 'paddle'. Supported engines: rD)rHrElist)r> supportedrIs rG_resolve_default_paddle_enginer]osr&z22I5 Y  MMM   3 3 3"9oo 3 3 3  rWtuple[str, Optional[Path]]c|dkr|dfS|t|dfSt||}t|}|td|d||fS)Npaddlez$No Paddle model files were found in rD)r]rVr;rE)r>rIrOmodel_dir_resolvedresolved_engines rG_resolve_requested_enginerczs| t|-j994??+J BB<=OPPON NNNOOO . ..rWboolcL t|dkS#t$rYdSwxYw)N)flexibleF)rHrE)r>s rG_is_flexible_only_modelrgs<%j11]BB uus  ##rc tj|S#tj$r}t d|d|d}~wwxYw)NzUnsupported engine: rD)rgetrClassNotFoundExceptionrE)rIrFs rG_get_inference_enginerkscD*"6**,,,  (DDD;;;;<devicecfgAOptional[Union[Dict[str, Any], PaddlePredictorOption, BaseModel]]rmDict[str, Any]cLt||||S)zIParse, validate and normalize engine-specific config to a canonical dict.rl)rknormalize_config)rIrnr>rms rGnormalize_engine_configrss2 ! ( ( 9 9  :  rW)maxsize frozensetcfttjS)z.Registered inference engine ids (bucket keys).)rurallkeysrWrG#_engine_config_bucket_key_allowlistrzs' _(**//11 2 22rWc R t t|} fd|D}||z }|r2|r0tdt |dt |d|s|S|D]B\}}t |ts(td|dt|j dC| |}t |trt|ni}||vrtj d||S)a Resolve bucketed engine_config to a single dict for the resolved engine. Bucketed form: every top-level key must be a registered engine name, and every value must be a mapping. Mixing those keys with any other top-level key is not allowed (strict). ch|]}|v| Sryry).0k allowlists rG z2_flatten_bucketed_engine_config..s555a9nn1nnnrWzengine_config cannot mix per-engine bucket keys with flat config keys. Use either a flat dict for the resolved engine only, or a dict whose top-level keys are exclusively inference engine names. Flat-like keys: z; bucket-like keys: rDzJBucketed engine_config requires each top-level value to be a mapping; key z has type zbBucketed engine_config has no entry for resolved engine %r; using an empty config for that engine.)rzsetrxrEsorteditems isinstancertype__name__ridictrwarning) rIrnrx allowlistedotherr~vbucketflat_for_enginers @rG_flatten_bucketed_engine_configrs455I sxxzz??D5555d555K ; E u  ] &e}} ] ]EK;DWDW ] ] ]      1!W%% <<<&*1gg&6<<<   WWV__F&0&A&AId6lllrO S ,    rWNOptional[Union[Dict[str, Any], PaddlePredictorOption, HPIConfig, GenAIConfig]]cT|t|ts|St||S)N)rrr)rIrns rG%_maybe_flatten_bucketed_engine_configrs, {*S$//{ *63 7 77rWuse_hpip genai_config,Optional[Union[Dict[str, Any], GenAIConfig]]cZ||St|rdS|rdSt|rdSdS)N genai_clienthpirfr`)rrg)r>rIrrs rG_resolve_effective_enginersK  <((~uz**z 8rWc>||S|dkr|S|dkr|S|dkr|SdS)NrYrrryrI engine_config pp_option hpi_configrs rG_select_engine_config_sourcersF       4rWinference_engineraOptional[Path]c`||js|St|||S)NrM)needs_local_modelrVget_supported_model_formatsrr>rOras rG_resolve_local_model_dirrsE%-=-O%!! &BBDD   rWrOptional[Dict[str, Any]]cx|sdStj|}||ddkrtd|S)NGlobalr>u9Model name mismatch，please input the correct model dir.)r, load_configrE)rr>rOconfigs rG_load_local_model_configrsJ t  &y 1 1FVH%l333UVVV MrWbinding model_configrct|tsdSddlm}t ||s%t dt |jd||||||S)Nr) RunnerEnginezInferenceEngine z& does not support runner construction.)r>rOrrr) issubclassr.enginesrr RuntimeErrorrr build_runner) predictor_clsrrr>rOrrrs rG_build_predictor_runnerr&s m_ 5 5t%%%%%% & 5 5  ht$455> h h h     ( (!# )  rW batch_sizeintnormalized_engine_configpredictor_engine_configc |j}||d} |r|| d<t|||||||} | | | d<t|tr || d<|| d<| S)N)r>rr)rrrr>rOrrrunnerrOr) predictorrrr-) rrr>rrrrOrr create_kwargsrs rG_build_predictor_kwargsrAs%M  MA)@ o& $#)!.F"( h-!4555%. k"(4 n% rWF) rOrmrIrrrrrrrOptional[PaddlePredictorOption]r*Optional[Union[Dict[str, Any], HPIConfig]]r,c |r|tjd|t||\}} } t|||| }t |||\}} t |} t ||}| j}t| ||| } t||||| }t||}t||||}|r| | | | r|r| }nt||| }| |}t!|||||| || }|jd i|| S) aX Create a predictor for the given model and engine. Args: model_name: Model name. model_dir (Optional[str]): Path to model directory. Required for local engines when the model is not official. Ignored when a local model is not needed. device (Optional[str]): Device to run on (e.g. `'gpu'`, `'cpu'`). Used by local engines. engine (Optional[str]): Inference engine. One of `'paddle'` (resolved to `paddle_static` or `paddle_dynamic` from local model files when `model_dir` is provided; otherwise resolved from predictor support, preferring `paddle_static`), `'paddle_static'`, `'paddle_dynamic'`, `'hpi'`, `'flexible'`, `'transformers'`, `'onnxruntime'`, `'genai_client'`, or `None`. When `None`: if `genai_config.backend` is a server backend, engine becomes `'genai_client'`; else if `use_hpip=True` and model supports hpi, engine becomes `'hpi'`; else if model is flexible-only, engine becomes `'flexible'`; otherwise defaults to `'paddle'`. engine_config (Optional[Dict[str, Any]]): Engine-specific config for the resolved engine (flat dict), **or** a bucketed dict whose top-level keys are only registered engine names (e.g. ``hpi``, ``paddle_static``), each mapping to a nested dict. Bucketed and flat keys must not be mixed at the same level; use either form exclusively. batch_size (int): Batch size for inference. Defaults to 1. pp_option (Optional[PaddlePredictorOption]): Paddle predictor options. Used when `engine='paddle_static'` and `engine_config` is not specified. Prefer `engine_config` for new code. use_hpip: When `engine` is `None`, if `True`, resolves to `engine='hpi'`. Ignored when `engine` is set. hpi_config (Optional[Union[Dict[str, Any], HPIConfig]]): HPI configuration. Used when `engine='hpi'` and `engine_config` is not specified. Prefer `engine_config` for new code. genai_config (Optional[Union[Dict[str, Any], GenAIConfig]]): GenAI configuration. Mainly used when `engine='genai_client'` and `engine_config` is not specified. Prefer `engine_config` for new code. Returns: A predictor instance. Nz`use_hpip` only takes effect when `engine` is None. Since engine=%r is explicitly set, use_hpip will be ignored. To use HPI, pass engine='hpi' instead.)r>rOrrrl)rr>rO)rr>rrrrOrrry)rrrLrrcrkrKrrrrrsensure_model_filesensure_environmentrto_predictor_configrr)r>rOrmrIrrrrrrkwargsraresolved_configrequested_enginepredictor_binding need_localconfig_to_validaterrrrs rGcreate_predictorrdsj F& $     7I7773J"O 'z68\ R RF!:FI""F -V44.z6BB!3J1)- 6#! ?" 7     @++,>???''))) :  )(!(    /BB ,!!9 7$)   M '  & A A A& A AArW)r>r?r@rA)r>r?rIr?r@r)r>r?rOrPr@r)r>r?r@r?)r>r?rIr?rOrPr@r^)r>r?r@rd)rIr?r@r) rIr?rnror>rPrmrPr@rp)r@ru)rIr?rnrpr@rp)rIr?rnrr@r) r>r?rIrPrrdrrr@r?)rIr?r@r) rrr>r?rOrPrarr@r)rrdr>r?rOrr@r) rrrrr>r?rOrrrrrp)rrrrr>r?rrrrprrprOrrrr@rp)r>r?rOrPrmrPrIrPrrrrrrrrdrrrrr@r,)w __future__rcollections.abcr functoolsrpathlibrtypingrrr r r pydanticr utilsrrutils.official_modelsranomaly_detectionrbindingsrrrrr common.genairrrdoc_vlmrrr face_featurerformula_recognitionrimage_classificationr image_featurer!image_multilabel_classificationr"image_unwarpingr#instance_segmentationr$keypoint_detectionr%layout_analysisr&m_3d_bev_detectionr'multilingual_speech_recognitionr(object_detectionr)open_vocabulary_detectionr*open_vocabulary_segmentationr+ predictorsr,r-r. runners.hpir/runners.paddle_static.configr0semantic_segmentationr1table_structure_recognitionr2text_detectionr3text_recognitionr4text_to_pinyinr5text_to_speech_acousticr6text_to_speech_vocoderr7ts_anomaly_detectionr8ts_classificationr9ts_forecastingr:utils.model_pathsr;video_classificationr<video_detectionr=rHrKutils.model_resolverrLrVr]rcrgrkrsrzrrrrrrrrrryrWrGrs#"""""######44444444444444$$$$$$$$333333++++++MLLLLLLLLL$$$$$$$$$$$$......444444//////000000<<<<<<******777777,,,,,,444444111111======******555555888888KKKKKKKKKK""""""??????//////777777,,,,,,......111111999999222222//////------))))))EEEEEE444444......((((544444 &////$ 4DDDD!%       13333 ((((V8888"&        6    L $  .215=AAE}B}B}B}B}B}B}B}BrW