Ցi- SSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r J r J r J r J r SSKrSSKJr SSKJrJrJr SSKJrJrJr S rSDS \ \ \\4S \ \ \\4S \S \4SjjrS\ \\ \ 4S\S \ \\ \ 44SjrSr Sr!Sr"SESjr#SFSjr$Sr%Sr&Sr'"SS\5r("SS\5r)Sr*Sr+S r,S!r-S"r.S#r/S$r0\Rb"\0S%\0S&3\RdS'9r3S(\4S)jr4S*r5S+\)4S,jr6S-\S \4S.jr7S/\4S0jr8S(\S \ \S44S1jr9SGS(\S2\S3\S \ \ \\\4S44S4jjr:SHS5\S6\S7\S2\S8\S \4 S9jjr;S:r<\Rb"S;\Rz5r>\Rb"S<\Rz5r?\Rb"S=5r@\Rb"S=5rAS>\RS \ \\ 44S?jrCS@\SA\SB\S \ \\ \\ 444SCjrDg)IN)Counter)deepcopy)AnyDictListTupleUnion)Image) BaseModelcomputed_fieldmodel_validator)calculate_bbox_areacalculate_overlap_ratio"calculate_projection_overlap_ratiocJUR(dURS5nU$)Nr)is_validbuffer)polys n/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/paddlex/inference/pipelines/paddleocr_vl/uilts.py make_validr"s =={{1~ Kpolygon1polygon2modereturncSSKJn U"U5nU"U5n[U5n[U5nUR U5R nUR U5R nUS:XaXg- $US:Xa$[UR UR 5nXh- $US:Xa$[UR UR 5n Xi- $[SU35e![a [S5ef=f)ah Calculate the overlap ratio between two polygons. Args: polygon1 (List[Tuple[int, int]]): First polygon represented as a list of points. polygon2 (List[Tuple[int, int]]): Second polygon represented as a list of points. mode (str, optional): Overlap calculation mode. Defaults to "union". Returns: float: Overlap ratio value between 0 and 1. r)PolygonzPlease install Shapely library.unionsmalllargezUnknown mode: ) shapely.geometryr ImportErrorr intersectionarearminmax ValueError) rrrrpoly1poly2r$r small_area large_areas rcalculate_polygon_overlap_ratior-(s =, H E H E u E u E%%e,11L KK  # #E w## UZZ0 (( UZZ0 ((>$011# =;<<=s CC&layout_det_reslayout_shape_modec[U5nUSVs/sHo3SS:wdM UPM nn[5n[[U55GHnXFSupxpX- X- pU S:dU S:aUR U5 [US-[U55GH7n Xe;dX;aM[ XFSXMSS5nXFSS:Xd XMSS:Xa@US :a:XFSS:XaUR U5 XMSS:XaUR U 5 M}US :dMUS :wa'S XF;a[ XFS XMS S5nUS :aM[XFS5n[XMS5nXFSXMS1nU1S k-(a [U5S:aSU;dU1S k::aGM UU:aUR U 5 GM&UR U5 GM: GM [U5VVs/sHunnUU;dMUPM snnUS'U$s snfs snnf)a Remove overlapping boxes from layout detection results based on a given overlap ratio. Args: layout_det_res (Dict[str, List[Dict]]): Layout detection result dict containing a 'boxes' list. Returns: Dict[str, List[Dict]]: Filtered dict with overlapping boxes removed. boxeslabel reference coordinater inline_formula?gffffff?rectpolygon_points>sealchartimagetabler>) rsetrangelenaddrr-r enumerate)r.r/layout_det_res_filteredboxr1dropped_indexesix1y1x2y2whj overlap_ratiopoly_overlap_ratio box_area_i box_area_jlabelsidxs rfilter_overlap_boxesrUNsX'~6.w7 7w<;;V7  eO 3u: ,/w1 q5AE    "q1uc%j)A#q';3&(>M!%558G$(88 3&x(,<<'++A.x(,<<'++A.s"$.3Cux3O)H!12EH=M4NPW*&*C/ 0,1GH 0,1GH (7+UXg->???CKRSOf,;1 !+#''*#''*K* X&e,(,S?0J,(G$ #"g `(s HH" H3Hcp[U[R5(aU$[R"U5$)z Convert the input to a PIL Image. Args: img (PIL.Image or numpy.ndarray): Input image. Returns: PIL.Image: PIL Image object. ) isinstancer fromarrayimgs r to_pil_imager[s)#u{{## ??3 rcp[U[R5(a[R"U5$U$)z Convert the input to a numpy array. Args: img (PIL.Image or numpy.ndarray): Input image. Returns: numpy.ndarray: Numpy array image. )rWr nparrayrYs r to_np_arrayr_s(#u{{##xx} JrcUVs/sHn[U5RPM nnUVs/sHn[U5RPM nn[U5n[ U5nXE4$s snfs snf)z Calculate width (max of all) and height (sum) for a vertical merge of images. Args: images (List[PIL.Image or np.ndarray]): List of images. Returns: Tuple[int, int]: (width, height) of merged image. )r[widthheightr'sum)imagesrZwidthsheightsrLrMs rcalc_merged_whrgsc28 8#l3%%F 839:6C|C ''6G: F A G A 4K 9:s A$A)cU(dg[U5S:Xa[US5$[U[5(aU/[U5S- -n[U5[U5S- :wa [ S5e[ US5n[ S[U55Hn[ X5nXS- n[URUR5nURUR-n[R"SXx4S5n US:Xa#XsR- S-n XuR- S-n O&US :XaXsR- n XuR- n OS=pU RX:S45 U RX[UR45 U nM [U5$) a Merge images vertically with given alignment. Args: images (List[PIL.Image or np.ndarray]): List of images to merge. aligns (str or List[str]): Alignment(s) for each merge step ('center', 'right', 'left'). Returns: np.ndarray: Merged image as numpy array. Nr6rz,The length of aligns must be len(images) - 1RGBrkrkcenterrright) rAr_rWstrr(r[r@r'rarbr newpaste) rdalignsr/mergedrGimg2alignrLrMnew_imgrHrJs r merge_imagesrvs`  6{a6!9%%&#S[1_- 6{c&kAo%GHH &) $F 1c&k "FI&1u   djj ) MMDKK '))EA6?; H ll"q(Bjj.Q&B g \\!BZZBKB f1g& d/0!#" v rcx ^^)^*/n0n[U5H&upVUST;aXdU'MURXV45 M( /n/n/n /n Sm)U)4Sjn U4Sjn [U5GHun upVU(d U/nU/n /n MX=S- upUSnUSnUSnUSn[UUS5nUS:H=(ai US :H=(a] UU:H=(aQ USUS :=(a? USUS :=(a- USUS - [US US- US US- 5S -:nUS:=(a US ;=(a UU:H=(a~ US US:=(al [ USUS - 5[US US- US US- 5S-:=(a/ T)"USUS5T)"US US 5- =(a U "X^U5nU(aSnOU(a U "UU5nOSnU(dU(a6URU5 U RU5 U RU5 GMURX45 U/nU/n /n GM U(aURX45 /nUH1unn[ U5[U5nnURUUUU45 M3 /n[ 5m*SnU[U5:Ga SnUGHunnnnUU:XdM[U*4SjU55(dM-SnUV s/sH oU SPM nn U(aUO/n [U5un!n"U!S:waU"U!- O [S5n#U#S :a[[U5HKun$n%UU%R5nUU%SUS'SUS'URU5 T*RU%5 MM Oy[UU U5n&[U5H]un$n%UU%R5nU$S:XaU&OSUS'U$S:XaU OSUS'USUS'URU5 T*RU%5 M_ /n'[US-U5Hn(U(U;dM U'RU(5 M U'H(n(URUU(5 T*RU(5 M* US-n O U(aGMXT;a*UT*;a$URXE5 T*RU5 US- nU[U5:aGM U$s sn f)a/ Merge blocks based on alignment and overlap logic, except for those with labels in non_merge_labels. Args: blocks (List[Dict]): List of block dicts. non_merge_labels (List[str]): Block labels that should not be merged. Returns: List[Dict]: List of processed (and possibly merged) blocks. r2c"[X- 5S:*$)Nabs)a1a2s r is_aligned merge_blocks..is_aligneds27|q  rcZ>T"USUS5(agT"USUS5(agg)Nrleftrrmrl) block_bbox prev_bboxr~s r get_alignment#merge_blocks..get_alignments6 jmYq\ 2 2  1 y| 4 4rc2>X!SnX Sn[USUS5n[USUS5n[USUS5n[USUS5nXVXx/n [U5H-upXU4;d U ST ;aMU Sn [X5S:dM- g g) NrErr6rr2TF)r&r'rCr) block_idxprev_idxblocksrrrHrIrJrKmin_boxrT other_block other_bboxnon_merge_labelss roverlapwith_other_box+merge_blocks..overlapwith_other_box s$U+ &u- 1z!} - 1z!} - 1z!} - 1z!} -2" )& 1 C8,,w'/??$U+J&w;a?!2rr6rE horizontalrtextrrg333333?)rr8rlNFc3,># UH oT;v M g7fNr).0rG used_indicess r merge_blocks..as#Q=a\$9=sTrZinf merge_alignsgroup_id)rCappendrr'r{r&r?rAallrgfloatcopyrBrvr@)+rrr/blocks_to_mergenon_merge_blocksrTblock merged_groups current_groupcurrent_indicescurrent_alignsrrrGr prev_blockr prev_labelr block_labeliou_his_crossis_updown_align align_mode group_ranges group_indicesrqstartend result_blocks group_foundimgsrrLrM aspect_ratiorNr merged_img insert_listn_idxr~rs+ ` @@r merge_blocksrsfO'  >- -$)S !  " "C< 0 ( MMON!&%_5?L!. v']);sUC?@"/M5L C F  1= -E3 ve|#Q=#Q Q Q" 2?@-Qq %(-@)/vR %d+1()Qq1uE%L 1$(1-(@ 9 &y 1 6 6 8'-i'8'?e 04n-%,,U3$((3 )A".dLBS!TJ(1-(@ 9 &y 1 6 6 856!Vze @AQ Dn-,9!,<j)%,,U3$((3 )A! "519c2E 00#**513)E!(()9%)@A $$U+)Ag?2>@    "s,'>  !1!6 7   S ! qO F P GAs!R7c ^SSKmSU4SjjnUVs/sHn[U5PM snupVpxXu- n X- n UR5n TRXU4Xx4SSS9 TRn Sn U"X,[ X5SS 9upn[ S [R"X-55nXYU- S --nXjU-S --nTRU UUU4U US UTRS 9 U $s snf)a$ Fill a rectangular area in the image with a white background and write the given token string. Args: image (np.ndarray): Image to paint on. box (tuple): (x1, y1, x2, y2) coordinates of rectangle. token_str (str): Token string to write. Returns: np.ndarray: Modified image. rN?c>SupEUnXT- S:a>XE-S- nT RXUSS9uupn XU-:a XU-:aUnUnOUnXT- S:aM>UWW 4$)N)g? g{Gz?rr6) thickness) getTextSize) rfontFace square_size fill_ratiorrm optimal_scalemidrLrM_cv2s rget_optimal_font_scale+paint_token..get_optimal_font_scales  lT!<1$CqIIFQA++*4L0L # lT!a""rrj)colorr)rr6r)rrr)lineType)r) rintr rectangleFONT_HERSHEY_SIMPLEXr&r'mathfloorputTextLINE_AA)r=rE token_strrvrHrIrJrKbox_wbox_hrZfontthickness_scale_ratio font_scaletext_wtext_hfont_thicknesstext_xtext_yrs @r paint_tokenrs# '**cc!fc*NBB GE GE **,CMM#Bx"BMO  # #D!7U*s"JDJJz'IJKN6>a' 'F 6>a' 'FKK     J;+sCc*SnSSKnURS5 0nUupgp/n U"[U55n URU 5 [ U5HupU SupnnX:dMX:dMUU::dM$UU ::dM,U R U 5 [ UU- UU- 5S:aMUX- X- UU- UU- /nS[X5-S-n[UUU5nU S UU'M [ U5VVs/sHunnUU ;dMUS PM nnnXU4$s snnf) a Replace figures in a table area with tokens, return new image and token map. Args: table_block_img (np.ndarray): Table image. table_box (list): Table bounding box [x_min, y_min, x_max, y_max]. figures (List[Dict]): List of figure dicts (must contain 'coordinate', 'path'). Returns: Tuple[np.ndarray, Dict[str, str], List[str]]: - New table image, - Token-to-img HTML map, - List of figure paths dropped. c1Skn/nSn[U5U:aC[[U55U-(dURU5 US- n[U5U:aMCU$)N>019rr6)rAr?rnr)numexclude_digitsseqrGs rgen_random_map0tokenize_figure_of_table..gen_random_mapsT( #hnAK.0 1 FA#hn rrNir4[F]path) randomseedrAshufflerCrr&rnr)table_block_img table_boxfiguresrr token_map table_x_min table_y_min table_x_max table_y_max drop_idxes random_map figure_idfigure figure_x_min figure_y_min figure_x_max figure_y_maxdraw_boxrrGf drop_figuress rtokenize_figure_of_tablersE  KKI9B6KkJG -J NN:&w/ AG AU> L,  '+ + +   i (<,. |0KLrQ**{*{* H s:#899C?I)/8YOO#)&>Ii +0,+4G*<P*<$!QZIAfI*URS5nSUS3nTRX RS55nT RUS5nUcURS5$/nURSRUR SS5R SS 555 SR U5nUR S:waUR nUS U-S -- nU$) Nr6rrrzImagez-    )groupgetrformatreplacejoincontent) matchtoken_idtokenimg_path img_blockimg_tags image_info ocr_contentfigure_token_mapimage_path_to_obj_maps rrepl(untokenize_figure_of_table..repls;;q>XJa #''{{1~>)--h=  ;;q> !H OO/66$$UB/77cB  8,J  B&'// f{2V;;  rz \[F(\d+)\])resub) table_res_strrrrpatterns `` runtokenize_figure_of_tabler#s (G 66' //rc\rSrSr%SrSr\\S'Sr\\S'\\S'\\S'\\S'\\S '\ \S 'S r \ \S 'S r \ \S 'S r \ \S'\"SS9\S\S\4Sj55rSrg) TableCelli'aK TableCell represents a single cell in a table. Attributes: row_span (int): Number of rows spanned. col_span (int): Number of columns spanned. start_row_offset_idx (int): Start row index. end_row_offset_idx (int): End row index (exclusive). start_col_offset_idx (int): Start column index. end_col_offset_idx (int): End column index (exclusive). text (str): Cell text content. column_header (bool): Whether this cell is a column header. row_header (bool): Whether this cell is a row header. row_section (bool): Whether this cell is a row section. r6row_spancol_spanstart_row_offset_idxend_row_offset_idxstart_col_offset_idxend_col_offset_idxrF column_header row_header row_sectionbefore)rdatarc [U[5(amSU;aU$USRSS5n[U5(d<UR SS5nU(aUH nX$SS-- nM UR 5nX!S'U$)z Create TableCell from dict, extracting 'text' property correctly. Args: data (Any): Input data. Returns: Any: TableCell-compatible dict. rbboxrr text_cell_bboxesNr )rWrrrApopstrip)clsr0r text_cellsels rfrom_dict_formatTableCell.from_dict_formatCs dD ! !~ <##GR0Dt99!XX&8$? (7 c 11)zz|L rrN)__name__ __module__ __qualname____firstlineno____doc__r&r__annotations__r'rnr,boolr-r.r classmethodrr9__static_attributes__rrrr%r%'s HcHc IM4JK(#CC$rr%cx\rSrSr%Sr/r\\\S'Sr \ \S'Sr \ \S'\ \ S\\\4Sj55rS rg ) TableDatai]z TableData holds a table's cells, row and column counts, and provides a grid property. Attributes: table_cells (List[TableCell]): List of table cells. num_rows (int): Number of rows. num_cols (int): Number of columns. table_cellsrnum_rowsnum_colsrcD[UR5VVs/sH:n[UR5Vs/sHn[SUUS-UUS-S9PM snPM< nnnURHn[[ UR UR5[ URUR55HYn[[ URUR5[ URUR55H nXCUU'M M[ M U$s snfs snnf)zn Returns a 2D grid of TableCell objects for the table. Returns: List[List[TableCell]]: Table as 2D grid. r r6)rr(r)r*r+) r@rGrHr%rFr&r(r)r*r+)selfrGrN table_datacells rgridTableData.gridks(4==)  *t}}- .A)*'(1u)*'(1u . *   $$DD--t}}=D++T]];114==A//?A(,qM!$  %-   sDD DDrN)r;r<r=r>r?rFrr%r@rGrrHr propertyrMrCrrrrErE]sU$&Ki%HcHc d4 ?+rrEzzzzzzz+(?:|||||)z.*?(?=z|$))flagssc $SSR[[[[[ [ /5-S-n[R"X5n[R"X5nUVs/sHoDR5(dMUPM nnX#4$s snf)z Extract OTSL tags and text parts from the input string. Args: s (str): OTSL string. Returns: Tuple[List[str], List[str]]: (tokens, text_parts) (|)) rOTSL_NL OTSL_FCEL OTSL_ECEL OTSL_LCEL OTSL_UCEL OTSL_XCELrfindallsplitr5)rQr"tokens text_partsrs rotsl_extract_tokens_and_textr`sz ))WiIy)T U V   ZZ #F'%J%/AZE;;=%ZJA  Bs &B B c ^[m[R"UU4Sj5VVs/sHup#U(aM[U5PM nnn/nSnSnU(Ga%[ SU55nUH:n [ U 5U:dMU R [5 [ U 5U:aM&M< /n Sn UHn U Hn U R U 5 U [ U5:dM%X U :XdM/U S- n U [ U5:dMEX [[[[[[4;dMmU R X 5 U S- n M U R [5 U [ U5:dMX [:XdMU S- n M U nSn Sn[U5GH=unnSnU[[4;aSnSnSnU[:wa XS-nSnUU-[ U5:aXU-OSnSnUS-[ U5:aU[ XFS-5:a XFS-UnU[[4;aUU "XGS-U[[/5- nU[[4;aUU"XGUS-[[/5- nUR [UR5UUUUU-UUU-S 95 U[[[[[4;aUS- nU[:XdGM6US- nSnGM@ XT4$s snnf) z Parse OTSL text and tags into TableCell objects and tag structure. Args: texts (List[str]): List of tokens and text. tokens (List[str]): List of OTSL tags. Returns: Tuple[List[TableCell], List[List[str]]]: (table_cells, split_row_tokens) c>UT:H$rr)z split_words r"otsl_parse_texts..s Zrrc38# UHn[U5v M g7frrArrows rr#otsl_parse_texts..s<+;Cs3xx+;r6cxSnUnXUU;a*US- nUS- nU[X5:aU$XUU;aM*U$Nrr6rh)r^c_idxr_idx which_tokensspan c_idx_iters r count_right%otsl_parse_texts..count_rightsY mJ'<7 !OJ AIDS// mJ'<7  rctSnUnXUU;a(US- nUS- nU[U5:aU$XUU;aM(U$rnrh)r^rorprqrr r_idx_iters r count_down$otsl_parse_texts..count_downsX  '<7 !OJ AIDS[(  '<7  rr r)rr&r'r(r)r*r+)rV itertoolsgroupbylistr'rArrXrWrYrZr[rCr%r5)textsr^xysplit_row_tokensrFrpromax_colsrj new_textstext_idxrrtrxrGr cell_textr&r' right_offsetnext_right_cellnext_bottom_cellrds @rotsl_parse_textsrsJ%%f.GHHDA QH K E E<+;<<#Cc(X% 9%c(X%$ #C  'c%j(U_-EMH#e*,!!!!! I2"((9 A    W %#e*$G)CA #$$U#4 Iy) )HHLy !a%L  ,-|+;c%j+H,&'b  " qy3/003/ :;;'7 'B5'I$9i"88K$aiI8N Iy#99J$UQYI8N   "*%%).',x'7).',x'7  Iy)Y J J QJE 7? QJEEU$V  ((Is KKrKc VURnURn[UR5S:XagSnURn[ U5HnUS- n[ U5HnXEUnUR URpURURpX:wdX:waMD[R"URR55n UR(aSOSn U nUS:a USUS3- nU S:a US U S3- nUS US U S U S 3- nM US - nM SUS3nU$)zv Export TableData to HTML table. Args: table_data (TableData): TableData object. Returns: str: HTML string. rr zthtdr6z rowspan=""z colspan="<>zzz
)rGrHrArFrMr@r&r(r'r*htmlescaperr5r,)rKnrowsncolsbodyrMrGrNrLrowspanrowstartcolspancolstartrcelltag opening_tags rexport_to_htmlr$s>   E   E : ! !"a' D ??D 5\ uA"gajD!%0I0IX!%0I0IX} kk$))//"34G"00ddG$IK{G9A66 {G9A66 a }AgYb ; ;D !"TF( #D Krotsl_strc^[U[5(deUR5n[U;a U[-$UR [5n/nUHnU(dM [ R U5nU(dM*[U5nSn[U5H&upxUR[5(dM!US-nM( URXEUS.5 M U(d[$U(a[SU55OSn U(a[SU55OSn U n [X5n [S5n U n[XS-5H#m[U4SjU55nX:dMUn TnM% /nUHQnUSn[U5nUU:aUS UnO[ /UU- -nUU-nURS R#U55 MS [R#U5[-$) z Pad OTSL string to a square (rectangular) format, ensuring each row has equal number of cells. Args: otsl_str (str): OTSL string. Returns: str: Padded OTSL string. rr6) raw_cells total_lenmin_lenc3*# UH oSv M g7f)rNrris rr%otsl_pad_to_sqr_v2..is>Xcy>Xc3*# UH oSv M g7frNrris rrrjs=HSK(Hrrc3F># UHn[UST- 5v M g7frrz)rrjras rrrqs# S(3S%5%=!>!>(s!rNr )rWrnr5rVr]OTSL_FIND_PATTERNr\rArC startswithrWrr'rr@rcrXr)rlinesrow_datalinerrrrGcell_strglobal_min_width max_total_len search_start search_endmin_total_cost optimal_widthcurrent_total_costrepaired_linesrjcells current_len new_cellspaddingras @rotsl_pad_to_sqr_v2rIs h $ $$ $~~Hh'!! NN7 #EH %--d3   N $Y/KA""9--a%0 # P  BJs>X>>PQAIC=H==qM#L%5J5\NM|!^4 S( SS  ./N!M 5 NK %j  &n}-I k][%@AGIbggi01 << '' 11r otsl_contentc[U5n[U5up[X!5up4[[ U5U(a[ SU55OSUS9n[ U5$)z Convert OTSL-v1.0 string to HTML. Only 6 tags allowed: , , , , , . Args: otsl_content (str): OTSL string. Returns: str: HTML table. c38# UHn[U5v M g7frrhris rr'convert_otsl_to_html..s;*:3c#hh*:rlr)rGrHrF)rr`rrErAr'r)rr^ mixed_textsrFrrKs rconvert_otsl_to_htmlrs_&l3L6|DF$4[$I!K%&?O#;*:;;UVJ * %%rc[U5n[SUS-S-5H!nX-S:XdM USUnX1U--U:XdMUs $ g)z Find the shortest substring that repeats to form the entire string. Args: s (str): Input string. Returns: str or None: Shortest repeating substring, or None if not found. r6rrN)rAr@)rQnrG substrings r!find_shortest_repeating_substringrsT AA 1a1fqj ! 5A:"1IF#q(  " rr min_repeatsc0[[U5U-US- S5HvnX*SnURXB-5(dM"SnUnURU5(a#USU*nUS- nURU5(aM#[U5XS-- nUSUXE4s $ g)a Detect if string ends with a repeating phrase. Args: s (str): Input string. min_len (int): Minimum length of unit. min_repeats (int): Minimum repeat count. Returns: Tuple[str, str, int] or None: (prefix, unit, count) if found, else None. r6rNr)r@rAendswith)rQrrrGunitcounttemp_s start_indexs rfind_repeating_suffixrs3q6k*GaK <v ::d( ) )EF//$''! //$''a&EI.K\k?D/ /= rrline_thresholdchar_threshold min_countc[U5U:aU$UR5nU(dU$SU;aF[U5S:a7[USSS9nU(a%Uupxn [U5U -[U5S-:aU$SU;a?[U5U:a0[U5nU(a[U5[U5-n X:aU$UR S5V s/sH)oR5(dMU R5PM+ n n U (dU$[U 5n X:aU$[ U 5n U R S5SupX:a X- S :aU$U$s sn f) as Detect and truncate character-level, phrase-level, or line-level repetition in content. Args: content (str): Input text. line_threshold (int): Min lines for line-level truncation. char_threshold (int): Min repeats for char-level truncation. min_len (int): Min length for char-level check. Returns: Union[str, str]: (truncated_content, info_string) r dry)rrr8r6rg?)rAr5rrr]r most_common)rrrrrstripped_content suffix_matchprefixrepeating_unitrrr total_lines line_countsmost_common_lines rtruncate_repetitive_contentrsU& 7|i}}  ##,<(=(C,-=qVWX ,8 )FE>"U*S1A-BS-HH  ##,<(=(G:;KL ()S-@@E&%%'.mmD&9 J&9dZZ\\TZZ\&9E J e*K#%.K)55a8; E$7C#? N Ks E+EcfSSKn[UR5S:XaURXR5nOUR 5nUR [R:waUR[R5nUR5nUR5nX4:XaU$X$- X4- - S-nUR[R5nURUSSUR5upgURU5nUcU$URU5uppX X-2XU -24n U $)Nrrrk)rrAshapecvtColorCOLOR_BGR2GRAYrdtyper]uint8astyper'r& thresholdTHRESH_BINARY_INV findNonZero boundingRect)rZrgraymax_valmin_valr0rbinarycoordsr~rrLrMcroppeds r crop_marginrs 399~||C!3!34xxz zzRXX{{288$hhjGhhjG Nw0 1C 7D ;;rxx D dCc.C.CDIA __V $F ~ !!&)JA!ae)QQY&'G Nrz#<\|TEXT_START\|>(.*?)<\|TEXT_END\|>z!<\|LOC_BEGIN\|>(.*?)<\|LOC_END\|>z<\|LOC_(\d+)\|>r=c"URSSupUS:aUUS:aO[U5nUS-US-pC[RRnUR X44U5n[U5nU$UnU$![ a [RnN@f=f)z? Post-process the input image to extract location information. Nri)rr[r ResamplingLANCZOSAttributeErrorresizer_)r=rMrL process_w process_hresample_filter inference_imgs rpre_process_for_spottingr%s ;;r?DA4xAHU# 1ua!e9 ,#..66O i3_E#E*    ,#mmO ,sA11B B input_strrLrMc <[U[5(de[RU5n[RU5n/n/n[ [ U5[ U55n[U5HnX8R5n [RXH5n [ U 5S:aM=[[[U SS55n [SSS5V s/sHoU XS-4PM n n U Vs/sHoSS- U-USS- U-4PM n nURU 5 URU 5 M U(aU(Gd$[[RU55nSnSnUS-[ U5:aXUS-nUVs/sHn[UR!S55PM n n[SSS5V s/sHoU XS-4PM n n U Vs/sHoSS- U-USS- U-4PM n nUUUSR#5nUR5n URU 5 URU 5 USR%5nUS- nUS-[ U5:aMS R'U5nXVS .nUU4$s sn fs snfs snfs sn fs snf) zD Post-process the input string to extract text and location blocks. rNrrr6g@@rr ) rec_polys rec_texts)rWrn ANNOT_TEXT_REr\ LOC_BLOCK_REr&rAr@r5 LOC_ITEM_REr|maprr LOC_TOKEN_REfinditerr rrr)rrLrMr} loc_blocksrrrrGtxt loc_itemsvalsrNptspmatcheslast_endr m text_span result_str spotting_ress rpost_process_for_spottingr:s i % %% %  ! !) ,E%%i0JII CJJ(A 1Xhnn'' 6 y>A  CYr]+,/4Q1~>~!Q!e%~>?BCs!!v !1Q4&=1#45sC I|,,Y78 !ec'l"A&E-23UC OUD338Aq>B>aGTa%[)>CBCFG3aaD6MA%qtf}q'893CG!(U1X^^-=>I//#C   S !   S !Ry}}H FA!ec'l"Y'J!*CL | ##5?C4BGsJ2J $J<JJ)r)rlauto)r)rry)rrri )Errzrr collectionsrrrtypingrrrrr numpyr]PILr pydanticr r r layout_parsing.utilsrrrrrrnrr-rUr[r_rgrvrrrr#r%rErVrWrXrYrZr[NON_CAPTURING_TAG_GROUPcompileDOTALLrr`rrrrrrrrSrrrrndarrayrrrrrrs  00??#25c?##25c?##2 #2 #2L@#d4j)@#>A@# #tDz/@#F   "&R]@;|94x!0H3 3l. .d       GJJv&=%>cB")) C*p)f"y"J727272t&s&*sDy1A(23 +. 5c3  %&: 6 666 6  6  6r@ A244H zz>E jj+, zz,- BJJ4T ?*2$2$2$"2$ 3S$Y  2$r