i<SrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKr SSK J r J r Sr SrSrS$SjrSrS rS rS rS$S jrS%S jrSrSrSrSrSrSrSrSrSrSr Sr!S&Sjr"Sr#Sr$Sr%Sr&Sr'Sr("S S!5r)"S"S#\)5r*g)'zp This code is refer from: https://github.com/JiaquanYe/TableMASTER-mmocr/blob/master/table_recognition/match.py N)Polygon MultiPointc/nUH%n[U5S:XaMURU5 M' [R"U5$)zj remove [0., 0., 0., 0.] in structure master bboxes. len(bboxes.shape) must be 2. :param bboxes: :return: g)sumappendnparray)bboxes new_bboxesbboxs n/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/paddleocr/ppstructure/table/table_master_match.pyremove_empty_bboxesr#sAJ t9  $ 88J cB[UR5S:Xa\[R"U5nUSUSS- - US'USUSS- - US'USUSS- -US'USUSS- -US'U$[UR5S:Xa[R"U5nUSS2S4USS2S4S- - USS2S4'USS2S4USS2S4S- - USS2S4'USS2S4USS2S4S- -USS2S4'USS2S4USS2S4S- -USS2S4'U$[eNrlenshaper empty_like ValueErrorr r s r xywh2xyxyr2sZ 6<<A]]6* q F1IM1 1 q F1IM1 1 q F1IM1 1 q F1IM1 1  V\\ a ]]6* !!Q$<&A,*:: 1a4!!Q$<&A,*:: 1a4!!Q$<&A,*:: 1a4!!Q$<&A,*:: 1a4rcj[UR5S:Xab[R"U5nUSUSUS- S- -US'USUSUS- S- -US'USUS- US'USUS- US'U$[UR5S:Xa[R"U5nUSS2S4USS2S4USS2S4- S- -USS2S4'USS2S4USS2S4USS2S4- S- -USS2S4'USS2S4USS2S4- USS2S4'USS2S4USS2S4- USS2S4'U$[errrs r xyxy2xywhrEsv 6<<A]]6* q VAY%:a$?? 1 q VAY%:a$?? 1 q F1I- 1 q F1I- 1  V\\ a ]]6* !!Q$<6!Q$<&A,+F!*KK 1a4!!Q$<6!Q$<&A,+F!*KK 1a4!!Q$<&A,6 1a4!!Q$<&A,6 1a4rc[RRU5(a"[R"[ US55nU$[RR U5(a[5n[RRUSRU55n[R"U5nUH4n[R"[ US55nURU5 M6 U$[e)Nrbz{}_*.pkl) ospathisfilepickleloadopenisdirdictjoinformatglobupdater)r!prefixdata search_pathpklspkl this_datas r pickle_loadr2Xs ww~~d{{4d+, K t  vggll4):):6)BC yy%C DdO4I KK " Krc[R"SS/[RS9nUSUSsUS'US'USUSsUS'US 'USUS sUS 'US 'USUS sUS 'US'U$)zH Convert two points format to four points format. :param xyxy: :return: r)dtyperr)rr)rr)rr)rrr)rr)rr)rr)rr)rzerosfloat32)xyxynew_bboxs r convert_coordr:gs xxAbjj1H%)!Wd1g"HTNHTN%)!Wd1g"HTNHTN%)!Wd1g"HTNHTN%)!Wd1g"HTNHTN Orc`[U5Rn[U5Rn[R"X45nUR U5(dSnU$UR U5R n[U5RR nUS:XaSnU$[U5U- nU$)Nr) r convex_hullr concatenate intersects intersectionarearfloat)bbox1bbox2 bbox1_poly bbox2_poly union_polyiou inter_area union_areas r cal_iourJus++J++J/J   , , J  ,,Z8==  +77<< ?C J #j0C JrcpUSUS- nUSUS- n[R"US-US--5nU$)Nrrr)mathsqrt)p1p2delta_xdelta_yds r cal_distancerSsDebemGebemG 7A:'1*-.A HrcSnSnUSUSS:aUSUSS::aSnUSUSS:aUSUSS::aSnU(aU(agg)z Find if center_point inside the bbox(corner_point) or not. :param center_point: center point (x, y) :param corner_point: corner point ((x1,y1),(x2,y2)) :return: FrrT) center_point corner_pointx_flagy_flags r is_insiderZswF FQ<?1--Q<?1--Q<?1--Q<?1-- &rcUS:XaSnOUS:XaSnO[e/nUVs/sHoUUPM nn[U5HnXv;dM URU5 M U$s snf)a Find out no match end2end bbox in previous match list. :param match_list: matching pairs. :param all_end2end_nums: numbers of end2end_xywh :param type: 'end2end' corresponding to idx 0, 'master' corresponding to idx 1. :return: no match pse bbox index list end2endrmasterr)rranger) match_listall_end2end_numstypeidxno_match_indexsmmatched_bbox_indexsns r find_no_matchrgsq y  O+56:aS6:6 # $ '  " "1 %%  7sAc8[USUS- 5nX2:agg)NrTF)abs) this_bbox target_bbox thresholddeltas r is_abs_lower_than_thresholdrns%  ! {1~- .E rcUVs/sHo"SPM nn[U5nS/[U5-nS/[U5-n[X5H!uprURUS5nX&U'XuU'M# XV4$s snf)z Sorted the bbox in the same line(group) compare coord 'x' value, where 'y' value is closed in the same group. :param g: index in the same group :param bg: bbox in the same group :return: rN)sortedrzipindex) gbgbg_itemxs xs_sortedg_sorted bg_sortedg_itemrbs r sort_line_bboxr{s%' 'B!*BB 'r IvI&HY'Iq:oogaj) # &   (sA1c/n/n[X5H;upE[XE5H'upgURU5 URU5 M) M= X#4$N)rqr) sorted_groupssorted_bbox_groupsidxsr group bbox_grouprsrts r flattenrsQ D F C+EA KKN MM" ,D <rc</n/n[X5HupEUn[U5S:Xa&URU/5 URU/5 M<Sn[X#5H>up[XiS5(dMURU5 U RU5 Sn O U(aMURU/5 URU/5 M //p[X#5H4up[ X5upU RU 5 U RU 5 M6 S/[U 5-nS/[U 5-nU V s/sH oSSPM nn [ U5n[X5H$upUR U SS5nXU'XU'M& [X5unnUUUU4$s sn f)z This function will group the render end2end bboxes in row. :param end2end_xywh_bboxes: :param no_match_end2end_indexes: :return: rFTNr)rqrrrnr{rprrr)end2end_xywh_bboxesno_match_end2end_indexesgroups bbox_groupsrrend2end_xywh_bboxrjflagrsrt tmp_groupstmp_bbox_groupsrxryr~rys sorted_ysrbend2end_sorted_idx_listend2end_sorted_bbox_lists r sort_bboxrsFK$'(@$V % v;!  MM5' "    { +DV1.yQ%@@HHUOIIi(D 24 ug&""I;/#%W(#%bV),Q3(#y)* FS_,M#o"66, -_rQ%(_B -r IZ1oobeAh'c"$32 9@955     .s4Fc"/n/nUH5nUSnURU5 [U5nURU5 M7 [R"U5n[R"U5nUSn [ U 5n U n [U 5nUn UUU U 4$)a  This function is use to convert end2end results and structure master results to List of xyxy bbox format and List of xywh bbox format :param end2end_result: bbox's format is xyxy :param structure_master_result: bbox's format is xywh :return: 4 kind list of bbox () r )rrrr r) end2end_resultstructure_master_resultend2end_xyxy_listend2end_xywh_list end2end_itemsrc_bbox xywh_bboxend2end_xyxy_bboxesr src_bboxesstructure_master_xyxy_bboxesstructure_master_xywh_bboxess r get_bboxes_listrs& '  *h'   + ' ((#45((#45)0J$Z0J#- *%I#,  $$  rc/n[U5Hdup4[U5HPupVUSUSpUSUSUSUS4uppXx4n X4X44n[X5(dM>URX5/5 MR Mf U$)a  Judge end2end Bbox's center point is inside structure master Bbox or not, if end2end Bbox's center is in structure master Bbox, get matching pair. :param end2end_xywh_bboxes: :param structure_master_xyxy_bboxes: :return: match pairs list, e.g. [[0,1], [1,2], ...] rrrr) enumeraterZr)rrmatch_pairs_listi end2end_xywhj master_xyxy x_end2end y_end2end x_master1 y_master1 x_master2 y_master2center_point_end2endcorner_point_masters r center_rule_matchrAs$%89'(DENA#/?LOyAAAA : 6I) %.#9 $-#9I;Q"R -CC ''/F: rc/n[X5HlupESnSS/n[U5H9up[U5n [U 5n [X5n X:dM-XHsUS'US'U nM; UScM[UR U5 Mn U$)z Use iou to find matching list. choose max iou value bbox as match pair. :param end2end_xyxy_bboxes: :param end2end_xyxy_indexes: original end2end indexes. :param structure_master_xyxy_bboxes: :return: match pairs list, e.g. [[0,1], [1,2], ...] rNr)rqrr:rJr) rend2end_xyxy_indexesrmatch_pair_listend2end_xyxy_index end2end_xyxymax_iou max_matchrr end2end_4xy master_4xyrGs r iou_rule_matchrZsO,/-(4L '(DENA' 5K&{3J+2C}-?* ! il F Q<  y)!-" rc/n[X#5HvupV[RnSS/n[X5H=upU SU SpUSUSpX4nX4n[UU5nUU:dM1XsUS'US'UnM? UR U5 Mx U$)aw Get matching between no-match end2end bboxes and no-match master bboxes. Use min distance to match. This rule will only run (no-match end2end nums > 0) and (no-match master nums > 0) It will Return master_bboxes_nums match-pairs. :param end2end_indexes: :param end2end_bboxes: :param master_indexes: :param master_bboxes: :return: match_pairs list, e.g. [[0,1], [1,2], ...] rr)rqrinfrSr)end2end_indexesend2end_bboxesmaster_indexes master_bboxesmin_match_listr master_bbox min_distance min_matchr end2end_bboxrrx_mastery_master end2end_point master_pointdists r distance_rule_matchrzsNn<vv F "?COA#/?LOy!,QQh&2M$/L m' which is real space is text 2. Remove ' ', which is split token, not true space 3. Replace '' with ' ', to get real text :param text: :return: z z replace)texts r deal_successive_spacers9 << +D <<R D << 3 'D Krc SnUH nURS5(dMUS- nM" U[U5:XaV/nUH6nURSS5RSS5nURU5 M8 SUR U5-S-/$U$)z convert ['Local', 'government', 'unit'] to ['Local government unit'] PS: maybe style Local is also exist, too. it can be processed like this. :param text_list: :param break_token: :return: rrr) startswithrrrr() text_list break_tokencountr new_text_lists r reduce_repeat_bbrs E ??5 ! ! QJE I D<<r*2262>D   & ((77&@AArc[5nUR5H<upEUVs/sH oaUSPM nn[Xr5nURU5nXU'M> U$s snf)Nr)r'itemsrr() r end2end_informatch_text_dictrend2end_index_listrrrs r get_match_text_dictrsufO,6,<,<,>( EW EWM ' /EW  %Y<  *(, % -?   sAc/nSnUSS:waURS5 XS:wGaXS:XaXS-RS5(dXS-RS5(a1SRXUS -S-5nUS - nURU5 OXS -RS5(dXS -RS5(a1SRXUS -S-5nUS - nURU5 O2URX5 US- nOURX5 US- nXS:waGMURS5 U$! [S 5 M#=f)zW Merge the span style token (row span or col span). :param master_token_list: :return: r>{KK ''"3gkAo"NOCqLG)005&{3>>&{3>>{KK ''"3gkAo"NOCqLG)005*001B1KLqLG%,,->-GH1 A  $ 2H  ,    % & sA.EA&E?EE EcURSS5nURSS5nURSS5nURSS5nURS S 5nURS S 5nURS S5nURSS5nURSS5nURSS5nURSS5nU$)aO post process with , , ... emptyBboxTokenDict = { "[]": '', "[' ']": '', "['', ' ', '']": '', "['\u2028', '\u2028']": '', "['', ' ', '']": '', "['', '']": '', "['', ' ', '']": '', "['', '', '', '']": '', "['', '', ' ', '', '']": '', "['', '']": '', "['', ' ', '\u2028', ' ', '\u2028', ' ', '']": '', } :param master_token: :return: z z z z z z u

z z z z z z zz z z zz u 
 
 r) master_tokens r deal_eb_tokenrs& '' [AL'' |DL'' 7JKL'' 7NOL'' 7NOL'' 7IJL'' 7JKL'' 7PQL'' 7QRL'' 7IJL'':L rcn[U5n/nSnUHnURS5(a[U[U5S- :aUS- nM2X1R5;aUS- nMLUR SSR X55nUS- n[ U5nURU5 M SRU5$)zg Insert OCR text result to structure token. :param master_token_list: :param match_text_dict: :return: rrrz>{}s)):;J)  " "5 ) )C0144a #7#7#99a +33&--(CD  a $\2 !!,/* 77% &&rcSn[R"X5nUVs/sHo3R5PM nnSn/nUHan[R"XW5nUR5n U b$SR U 5n UR U 5 MPUR S5 Mc [ Xd5HupU bURXz5nMM U$s snf)z Deal with isolate span cases in this function. It causes by wrong prediction in structure recognition model. eg. predict to rowspan="2">. :param thead_part: :return: z rowspan="(\d)+" colspan="(\d)+">| colspan="(\d)+" rowspan="(\d)+">| rowspan="(\d)+">| colspan="(\d)+">zc rowspan="(\d)+" colspan="(\d)+"| colspan="(\d)+" rowspan="(\d)+"| rowspan="(\d)+"| colspan="(\d)+"Nz )refinditerrsearchr)rrqr) thead_partisolate_pattern isolate_iterr isolate_list span_patterncorrected_list isolate_item span_partspanStr_in_isolateItemcorrected_items r deal_isolate_spanr[s . ;;;L'34|!GGI|L4  N$ IIl9 !*!2 ! -*112HIN  ! !. 1  ! !$ '%),N(I$  %#++LIJ  )J 55sCcSn[R"X5nUVs/sHo3R5PM nn/nUHnURS5S:dURS5S:aWUR SS5R SS5nUR SS5R SS 5nUR U5 MUR U5 M [ XE5HupgUR Xg5nM U$s snf) zn Deal duplicate or after replace. Keep one in a token. :param thead_part: :return: z(.+?)|(.+?)|(.+?)|(.+?)|(.*?)rrrr )rrrrrrrq)r td_patterntd_iterttd_list new_td_listtd_item new_td_items r deal_duplicate_bbrs kk*1G")*'Qwwy'G*K == ! #w}}V' always occurs in text's context. This function will find out all tokens in and insert by manual. :param result_token: :return: z(.*?)zs|||rTFrrrrzrzr>z>z()+z()+rr) rrrcopydeepcopyrrrrrqsubrr) result_token thead_patternrorigin_thead_partr span_iters span_listhas_span_in_headreplaced_span_listsprsp mb_patternsingle_b_string mgb_patternsingle_gb_strings r deal_bbr/s+M yy-5=7==?J j1IL L5I$-.IqII."9~1tu    vy 1 WWk * WXu % WZ ( " B  % %bjjf&= >99GB#++B4J: ''=  VVJD  !VVK:F  '' :BB8US ##$6 DJ":.J#:.J''(9FL q/s2G c,\rSrSrSrSrSrSrSrg)MatchericXXlX l[USS9Ul[USS9Ulg)z This class process the end2end results and structure recognition results. :param end2end_file: end2end results predict by end2end inference. :param structure_master_file: structure recognition results predict by structure master inference. r\)r, structureN) end2end_filestructure_master_filer2end2end_resultsstructure_master_results)selfr4r5s r __init__Matcher.__init__s1 )%:"*< J(3 !+) %rc[5n[URR55GHunup4/nX0R;aMURUn[ XF5unnn n [ X5n URU 5 [U[U5SS9n [U 5S:a#UU n [U U U 5nURU5 [U[U5SS9n[U[U 5SS9n[U5S:a8[U5S:a)UUnU Un[UUUU5nURU5 [U[U5SS9n[U5S:aSUUn[UU5unnnn[U[U 55n[R"U5nURU5 O[R"U5n/n/nUUUUS.nUR!UU5nUX'GM U$)z Match process: pre-process : convert end2end and structure master results to xyxy, xywh ndnarray format. 1. Use pseBbox is inside masterBbox judge rule 2. Use iou between pseBbox and masterBbox rule 3. Use min distance of center point rule :return: r\)rarr])r_match_list_add_extra_matchr~sorted_bboxes_groups)r'rr6rr7rrextendrgrrrrrrr_format)r8 match_resultsrb file_namerr_rrrrrcenter_rule_match_listcenter_no_match_end2end_indexscenter_no_match_end2end_xyxyiou_rule_match_list!centerIou_no_match_end2end_indexs centerIou_no_match_master_indexscenterIou_no_match_end2end_xywhcenterIou_no_match_master_xywhdistance_match_listrno_match_end2end_xywhend2end_sorted_indexes_listend2end_sorted_bboxes_listr~r=rr<match_result_dicts r match Matcher.matchsr 09$:N:N:T:T:V0W ,C,)J = ==&*&C&CI&N #  H  ##,,&7#& "   4 5.;C 349. *12Q6/B20,'5020'# !!"56 1>C 3491 -0=C <=H0 ,4599:Q>2E53/2N42.':5342 '# !!"56(5C 349( $+,q0(; J '8M $Q1XTrcRURUnURUnUSnUSn/nUHVnS/n [U5n [U 5Hn U R S5 M U R S5 UR U 5 MX UR S5n U SS:XaU S SR U5 O_U SS:Xa4U R S5 U R U5 U R S5 O"U R U5 U R S5 URS U 5 U$) z Extend the master token(insert virtual master token), and format matching result. :param match_result: :param file_name: :return: rr~zrz,rrNmatched_master_token_list)r6r7rr^rr>split setdefault) r8 match_resultrAr master_inforr~virtual_master_token_list line_grouptmp_list item_nums_rs r r?Matcher._format}s8++I6 33I> "6* $_5 %'!'JxHJI9% ,& OOG $ % , ,X 6 ()..s3 R J . cr " ) )*C Dr "k 1  $ $W -  $ $%> ?  $ $Z 0  $ $%> ?  $ $Z 0  ;=NOrc[5nSn[UR55HRunupVURUnUSnUSn [ U 5n [ XU5n [ X5n [U 5n XU'MT U$)z` Merge the OCR result into structure token to get final results. :param match_results: :return: rrSr<)r'rrr6rrrr/) r8r@merged_resultsrrbrA match_inforrr_rr merged_results r get_merge_resultMatcher.get_merge_results  ,5m6I6I6K,L (C()// :L *+F G #$@AJ' 3J1*KXO01BTM#M2M(59 %-Mr)r4r6r5r7N) __name__ __module__ __qualname____firstlineno__r9rOr?rb__static_attributes__rUrr r1r1s  tl/brr1c$\rSrSrSrSSjrSrg)TableMasterMatchericgr}rU)r8s r r9TableMasterMatcher.__init__s rcdU/0n[X#5H9upg[[R"U5USS9nXTR U5 M; XPlU00n UupSR U SS5n XUS'XUS'XlUR5n URU 5n XnSU-S -nU$) Nr)r rrRrrr zz
) rqr'rr rr6r(r7rOrb)r8 structure_resdt_boxesrec_resimg_namer6dt_boxresrRstructure_master_result_dictpred_structures pred_bboxesr@r_ pred_htmls r __call__TableMasterMatcher.__call__s#R.x1KFXXf%VA  % , ,Q / 2 /(0"~$'4$((?1R#899HX.v69DX.v6(D% ..}=", )I58PP r)r6r7N)r)rdrerfrgr9ryrhrUrr rjrjs  rrj)r\)r)r)+__doc__r rcv2r*rrLr#numpyrshapely.geometryrrrrrr2r:rJrSrZrgrnr{rrrrrrrrrrrrrrrrr/r1rjrUrr rs  0  &&  " .0,7tD2@:   , 0!f F':*Z"JIXLL^r