字符串 ') and Issue_No=(select Issue_No from OA where Script_ID=@Script_ID) order by ID ' 后的引号不完整。 ') and Issue_No=(select Issue_No from OA where Script_ID=@Script_ID) order by ID ' 附近有语法错误。 基于图表示和匹配的表单定位与提取-《智能系统学报》

 TAN Ting,LYU Shujing,LYU Yue.Form location and extraction based on graph representation and matching[J].CAAI Transactions on Intelligent Systems,2019,14(02):231-238.[doi:10.11992/tis.201709038]





Form location and extraction based on graph representation and matching
谭婷1 吕淑静2 吕岳12
1. 华东师范大学 上海多维度信息处理重点实验室, 上海 200062;
2. 中国邮政集团公司上海研究院 图像分析与智能系统联合实验室, 上海 200062
TAN Ting1 LYU Shujing2 LYU Yue12
1. Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai 200062, China;
2. ECNU-SRI Joint Lab for Pattern Analysis and Intelligent System, Shanghai Research Institute of China Post, Shanghai 200062, China
image segmentationform extractionform locationgraph representationgraph matchingisomorphic graphexpress package sorting
To obtain information of a user’s interested region on express package images of different types, resolutions, and directions, a form location and extraction method based on graph representation and matching is proposed in this paper. A reference form is needed in this method. First, key regions such as the existing printed patterns or characters in the reference form are chosen as nodes to build the reference graph. Second, graph representation is conducted on the form to be processed based on the candidate key region derived from image segmentation. Then, the similarity between the reference form and the candidate form is calculated according to attributes of the graph. Finally, the isomorphic graph with the maximum similarity is chosen as the optimal matching of the reference form and graph, and the position mapping of the isomorphic graph and the reference form and test image is established to locate the form. The experimental datasets in this paper originate from express package images collected in practical scenarios. Experimental results indicate that the proposed algorithm has good performance on express form images. Especially, good robustness is achieved for rotated, illuminated, and partially shaded images.


[1] SHARMA D V, LEHAL G S. Form field frame boundary removal for form processing system in Gurmukhi script[C]//Proceedings of the 10th International Conference on Document Analysis and Recognition. Barcelona, Spain, 2009:256-260.
[2] CHEN J L, LEE H J. An efficient algorithm for form structure extraction using strip projection[J]. Pattern recognition, 1998, 31(9):1353-1368.
[3] LIU Wenyin, DORI D. From raster to vectors:extracting visual information from line drawings[J]. Pattern analysis and applications, 1999, 2(1):10-21.
[4] WATANABE T, LUO Qin, SUGIE N, et al. Layout recognition of multi-kinds of table-form documents[J]. IEEE transactions on pattern analysis and machine intelligence, 1995, 17(4):432-445.
[5] LAM S W, SRIHARI S N. Multi-domain document layout understanding[C]//Proceedings of International Conference on Document Analysis and Recognition. 1991:112-120.
[6] SACHDEVA R, SHARMA D V. Data extraction from hand-filled form using form template[J]. International journal on recent and innovation trends in computing and communication, 2015, 3(8):5311-5317.
[7] NING L W, SIAH Y K, KHALID M, et al. Design of an automated data entry system for hand-filled forms[C]//Proceedings of 2000 TENCON. Kuala Lumpur, Malaysia, 2000:162-166.
[8] BENSEFIA A. Extraction of Arabic handwriting fields by forms matching[J]. Journal of signal and information processing, 2015, 6(1):53424.
[9] CESARINI F, GORI M, MARINAI S, et al. INFORMys:a flexible invoice-like form-reader system[J]. IEEE transactions on pattern analysis and machine intelligence, 1998, 20(7):730-745.
[10] CHO M, SUN Jian, DUCHENNE O, et al. Finding matches in a haystack:a max-pooling strategy for graph matching in the presence of outliers[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA, 2014:2091-2098.
[11] SUH Yumin, ADAMCZEWSKI K, LEE K M. Subgraph matching using compactness prior for robust feature correspondence[C]//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, MA, USA, 2015:5070-5078.
[12] SHARMA A, HORAUD R, CECH J, et al. Topologically-robust 3D shape matching based on diffusion geometry and seed growing[C]//Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA, 2011:2481-2488.
[13] DUCHENNE O, JOULIN A, PONCE J. A graph-matching kernel for object categorization[C]//Proceedings of 2011 IEEE International Conference on Computer Vision. Barcelona, Spain, 2011:1792-1799.
[14] ZHANG Quanshi, SONG Xuan, SHAO Xiaowei, et al. Attributed graph mining and matching:an attempt to define and extract soft attributed patterns[C]//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, OH, USA, 2014:1394-1401.
[15] ZHANG Quanshi, SONG Xuan, SHAO Xiaowei, et al. Object discovery:soft attributed graph mining[J]. IEEE transactions on pattern analysis and machine intelligence, 2016, 38(3):532-545.
[16] LEORDEANU M, SUKTHANKAR R, Hebert M, et al. Unsupervised learning for graph matching[J]. International journal of computer vision, 2012, 96(1):28-45.
[17] UIJLINGS J R R, VAN DE SANDE K E A, GEVERS T, et al. Selective search for object recognition[J]. International journal of computer vision, 2013, 104(2):154-171.


 WANG Ke-jun,GUO Qing-chang.Image segmentation algorithm based on the PSO and improved Snake model[J].CAAI Transactions on Intelligent Systems,2007,2(02):53.
 CHEN Xiao-bo,CHENG Xian-yi.An adaptive image segmentation technique based on multiAgent system[J].CAAI Transactions on Intelligent Systems,2007,2(02):80.
 LIU Yong-mei,DAI Li-jie.An improved method of Kmeans image segmentation based on spatial position information[J].CAAI Transactions on Intelligent Systems,2010,5(02):67.
 WU Yi-quan,JI Shou-xin.Multithreshold selection for an image based on gray entropy and chaotic particle swarm optimization[J].CAAI Transactions on Intelligent Systems,2010,5(02):522.
 SHANG Qian,RUAN Qiuqi,LI Xiaoli.Target recognition and location based on binocular stereo vision[J].CAAI Transactions on Intelligent Systems,2011,6(02):303.
[6]胡光龙,秦世引.动态成像条件下基于SURF和Mean shift的运动目标高精度检测[J].智能系统学报,2012,7(01):61.
 HU Guanglong,QIN Shiyin.High precision detection of a mobile object under dynamic imaging based on SURF and Mean shift[J].CAAI Transactions on Intelligent Systems,2012,7(02):61.
 MA Hui,WANG Kejun.A region of interest extraction method using rotation rectified finger vein images[J].CAAI Transactions on Intelligent Systems,2012,7(02):230.
 YIN Yushan,WANG Lijin,YIN Yilong,et al.Backtracking search optimization algorithm assisted multilevel threshold for image segmentation[J].CAAI Transactions on Intelligent Systems,2015,10(02):68.[doi:10.3969/j.issn.1673-4785.201410008]
 WU Yiquan,WANG Kai,CAO Pengxiang.Two-dimensional asymmetric tsallis cross entropy image threshold selection using bee colony optimization[J].CAAI Transactions on Intelligent Systems,2015,10(02):103.[doi:10.3969/j.issn.1673-4785.201403040]
 LONG Peng,LU Huaxiang.Global threshold segmentation technique guided by prior knowledge with asymmetric variance[J].CAAI Transactions on Intelligent Systems,2015,10(02):663.[doi:10.11992/tis.201412022]


更新日期/Last Update: 2019-04-25