[1]LIU Biao,HUANG Rongrong,LIN He,et al.Research on braille music recognition based on convolutional neural networks[J].CAAI Transactions on Intelligent Systems,2019,14(1):186-193.[doi:10.11992/tis.201805002]
Copy
Research on braille music recognition based on convolutional neural networks
CAAI Transactions on Intelligent Systems[ISSN 1673-4785/CN 23-1538/TP] Volume:
14
Number of periods:
2019 1
Page number:
186-193
Column:
学术论文—机器感知与模式识别
Public date:
2019-01-05
- Title:
- Research on braille music recognition based on convolutional neural networks
- Keywords:
- machine learning; braille music recognition; convolution neural network; deep learning; computer vision; image recognition; artificial intelligence; image processing
- CLC:
- TP39
- DOI:
- 10.11992/tis.201805002
- Abstract:
- Blind musicians are confronted with the problems of manual conversion and low efficiency in the communication of musical works. The rapid development of information science and technology has provided many solutions to these problems. However, most of the recognition schemes for braille music works lack recognition efficiency and compatibility. In consideration of this deficiency, whereby traditional schemes rely heavily on artificial experience in braille music picture extraction, a convolution neural network-based recognition model has been developed. After preprocessing the sample data of braille music pictures through repeated iterative training, the recognition model was able learn the characteristics of music notation in braille music pictures. The experimental results showed the recognition effectiveness and strong generalization ability of the model, which provides a new idea for the recognition of braille music works.
- References:
-
[1] MARIOTTI S P. Global data on visual impairments 2010[R]. Geneva:World Health Organization, 2012:1-17.
[2] ANTONACOPOULOS A, BRIDSON D. A robust braille recognition system[C]//6th International Workshop on Document Analysis Systems. Florence, Italy, 2004:533-545.
[3] MOUSA A, HIARY H, ALOMARI R, et al. Smart braille system recognizer[J]. IJCSI international journal of computer science issues, 2013, 10(6):52-60.
[4] SHREEKANTH T, UDAYASHANKARA V. An algorithmic approach for double sided Braille dot recognition using image processing techniques[J]. International journal of image processing and visual communication, 2014, 2(4):1-6.
[5] 王倩倩. 基于DSP的简谱识别和盲文乐谱转换算法研究与实现[D]. 沈阳:东北大学, 2013. WANG Qianqian. Research and implementation of numbered musical notation identification and braille musical translation algorithm based on DSP[D]. Shenyang:Northeastern University, 2013.
[6] 黄河燕, 周强, 沈鑫, 等. 基于对节记谱法的盲文乐谱自动排版方法及装置:CN105719626A[P]. 2016-06-29. HUANG Heyan, ZHOU Qiang, SHEN Xin, et al. Automatic braille music score typesetting method and device based on by-rhythm stave memorizing method:CN105719626A[P]. 2016-06-29.
[7] 张志强. 视障乐谱转换软件SunMusic的设计实现[D]. 兰州:兰州大学, 2016. ZHANG Zhiqiang. The design and implementation of music conversion software SunMusic for visually impaired[D]. Lanzhou:Lanzhou University, 2016.
[8] 李婷. 基于深度学习的盲文识别方法[J]. 计算机与现代化, 2015(6):37-40 LI Ting. A deep learning method for braille recognition[J]. Computer and modernization, 2015(6):37-40
[9] ALI H S, ASSABIE Y. Recognition of double sided Amharic braille documents[J]. International journal of image, graphics and signal processing, 2017, 9(4):1-9.
[10] JIBRIL E C, MESHESHA M. Recognition of Amharic braille documents[C]//The 5th International Conference on the Advancement of Science and Technology. 2017, 15:22-29.
[11] WALEED M. Braille identification system using artificial neural networks[J]. Tikrit journal of pure science, 2017, 22(2):140-145.
[12] AL NASSIRI A, ABDULLA S. A fuzzy classification and recognition system for arabic braille segmented characters[J]. International journal of applied engineering research, 2018, 13(6):3662-3669.
[13] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe, Nevada, 2012:1097-1105.
[14] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv:1409.1556, 2014.
[15] HE Kaiming, ZHANG Xiangyu, REN Shaoqing, et al. Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA, 2016:770-778.
[16] 周飞燕, 金林鹏, 董军. 卷积神经网络研究综述[J]. 计算机学报, 2017, 40(6):1229-1251 ZHOU Feiyan, JIN Linpeng, DONG Jun. Review of convolutional neural network[J]. Chinese journal of computers, 2017, 40(6):1229-1251
[17] 常亮, 邓小明, 周明全, 等. 图像理解中的卷积神经网络[J]. 自动化学报, 2016, 42(9):1300-1312 CHANG Liang, DENG Xiaoming, ZHOU Mingquan, et al. Convolutional neural networks in image understanding[J]. Acta automatica sinica, 2016, 42(9):1300-1312
[18] 李彦冬, 郝宗波, 雷航. 卷积神经网络研究综述[J]. 计算机应用, 2016, 36(9):2508-2515, 2565 LI Yandong, HAO Zongbo, LEI Hang. Survey of convolutional neural network[J]. Journal of computer applications, 2016, 36(9):2508-2515, 2565
[19] 周俊宇, 赵艳明. 卷积神经网络在图像分类和目标检测应用综述[J]. 计算机工程与应用, 2017, 53(13):34-41 ZHOU Junyu, ZHAO Yanming. Application of convolution neural network in image classification and object detection[J]. Computer engineering and applications, 2017, 53(13):34-41
[20] GU Jiuxiang, WANG Zhenhua, KUEN J, et al. Recent advances in convolutional neural networks[J]. Pattern recognition, 2018, 77:354-377.
[21] LI Yangyan, SU Hao, QI C R, et al. Joint embeddings of shapes and images via CNN image purification[J]. ACM transactions on graphics (TOG), 2015, 34(6):1-5.
[22] 卢宏涛, 张秦川. 深度卷积神经网络在计算机视觉中的应用研究综述[J]. 数据采集与处理, 2016, 31(1):1-17 LU Hongtao, ZHANG Qinchuan. Applications of deep convolutional neural network in computer vision[J]. Journal of data acquisition and processing, 2016, 31(1):1-17
[23] 李念峰, 董迎红, 肖志国. 基于图像处理的盲文自动识别系统研究[J]. 制造业自动化, 2012, 34(3):63-67 LI Nianfeng, DONG Yinghong, XIAO Zhiguo. Study on image processing based braille automatic identification system[J]. Manufacturing automation, 2012, 34(3):63-67
- Similar References:
Memo
-
Last Update:
1900-01-01