[1]JABEEN Farzana,田琳琳,任怡,等.针对可穿戴设备的虚拟鼠标[J].智能系统学报,2017,12(02):133-139.[doi:10.11992/tis.201608003]
 JABEEN Farzana,TIAN Linlin,REN Yi,et al.Virtual mouse for wearable display[J].CAAI Transactions on Intelligent Systems,2017,12(02):133-139.[doi:10.11992/tis.201608003]





Virtual mouse for wearable display
JABEEN Farzana1 田琳琳2 任怡2 陶霖密1
1. 清华大学 人机交互与媒体集成研究所, 北京 100084;
2. 北京邮电大学 国际学院, 北京 100876
JABEEN Farzana1 TIAN Linlin2 REN Yi2 TAO Linmi1
1. Institute of HCI and Media Integration, Tsing University, Beijing 100084, China;
2. International College, Beijing University of Posts and Telecommunications, Beijing 100876, China
virtual mousewearable displaydisabilityhuman computer interaction
Physical and cognitive health problems have always been one of the most prominent issues related to sustainable development of human health. By embedding virtual-reality into products and technology, the virtual-reality and the health-care of the disabled were combined. However, using sensor-based virtual display device in the early stage was not easy for the disabled when using input devices (keyboard, mouse, remote controller) to control VR devices, the operation was complicated, which meant that people with dyskinesia cannot operate them without extra help. This paper proposed virtual mouse to solve these problems mentioned above with the help of wearable glasses, combining the functions of keyboard, mouse, and remote-control to simply interaction process. Using one key, users can interact with the system installed in the virtual glasses with only one finger, little finger strength is needed. Experiments were made to test the usability of the virtual mouse with wearable glasses. The experimental results demonstrate reliability and effectiveness of the proposed system, the feedback of the users shows the satisfaction and necessity of the system.


[1] KOUROUPETROGLOU G. Assistive technologies and computer access for motor disabilities[M]. Hershey PA, USA: IGI Global, 2014.
[2] CHESTNUT J A, CRUMPTON L L. Virtual reality: a training tool in the 21st century for disabled persons and medical students[C]//Proceedings of the 1997 Sixteenth Southern Biomedical Engineering Conference. Biloxi, MS: IEEE, 1997: 418-421.
[3] HOLCOMB J B, DUMIRE R D, CROMMETT J W, et al. Evaluation of trauma team performance using an advanced human patient simulator for resuscitation training[J]. The journal of trauma and acute care surgery, 2002, 52(6): 1078-1086.
[4] FENG Chuan, ROZENBLIT J W, HAMILTON A. Fuzzy logic-based performance assessment in the virtual, assistive surgical trainer (VAST)[C]//Proceedings of the 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems. Belfast: IEEE, 2008: 203-209.
[5] CHUNG J M, RAMASAMY K, KOTIKALAPUDI V, et al. Virtual laboratory education for persons with vision disabilities[C]//Proceedings of the 2002 45th Midwest Symposium on Circuits and Systems. Tulsa, OK, USA: IEEE, 2002, 2: II-617-II-620.
[6] BOZGEYIKLI L, BOZGEYIKLI E, CLEVENGER M, et al. VR4VR: towards vocational rehabilitation of individuals with disabilities in immersive virtual reality environments[C]//Proceedings of the 2014 2nd Workshop on Virtual and Augmented Assistive Technology. Minneapolis, MN, USA: IEEE, 2014: 29-34.
[7] DEDE C J, SALZMAN M, LOFTIN R B. The development of a virtual world for learning newtonian mechanics[M]//BRUSILOVSKY P, KOMMERS P, STREITZ N. Multimedia, Hypermedia, and Virtual Reality Models, Systems, and Applications, Volume 1077 of the series Lecture Notes in Computer Science. Berlin Heidelberg: Springer, 1996: 87-106.
[8] ZYDA M. From visual simulation to virtual reality to games[J]. Computer, 2005, 38(9): 25-32.
[9] DRAGANOV I R, BOUMBAROV O L. Investigating oculus rift virtual reality display applicability to medical assistive system for motor disabled patients[C]//Proceedings of the 8th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications. Warsaw, Poland: IEEE, 2015.
[10] STANNEY K M, MOURANT R R, KENNEDY R S. Human factors issues in virtual environments: a review of the literature[J]. Presence, 1998, 7(4): 327-351.
[11] DEB S, DEB S. Single key Omni directional pointing and command system (SKOPS)——a smart on screen navigational tool for physically disabled persons[C]//Proceedings of the 2007 9th International Conference on e-Health Networking, Application and Services. Taipei, China: IEEE, 2007: 197-201.
[12] LANYI C S, TOLGYESY S M, SZUCS V, et al. Wheelchair driving simulator: computer aided training for persons with special need[C]//Proceedings of the 2015 6th IEEE International Conference on Cognitive Infocommunications. Gyor, Hungary: IEEE, 2015.
[13] 陈晨, 吴建国. 基于WebRTC的残疾人鼠标研究与实现[J]. 计算机技术与发展, 2013, 23(9): 32-35.CHEN Chen, WU Jianguo. Research and implementation of disabled mouse based on WebRTC[J]. Computer technology and development, 2013, 23(9): 32-35.
[14] ALM N, ARNOTT J L, MURRAY I R, et al. Virtual reality for putting people with disabilities in control[C]//Proceedings of 1998 IEEE International Conference on Systems, Man, and Cybernetics. San Diego, CA, USA: IEEE, 1998, 2: 1174-1179.
[15] WANG Xingfeng, QIN Kaihuai. A six-degree-of-freedom virtual mouse based on hand gestures[C]//Proceedings of 2010 International Conference on Electrical and Control Engineering. Wuhan, China: IEEE, 2010.
[16] BOZGEYIKLI E, BOZGEYIKLI L, CLEVENGER M, et al. Poster: design and development of a virtual reality system for vocational rehabilitation of individuals with disabilities[C]//Proceedings of 2014 IEEE Symposium on 3D User Interfaces. Minneapolis, Minnesota, USA: IEEE, 2014.
[17] PIOVESAN S D, WAGNER R, MEDINA R D, et al. Virtual reality system to the inclusion of people with disabilities in the work market[C]//Proceedings of International Conference on Information Technology Based Higher Education and Training. Antalya, Turkey: IEEE, 2013.
[18] KAMIETH F, D?HNE P, WICHERT R, et al. Exploring the potential of virtual reality for the elderly and people with disabilities[M]//KIM J J. Virtual Reality. Open Access Publisher, 2011.
[19] LOUP-ESCANDE E, CHRISTMANN O, DAMIANO R, et al. Virtual reality learning software for individuals with intellectual disabilities: comparison between touchscreen and mouse interactions[C]//Proceedings of the 9th International Conference on Disability, Virtual Reality and Associated Technologies. Laval, France, 2012: 295-303.
[20] 张占龙, 罗辞勇, 何为. 虚拟现实技术概述[J]. 计算机仿真, 2005, 22(3): 1-3, 7. ZHANG Zhanlong, LUO Ciyong, HE Wei. A survey of virtual reality technology[J]. Computer simulation, 2005, 22(3): 1-3, 7.
[21] BUDZISZEWSKI P, GRABOWSKI A, MILANOWICZ M, et al. Workstations for people with disabilities: an example of a virtual reality approach[J]. International journal of occupational safety and ergonomics, 2016, 22(3): 367-373.
[22] HOWARD B, HOWARD S. Lightglove: wrist-worn virtual typing and pointing[C]//Proceedings of the Fifth International Symposium on Wearable Computers. Zurich, Switzerland: IEEE, 2001.
[23] MCCOMAS J, PIVIK J, LAFLAMME M. Current uses of virtual reality for children with disabilities[J]. Studies in health technology and informatics, 1998, 58: 161-169.
[24] QUARLES J. Shark punch: a virtual reality game for aquatic rehabilitation[C]//Proceedings of 2015 IEEE Virtual Reality. Arles, Camargue, Provence, France: IEEE, 2015: 265-266.
[25] 宫金良, 张彦斐, 周玉林, 等. 一种新型六维鼠标在虚拟现实技术中的应用[J]. 传感器技术, 2005, 24(9): 82-84, 88.GONG Jinliang, ZHANG Yanfei, ZHOU Yulin, et al. Application of novel six dimension mouse in virtual reality technology[J]. Journal of transducer technology, 2005, 24(9): 82-84, 88.
[26] 谢晶妮, 张茂军. 虚拟现实发展趋势展望[J]. 计算机工程, 2002, 28(7): 1-2, 19. XIE Jingni, ZHANG Maojun. Trends of virtual reality system development[J]. Computer engineering, 2002, 28(7): 1-2, 19.


 CHENG Yu,ZHANG Mingyu,TAO Linmi.One-Bit human-computer interactive system[J].CAAI Transactions on Intelligent Systems,2015,10(02):528.[doi:10.3969/j.issn.1673-4785.201501015]


作者简介:JABEEN Farzana,女,博士研究生,主要研究方向为人机交互、为运动障碍人士设计对外交流系统、为盲人设计购物助理系统。她认为用低比特交互系统可以很好地解决残障人士的对外沟通问题。已发表学术论文多篇;陶霖密,男,1962年生,副教授,主要研究方向为人机交互、计算机视觉与模式识别等。承担的项目有国家重点基金情感计算,以及与IBM、INTEL、SIEMENS的国际合作基金等重要项目。发表论文多篇。
更新日期/Last Update: 1900-01-01