Welcome to Journal of Beijing Institute of Technology
Advance Search
Volume 25Issue 4
.
Turn off MathJax
Article Contents
Article Navigation> JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY> 2016> 25(4): 491-501
FENG Zhi-quan, XU Tao, LÜ Na, TANG Hao-kui, JIANG Yan, LIANG Li-wei. Hand gesture tracking algorithm based on visual attention[J]. JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY, 2016, 25(4): 491-501. doi: 10.15918/j.jbit1004-0579.201625.0407
Citation: FENG Zhi-quan, XU Tao, LÜ Na, TANG Hao-kui, JIANG Yan, LIANG Li-wei. Hand gesture tracking algorithm based on visual attention[J].JOURNAL OF BEIJING INSTITUTE OF TECHNOLOGY, 2016, 25(4): 491-501.doi:10.15918/j.jbit1004-0579.201625.0407
shu

Hand gesture tracking algorithm based on visual attention

doi:10.15918/j.jbit1004-0579.201625.0407

  • School of Information Science and Engineering, University of Jinan, Jinan 250022, China;Shandong Provincial Key Laboratory of Network-Based Intelligent Computing, Jinan 250022, China

  • Received Date:2015-10-14
    Abstract
  • In the majority of the interaction process, the operator often focuses on the tracked 3D hand gesture model at the "interaction points" in the collision detectionscene, such as "grasp" and "release" and objects in the scene, without paying attention to the tracked 3D hand gesture model in the total procedure. Thus in this paper, a visual attention distribution model of operator in the "grasp", "translation", "release" and other basic operation procedures is first studied and a 3D hand gesture tracking algorithm based on this distribution model is proposed. Utilizing the algorithm, in the period with a low degree of visual attention, a pre-stored 3D hand gesture animation can be used to directly visualise a 3D hand gesture model in the interactive scene; in the time period with a high degree of visual attention, an existing "frame-by-frame tracking" approach can be adopted to obtain a 3D gesture model. The results demonstrate that the proposed method can achieve real-time tracking of 3D hand gestures with an effective improvement on the efficiency, fluency, and availability of 3D hand gesture interaction.
    • FullText(HTML)
  • loading
    • References (15)
  • [1]
    Oikonomidis I, Kyriazis N, Argyros A A. Tracking the articulated motion of two strongly interacting hands[C]//CVPR, 2012:1-10.
    [2]
    Zhao Wenping, Chai Jinxiang, Xu Yingqing. Combining marker-based Mocap and RGB-D camera for acquiring high-fidelity hand motion data[C]//Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Eurographics Association, 2012: 33-42.
    [3]
    David Kim, Otmar Hilliges, Shahram Izadi, et al. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor[C]//Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST'12), ACM, New York, NY, USA, 2012: 167-176.
    [4]
    Andreas Aristidou. Motion capture with constrained inverse kinematics for real-time hand tracking[C]//ISCCSP 2010, Limassol, Cyprus, 2010: 1-6.
    [5]
    Wang Robert Y, Jovan Popovic. Real-time hand-tracking with a color glove[C]//SIGGRAPH'09,2009:63-71.
    [6]
    Wang Yangang, Min Jianyuan, Zhang Jianjie, et al. Video-based hand manipulation capture through composite motion control[J]. ACM Transactions on Graphics (Proceedings of ACM SIGGARPH 2013), 2013, 32(4):1-10.
    [7]
    Shahram Izadi, Aaron Quigley, Ivan Poupyrev, et al. Mime: compact, low power 3D gesture sensing for interaction with head mounted displays[C]//UIST'13, 2013: 227-236.
    [8]
    Stefanov N, Galata A, Hubbold R. A real-time hand tracker using variable-length markov models of behaviour[J]. Computer Vision and Image Under-standing,2007, 108(1-2): 98-115.
    [9]
    Li H P, Hu Z Y, Wu Y H, et al. Behavior modeling and abnormality detection based on semi-supervised learning method[J]. Journal of Software,2007, 18(3): 527-537.
    [10]
    Li Z B, Horain P, Pez A M, et al. Statistical gesture models for 3D motion capture from a library of gestures with variants[C]//Proceedings of the Statistical Gesture Models for 3D Motion Capture from a Library of Gestures with Variants, GW2009, LNAI 5934, 2010: 219-230.
    [11]
    Choumane A, Casiez G, Grisoni L. Buttonless clicking: intuitive select and pick-release through gesture analysis[C]//Proceedings of the IEEE Virtual Reality, 20-24 March, Waltham, Massachusetts, USA, 2010: 67-70.
    [12]
    Feng Z, Yang B, Li Y, et al. Real-time oriented behavior-driven 3D freehand tracking for direct interaction[J]. Pattern Recognition, 2013, 46(2): 590-608.
    [13]
    Itti L, Koch C, Niebur E. A model of saliency based visual attention for rapid scene analysis[C]//IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011: 1254-1259.
    [14]
    Sanchez-Riera J, Hsiao Y S, Lim T, et al. A robust tracking algorithm for 3D hand gesture with rapid hand motion through deep learning[C]//Multimedia and Expo Workshops (ICMEW), 2014 IEEE International Conference on, 2014: 1-6.
    [15]
    Yao M H, Gu Q L, Wang X B, et al. A novel hand gesture tracking algorithm fusing camshift and particle filter[C]//2015 International Conference on Artificial Intelligence and Industrial Engineering, Atlantis, 2015.
    • Relative Articles
  • Supplements (0)
  • Cited By
  • 加载中

Catalog

    通讯作者:陈斌, bchen63@163.com
    • 1.

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索
    Get Citation
    PDF
    XML

    Article Metrics

    Article views (649) PDF downloads(584) Cited by()
    Proportional views
    Related

    Address:5 Zhongguancun South Street, Haidian District, Beijing

    Tel:86-10-68914374

    Email:blgywb@bit.edu.cn

    Copy Right © Journal of Beijing Institute of Technology

    Supported by:Beijing Renhe Information Technology Co. Ltd

    /

      Return
      Return
        Baidu
        map