LI Jinghua, HUAI Huarui, KONG Dehui, WANG Lichun, SUN Yanfeng. Dynamic Hand Gesture Recognition Based on Two-channel Hybrid 3D-2D RBM[J]. Journal of Beijing University of Technology, 2019, 45(5): 428-435. DOI: 10.11936/bjutxb2017090018
    Citation: LI Jinghua, HUAI Huarui, KONG Dehui, WANG Lichun, SUN Yanfeng. Dynamic Hand Gesture Recognition Based on Two-channel Hybrid 3D-2D RBM[J]. Journal of Beijing University of Technology, 2019, 45(5): 428-435. DOI: 10.11936/bjutxb2017090018

    Dynamic Hand Gesture Recognition Based on Two-channel Hybrid 3D-2D RBM

    • To explore the intrinsic spatio-temporal representation of dynamic hand gesture in the video-based hand gesture recognition, this paper proposed a 3D-2D restricted Boltzmann machine (RBM) model, which is able to model the spatio-temporal correlation of hand gesture video data. Especially, a method combining traditional hand-defined feature with 3D-2D RBM was proposed to describe hand gesture better. The proposed hybrid 3D-2D RBM model consists of three phases. First, Canny-2D HOG and optical flow 2D HOG were used to describe the spatial and temporal feature, respectively. A 3D-2D RBM was then adopted to learn the latent high-level semantics. Finally, the two-channel discrimination results were fused together for recognition. The experimental results on the public Cambridge Hand Gesture Data set show that the proposed hybrid 3D-2D RBM outperforms the state-of-the-art.
    • loading

    Catalog

      Turn off MathJax
      Article Contents

      /

      DownLoad:  Full-Size Img  PowerPoint
      Return
      Return