Use of Human Gestures for Controlling a Mobile Robot via Adaptive CMAC Network and Fuzzy Logic Controller

Authors Organisations
  • Dajun Zhou(Author)
    Xiamen University
  • Minghui Shi(Author)
    Xiamen University
  • Fei Chao(Author)
    Xiamen University
  • Chih-Min Lin(Author)
    Xiamen University
    Yuan Ze University
  • Longzhi Yang(Author)
    Northumbria University
  • Changjing Shang(Author)
  • Changle Zhou(Author)
    Xiamen University
Type Article
Original languageEnglish
Pages (from-to)218-231
Number of pages14
Early online date14 Dec 2017
Publication statusPublished - 22 Mar 2018
Permanent link
Show download statistics
View graph of relations
Citation formats


Mobile robots with manipulators have been more and more commonly applied in extreme and hostile environments to assist or even replace human operators for complex tasks. In addition to autonomous abilities, mobile robots need to facilitate the human–robot interaction control mode that enables human users to easily control or collaborate with robots. This paper proposes a system which uses human gestures to control an autonomous mobile robot integrating a manipulator and a video surveillance platform. A human user can control the mobile robot just as one drives an actual vehicle in the vehicle’s driving cab. The proposed system obtains human’s skeleton joints information using a motion sensing input device, which is then recognized and interpreted into a set of control commands. This is implemented, based on the availability of training data set and requirement of in-time performance, by an adaptive cerebellar model articulation controller neural network, a finite state machine, a fuzzy controller and purposely designed gesture recognition and control command generation systems. These algorithms work together implement the steering and velocity control of the mobile robot in real-time. The experimental results demonstrate that the proposed approach is able to conveniently control a mobile robot using virtual driving method, with smooth manoeuvring trajectories in various speeds


  • mobile robot, mobile manipulator, intelligent control, human-robot interactions