A Robot Calligraphy System: From Simple to Complex Writing by Human Gestures

Authors Organisations
  • Fei Chao(Author)
    Xiamen University
  • Yuxuan Huang(Author)
    Xiamen University
  • Xin Zhang(Author)
    Xiamen University
  • Changjing Shang(Author)
  • Longzhi Yang(Author)
    Northumbria University
  • Changle Zhou(Author)
    Xiamen University
  • Huosheng Hu(Author)
    Xiamen University
    University of Essex
  • Chih-Min Lin(Author)
    Xiamen University
    Yuan Ze University
Type Article
Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalEngineering Applications of Artificial Intelligence
Early online date14 Dec 2016
Publication statusPublished - 01 Mar 2017
Permanent link
Show download statistics
View graph of relations
Citation formats


Robotic writing is a very challenging task and involves complicated kinematic control algorithms and image processing work. This paper, alternatively, proposes a robot calligraphy system that firstly applies human arm gestures to establish a font database of Chinese character elementary strokes and English letters, then uses the created database and human gestures to write Chinese characters and English words. A three-dimensional motion sensing input device is deployed to capture the human arm trajectories, which are used to build the font database and to train a classifier ensemble. 26 types of human gesture are used for writing English letters, and 5 types of gesture are used to generate 5 elementary strokes for writing Chinese characters. By using the font database, the robot calligraphy system acquires a basic writing ability to write simple strokes and letters. Then, the robot can develop to write complex Chinese characters and English words by following human body movements. The classifier ensemble, which is used to identify each gesture, is implemented through using feature selection techniques and the harmony search algorithm, thereby achieving better classification performance. The experimental evaluations are carried out to demonstrate the feasibility and performance of the proposed method. By following the motion trajectories of the human right arm, the end-effector of the robot can successfully write the English words or Chinese characters that correspond to the arm trajectories


  • robotic writing, robotic calligraphy, human-robot interaction, human gesture recognition, classifier ensemble