Proceedings: GI 2005

Evaluation of an on-line adaptive gesture interface with command prediction

Xiang Cao, Ravin Balakrishnan

Proceedings of Graphics Interface 2005: Victoria, British Columbia, Canada, 9 - 11 May 2005, 187-194

  • BibTex

    author = {Cao, Xiang and Balakrishnan, Ravin},
    title = {Evaluation of an on-line adaptive gesture interface with command prediction},
    booktitle = {Proceedings of Graphics Interface 2005},
    series = {GI 2005},
    year = {2005},
    issn = {0713-5424},
    isbn = {1-56881-265-5},
    location = {Victoria, British Columbia, Canada},
    pages = {187--194},
    numpages = {8},
    publisher = {Canadian Human-Computer Communications Society},
    address = {School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada},


We present an evaluation of a hybrid gesture interface framework that combines on-line adaptive gesture recognition with a command predictor. Machine learning techniques enable on-line adaptation to differences in users' input patterns when making gestures, and exploit regularities in command sequences to improve recognition performance. A prototype using 2D single-stroke gestures was implemented with a minimally intrusive user interface for on-line re-training. Results of a controlled user experiment show that the hybrid adaptive system significantly improved overall gesture recognition performance, and reduced users' need to practice making the gestures before achieving good results.