A Survey of Gesture in Interaction

This project explores the definition of ‘gesture’ through a survey of literature in cognitive science and the fine arts to deconstruct humanistic qualities of gesture. While this work could be critical to art and humanities-based applications that rely on movement-based inputs, it is also a contribution to a broader scope of accessibility in technology design.

We selected works based on their approach to or use of embodied qualities that explore beyond typical overt systems of measurement in gestural recognition and interaction. This work will provide a foundation for exploring alternative opportunities to develop tracking models in human movement, which are important as technology development becomes more nuanced. Our aim is to develop a typology of gesture that supports phenomenologically-focused design opportunities based in complex humanistic functions. In this work we present a variety of approaches to gesture through cognitive science, HCI, and the fine arts to articulate similarities and differences that will impact the development of a typology of gesture.

Published by gregcorness

Greg Corness is a Researcher and Artist working with embodied interaction in media environments. His background in music, theatre and dance provides the basis for his research which focus on interdisciplinary improvisation, distributed cognition in performance, and methodologies for researching experience in performance. He is particularly interested in investigating performer’s intuition during improvisation and how to leverage this embodied knowledge in their interactions with autonomous computer systems. He has developed several generative sound systems as well as computer vision and tangible interfaces for use in interactive performance and installation works. He has published in the fields of electronic music and human-computer interaction and his work includes galleries installations, interactive museum exhibits and live performance in Canada and the US. View more posts