Skip to content

Automated capture and delivery of assistive task guidance with an eyewear computer: the GlaciAR system

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Original languageEnglish
Title of host publicationProceedings of the 8th Augmented Human International Conference
Publisher or commissioning bodyAssociation for Computing Machinery (ACM)
Number of pages9
ISBN (Electronic)9781450348355
StatePublished - 18 Mar 2017
EventACM 8th Augmented Human International Conference - Silicon Valley, United States


ConferenceACM 8th Augmented Human International Conference
CountryUnited States
CitySilicon Valley


In this paper we describe and evaluate an assistive mixed reality system that aims to augment users in tasks by combining automated and unsupervised information collection with minimally invasive video guides. The result is a fully self-contained system that we call GlaciAR (Glass-enabled Contextual Interactions for Augmented Reality). It operates by extracting contextual interactions from observing users performing actions. GlaciAR is able to i) automatically determine moments of relevance based on a head motion attention model, ii) automatically produce video guidance information, iii) trigger these guides based on an object detection method, iv) learn without supervision from observing multiple users and v) operate fully on-board a current eyewear computer (Google Glass). We describe the components of GlaciAR together with user evaluations on three tasks. We see this work as a first step toward scaling up the notoriously difficult authoring problem in guidance systems and an exploration of enhancing user natural abilities via minimally invasive visual cues.

    Research areas

  • Augmented Reality, Task Guidance, Eyewear computing, Assistive computing


ACM 8th Augmented Human International Conference

Duration16 Mar 201718 Mar 2017
CitySilicon Valley
CountryUnited States

Event: Conference

Download statistics

No data available



  • Full-text PDF (accepted author manuscript)

    Rights statement: This is the author accepted manuscript (AAM). The final published version (version of record) is available online via ACM at . Please refer to any applicable terms of use of the publisher.

    Accepted author manuscript, 40 MB, PDF-document


View research connections

Related faculties, schools or groups