Abstract
A display system which augments a user’s view of the surrounding scene with annotations based on the scene contents, has many potential applications. In order to exploit this potential, systematic schemes need to be developed for presenting the augmentation stimuli. We consider the problem of scene augmentation in the context of a human engaged in assembling a mechanical object from its components. Concepts from robot assembly planning are used to develop a systematic framework for presenting augmentation stimuli for this assembly domain. An interactive simulation tool called AUDIT is then described, which can be used for developing and visualizing multi-modal augmentation schemes for assembly. The interactive nature of the system is useful for evaluating an augmentation scheme and studying its impact on the assembly/disassembly guidance.
