ARCADE: An Augmented Reality Display Environment for Multimodal Interaction with Conversational Agents

Carolin Schindler, Daiki Mayumi, Yuki Matsuda, Niklas Rach, Keiichi Yasumoto, Wolfgang Minker: “ARCADE: An Augmented Reality Display Environment for Multimodal Interaction with Conversational Agents,” Companion Proceedings of the 26th International Conference on Multimodal Interaction (ICMI Companion '24), pp.85-87, 2024.

Abstract

Making the interaction with embodied conversational agents accessible in a ubiquitous and natural manner is not only a question of the underlying software but also brings challenges in terms of the technical system that is used to display them. To this end, we present our spatial augmented reality system ARCADE, which can be utilized like a conventional monitor for displaying virtual agents as well as additional content. With its optical-see-through display, ARCADE creates the illusion of the agent being in the room similarly to a human. The applicability of our system is demonstrated in two different dialogue scenarios, which are included in the video accompanying this paper at https://youtu.be/9nH4c4Q-ooE

https://youtu.be/9nH4c4Q-ooE

Links

DOI: https://doi.org/10.1145/3686215.3688376

PDF: https://cocolab.jp/publication/files/202411_ICMI_Carolin.pdf

BibTeX

code:references.bib

@inproceedings{bib:carolin_arcade_ICMI2024demo,

author={Schindler, Carolin and Mayumi, Daiki and Matsuda, Yuki and Rach, Niklas and Yasumoto, Keiichi and Minker, Wolfgang},

title={ARCADE: An Augmented Reality Display Environment for Multimodal Interaction with Conversational Agents},

booktitle={Companion Proceedings of the 26th International Conference on Multimodal Interaction (ICMI Companion '24)},

pages={85--87},

year={2024},

doi={10.1145/3686215.3688376},

url={https://doi.org/10.1145/3686215.3688376}

}

https://scrapbox.io/files/68cb5b317d2807c30005132e.png