Retrospective Speech Balloons on Speech-visible AR via Head-Mounted Display

Tomoki Kurahashi, Ryota Sakuma, Keiichi Zempo, Koichi Mizutani, and Naoto Wakatsuki. Retrospective speech balloons on speech-visible ar via head-mounted display. In Adjunct Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2018 (To appear). 2018.
[BibTeX▼]

@inproceedings{ismar2018_demo_11,
    author = "Kurahashi, Tomoki and Sakuma, Ryota and Zempo, Keiichi and Mizutani, Koichi and Wakatsuki, Naoto",
    title = "Retrospective Speech Balloons on Speech-visible AR via Head-Mounted Display",
    year = "2018",
    booktitle = "Adjunct Proceedings of the IEEE International Symposium for Mixed and Augmented Reality 2018 (To appear)"
}

Abstract

It was confirmed speech balloon captioning shown in 3 dimensional space (such as Augmented Reality) were better than caption shown in 2 dimension screen with the aim of information insurance for people with hearing impairment in previous research. In this research, we reconfirmed that multi line captions contributes to the user's comprehension of the speech balloon contents better than the single line caption. This research has also found that the system's ability which enables the user to look back on the previous parts of the conversation leads to the improvement of the user experience. In addition, when the amount of sentences increases, the captions presented not as a log, but as multi speech balloons like comics are more natural and do not obstruct the user's view.

Sponsors

Abstract