MSc Interaction Technology · University of Twente · 2026
Multimodal Affect Recognition for Unseen Visitors in a Free-Roaming VR Museum
Akshaj Somanpura Rajendran · Supervisor: Shenghui Wang
Can worn sensors tell a museum guide how a visitor feels, second by second, for someone it has never met?
Across five experiments on a free-roaming VR visit, no sensor, combination or adaptation rose above chance, and the ratings
show why: the painting explains almost none of a rating, the visitor most of it.
38
visitors: 22 rated live, 16 rated afterwards
114
sensor features per second, from eyes, skin, heart and voice
+0.084
best score for an unseen visitor (CCC; 0 is chance)
1.5% vs 65%
of a rating: the painting explains at most 1.5%, the visitor up to 65%