Ecological Validity and the Evaluation of Avatar Facial Animation Noise

Authors: Marta Wilczkowiak, Sean Rintel
Venue: Workshop Series on Animation in Virtual and Augmented Environments (ANIVAE 2024)

Abstract

Facial animation noise levels affect the acceptance of avatars in communication systems. However, there is no standard for evaluation, especially with regard to ecological validity. We investigate low and high ecological validity on two within-subjects experiments conducted in Augmented Reality on a Hololens2. We simulated facial-expression noise introduced on stylized cartoon avatars, and found that in the high ecological validity experiment, subjects were less sensitive to noise parameters, but their judgement was more influenced by empathy scores and gender biases. This highlights the importance of considering both technical parameters and user experience when designing communication systems. We make some general recommendations for evaluating issues of avatar acceptance given the trade-offs between the approaches, and propose the ‘Triple C’ factors of Context, Culture and Character as an important set of ecological factors to consider.

BibTeX

@inproceedings{wilczkowiaksheher2024ecological,
author = {Wilczkowiak (SHE/HER), Marta and Jakubzak, Ken and Clemoes,  James and Treptow, Cornelia and Read, Kerry and Porubanova, Michaela and McDuff, Daniel and Kuznetsova, Marina and Rintel, Sean and Gonzalez-Franco, Mar},
title = {Ecological Validity and the Evaluation of Avatar Facial Animation Noise},
organization = {IEEE Virtual Reality 2024},
booktitle = {Workshop Series on Animation in Virtual and Augmented Environments (ANIVAE 2024)},
year = {2024},
month = {March},
url = {https://www.microsoft.com/en-us/research/publication/ecological-validity-and-the-evaluation-of-avatar-facial-animation-noise/},
}
Projects: Project

View on Microsoft Research →