Creating Realistic Human Avatars for Social Virtual Environments Using Photographic Inputs

Raymond Leonardo Chandra; Koen Castermans; Djamel Berkaoui; Patrick Querl; Nacken Heribert

doi:10.51519/journalisi.v6i3.842

Raymond Leonardo Chandra RWTH Aachen University, Germany
Koen Castermans RWTH Aachen University, Germany
Djamel Berkaoui RWTH Aachen University, Germany
Patrick Querl RWTH Aachen University, Germany
Nacken Heribert RWTH Aachen University, Germany

DOI: 10.51519/journalisi.v6i3.842

Keywords: virtual reality, Education, Open-Source Software, Photogrammetry, Avatar

Abstract

This paper presents the development and evaluation of realistic virtual reality avatars created with a Blender add-on called Facebuilder. In this process, a person's head is photographed from different angles. These photographs are used in subsequent steps to generate a realistic avatar face. To investigate the user experience of interacting with these avatars, a study was conducted in VR using the MyScore application. The study involved 22 participants who met in a virtual environment to discuss a topic of their choice. Statistical analyses including descriptive statistics, Wilcoxon Signed-Rank Test, and Friedman Test showed significant differences supporting all three hypotheses: users preferred communicating with realistic avatars, were more focused and engaged when interacting with them. The results indicate a significant preference for realistic avatars in educational use cases, primarily due to the perceived seriousness of the interactions and the resulting higher level of participant engagement. The suitability of realistic versus non-realistic avatars was found to be use-case dependent. Participants suggested that realistic avatars would be more appropriate for educational scenarios and non-realistic avatars for entertainment.

Downloads

Download data is not yet available.

References

D. Hamilton, J. McKechnie, E. Edgerton, and C. Wilson, “Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design,” J. Comput. Educ., vol. 8, no. 1, pp. 1–32, Mar. 2021, doi: 10.1007/s40692-020-00169-2.

D. Jo et al., “The impact of avatar-owner visual similarity on body ownership in immersive virtual reality,” in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, Gothenburg Sweden: ACM, Nov. 2017, pp. 1–2. doi: 10.1145/3139131.3141214.

E. Molina, A. R. Jerez, and N. P. Gomez, “Avatars rendering and its effect on perceived realism in Virtual Reality,” in 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Utrecht, Netherlands: IEEE, Dec. 2020, pp. 222–225. doi: 10.1109/AIVR50618.2020.00046.

M. C. Fysh, I. V. Trifonova, J. Allen, C. McCall, A. M. Burton, and M. Bindemann, “Avatars with faces of real people: A construction method for scientific experiments in virtual reality,” Behav. Res. Methods, vol. 54, no. 3, pp. 1461–1475, Jun. 2022, doi: 10.3758/s13428-021-01676-5.

D. Hepperle, C. F. Purps, J. Deuchler, and M. Wölfel, “Aspects of visual avatar appearance: self-representation, display type, and uncanny valley,” Vis. Comput., vol. 38, no. 4, pp. 1227–1244, Apr. 2022, doi: 10.1007/s00371-021-02151-0.

M. E. Latoschik, D. Roth, D. Gall, J. Achenbach, T. Waltemate, and M. Botsch, “The effect of avatar realism in immersive social virtual realities,” in Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, Gothenburg Sweden: ACM, Nov. 2017, pp. 1–10. doi: 10.1145/3139131.3139156.

Z. Li et al., “3D Human Avatar Digitization from a Single Image,” in Proceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, Brisbane QLD Australia: ACM, Nov. 2019, pp. 1–8. doi: 10.1145/3359997.3365707.

A. Mao, H. Zhang, Y. Liu, Y. Zheng, G. Li, and G. Han, “Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor,” Sensors, vol. 17, no. 5, p. 1113, May 2017, doi: 10.3390/s17051113.

F. Bogo, M. J. Black, M. Loper, and J. Romero, “Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences,” in 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile: IEEE, Dec. 2015, pp. 2300–2308. doi: 10.1109/ICCV.2015.265.

C. Pirch, O. Kausch, A. Klepser, and S. Morlock, “One Avatar, Two Level of Detail, One Result? - Analyzing the Effect of Low and High Detailed Avatars on Fitting Simulations,” in Proceedings of 3DBODY.TECH 2021 - 12th International Conference and Exhibition on 3D Body Scanning and Processing Technologies, Lugano, Switzerland, 19-20 October 2021, Lugano, Switzerland: Hometrica Consulting - Dr. Nicola D’Apuzzo, Oct. 2021. doi: 10.15221/21.46.

A. Bönsch, A. Feng, P. Patel, and A. Shapiro, “Volumetric Video Capture using Unsynchronized, Low-cost Cameras:,” in Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Prague, Czech Republic: SCITEPRESS - Science and Technology Publications, 2019, pp. 255–261. doi: 10.5220/0007373202550261.

n. d KeenTools, “FaceBuilder for Blender.” Accessed: Jan. 01, 2024. [Online]. Available: https://keentools.io/products/facebuilder-for-blender

T. Boe and C. Carter, “Human Photogrammetry: Foundational Techniques for Creative Practitioners,” Int. J. Comput. Graph. Animat., vol. 10, no. 1, pp. 1–20, Jan. 2020, doi: 10.5121/ijcga.2020.10101.

O. C. Quispe-Enriquez, J. J. Valero-Lanzuela, and J. L. Lerma, “Craniofacial 3D Morphometric Analysis with Smartphone-Based Photogrammetry,” Sensors, vol. 24, no. 1, p. 230, Dec. 2023, doi: 10.3390/s24010230.

S. Nebel, M. Beege, S. Schneider, and G. D. Rey, “A Review of Photogrammetry and Photorealistic 3D Models in Education from a Psychological Perspective,” Front. Educ., vol. 5, p. 144, Aug. 2020, doi: 10.3389/feduc.2020.00144.

T. Roosendaal, The Essential Blender: Guide to 3D Creation with the Open-Source Suite Blender, Blender Foundation, 2007.

D. Berkaoui, R. Chandra, and K. Castermans, “MyScore – Avatar-Based Teaching and Learning,” 2022, doi: 10.18420/VRAR2022_7790.

K. L. Nowak, J. Fox, and The Ohio State University, “Avatars and computer-mediated communication: A review of the definitions, uses, and effects of digital representations on communication,” Rev. Commun. Res., vol. 6, pp. 30–53, 2018, doi: 10.12840/issn.2255-4165.2018.06.01.015.

C. M. Grewe, T. Liu, C. Kahl, A. Hildebrandt, and S. Zachow, “Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces,” Front. Virtual Real., vol. 2, p. 619811, Apr. 2021, doi: 10.3389/frvir.2021.619811.

R. H. Riffenburgh, “Tests on Ranked Data,” in Statistics in Medicine, Elsevier, 2012, pp. 221–248. doi: 10.1016/B978-0-12-384864-2.00011-1.

Jing Tong, Jin Zhou, Ligang Liu, Zhigeng Pan, and Hao Yan, “Scanning 3D Full Human Bodies Using Kinects,” IEEE Trans. Vis. Comput. Graph., vol. 18, no. 4, pp. 643–650, Apr. 2012, doi: 10.1109/TVCG.2012.56.