Real time multimodal interaction with animated virtual human

Jin, L. and Wen, Z. 2006. Real time multimodal interaction with animated virtual human. in: Banissi, E., Burkhard, R.A., Ursyn, A., Zhang, J.J., Bannatyne, M., Maple, C., Cowell, A.J., Tian, G.Y. and Hou, M. (ed.) Proceedings of the Information Visualization (IV'06) Los Alamitos, USA IEEE . pp. 557-562

Chapter titleReal time multimodal interaction with animated virtual human
AuthorsJin, L. and Wen, Z.
EditorsBanissi, E., Burkhard, R.A., Ursyn, A., Zhang, J.J., Bannatyne, M., Maple, C., Cowell, A.J., Tian, G.Y. and Hou, M.
Abstract

This paper describes the design and implementation of a real time animation framework in which animated virtual human is capable of performing multimodal interactions with human user. The animation system consists of several functional components, namely perception, behaviours generation, and motion generation. The virtual human agent in the system has a complex underlying geometry structure with multiple degrees of freedom (DOFs). It relies on a virtual perception system to capture information from its environment and respond to human user's commands by a combination of non-verbal behaviours including co-verbal gestures, posture, body motions and simple utterances. A language processing module is incorporated to interpret user's command. In particular, an efficient motion generation method has been developed to combines both motion captured data and parameterized actions generated in real time to produce variations in agent's behaviours depending on its momentary emotional states.

Book titleProceedings of the Information Visualization (IV'06)
Page range557-562
Year2006
PublisherIEEE
Publication dates
Published2006
Place of publicationLos Alamitos, USA
ISBN0769526020
Digital Object Identifier (DOI)https://doi.org/10.1109/IV.2006.88
File

Related outputs

Visualising weekly learning outcomes (VWLO) and the intention to continue using a learning management system (CIU): the role of cognitive absorption and perceived learning self-regulation
Al-shaikhli, Dhuha, Jin, Li, Porter, Alan and Tarczynski, Andrzej 2022. Visualising weekly learning outcomes (VWLO) and the intention to continue using a learning management system (CIU): the role of cognitive absorption and perceived learning self-regulation. Education and Information Technologies. 27. https://doi.org/10.1007/s10639-021-10703-z

The Impact of Cultural Familiarity on Students’ Social Media Usage in Higher Education
Tarczynski, A., Al-shaikhli, D., Jin, L., Porter, A., Ibragimov, D. and Shpirko, M. 2019. The Impact of Cultural Familiarity on Students’ Social Media Usage in Higher Education. 18th European Conference on e-Learning ECEL 2019. Aalborg University Copenhagen, Denmark 07 - 08 Nov 2019 Academic Conferences and Publishing International Limited.

Fostering Creativity via Technoself Enhanced Learning with Emerging Technologies
Jin, L. and Forrest, K. 2019. Fostering Creativity via Technoself Enhanced Learning with Emerging Technologies. 11th annual International Conference on Education and New Learning Technologies. Palma de Mallorca, Spain 01 - 03 Jul 2019 IATED Academy. https://doi.org/doi:10.21125/edulearn.2019

Using Agent Solutions and Visualization Techniques to Manage Cloud-based Education System
Huang, W., Jin, L. and Sandia,I 2016. Using Agent Solutions and Visualization Techniques to Manage Cloud-based Education System. International Conference on Engineering, Technology and Applied Science (ICETA2016). Tai Pei, Tai Wan 20 - 22 Apr 2016 International Business Academic Consortium.

AR-based Technoself Enhanced Learning Approach to Improving Student Engagement
Jin, L., Huang, W. and Wen, Z. 2016. AR-based Technoself Enhanced Learning Approach to Improving Student Engagement. 8th Annual International Conference on Education and New Learning Technologies. Barcelona, Spain 04 - 06 Jul 2016 IATED Academy. https://doi.org/10.21125/edulearn.2016.1443

Developing a Technoself System to Improve Lifelong Learning Engagement
Jin, L., Huang, W. and Wen, Z. 2015. Developing a Technoself System to Improve Lifelong Learning Engagement. IEEE International Conference on Teaching, Assessment, and Learning for Engineering (IEEE TALE). Zhuhai, China 10 Dec 2015 IEEE . https://doi.org/10.1109/TALE.2015.7386024

Technoself Enhanced Blended Learning via Social Interaction
Jin, L., Porter, A. and Saunders, G. 2013. Technoself Enhanced Blended Learning via Social Interaction. The Second International Conference on E-Learning and E-Technologies in Education (ICEEE2013), 23-25 Sept, pp. 74-80, 2013. . Lodz, Poland 23 Sep 2013 IEEE . https://doi.org/10.1109/ICeLeTE.2013.6644351

A new trend in education
Jin, L. 2012. A new trend in education. in: Luppicini, R. (ed.) Handbook of research of technoself: identity in a technological society IGI Global. pp. 456-473

Social virtual worlds for technology enhanced learning on an augmented learning platform
Jin, L., Wen, Z. and Gough, N. 2010. Social virtual worlds for technology enhanced learning on an augmented learning platform. Learning, Media and Technology. 35 (2), pp. 139-153. https://doi.org/10.1080/17439884.2010.494424

An integrated VLE to enhance social interaction for user-centred active learning
Jin, L. and Wen, Z. 2010. An integrated VLE to enhance social interaction for user-centred active learning. in: Future computing 2010: the second international conference on future computational technologies and applications IARIA. pp. 35-40

An augmented social interactive learning approach through web2.0
Jin, L. and Wen, Z. 2009. An augmented social interactive learning approach through web2.0. in: 33rd Annual IEEE International Computer Software and Applications Conference, 2009 Institute of Electrical and Electronics Engineers. pp. 607-611

Trends on interactive platforms for social media through Web2.0
Jin, L., Psarrou, A., Cao, S. and Chen, Y. 2009. Trends on interactive platforms for social media through Web2.0. in: International Conference on Management and Service Science. MASS '09. 20-22 Sept. 2009 IEEE .

A cost-effective approach to cultural heritage representation using game engines
Jin, L. and Wen, Z. 2008. A cost-effective approach to cultural heritage representation using game engines. in: New Media Art Conference 2008, 7-9th Nov 2008, Shanghai, China Tongji University Press. pp. 121-132

Distributed VR for collaborative design and manufacturing
Jin, L., Wen, Z. and Oraifige, I.A. 2007. Distributed VR for collaborative design and manufacturing. in: Banissi, E., Burkhard, R.A., Grinstein, G., Cvek, U., Trutschl, M., Stuart, L., Wyeld, T.G., Andrienko, G., Dykes, J., Jern, M., Groth, D. and Ursyn, A. (ed.) Proceedings of the 11th International Conference on Information Visualisation: IV '07 Los Alamitos, USA IEEE . pp. 792-797

Extending the gaia methodology for the design and development of agent-based software systems
Huang, W., El-Darzi, E. and Jin, L. 2007. Extending the gaia methodology for the design and development of agent-based software systems. in: Proceedings of the 31st Annual IEEE International Computer Software and Applications Conference (COMPSAC 2007), Peking (Beijing), China, July 23-27 2007 Los Alamitos, USA IEEE .

Multimodal interaction with animated game characters
Jin, L. and Wen, Z. 2006. Multimodal interaction with animated game characters. in: Santorineos, M. (ed.) Gaming realities: a challenge for digital culture Athens, Greece FOURNOS Centre for the Digital Culture. pp. 139-143

Virtual learning environment toolkit in VICTEC, EC Framework-V VICTEC technical report
Jin, L. and Aylett, R. 2002. Virtual learning environment toolkit in VICTEC, EC Framework-V VICTEC technical report. CORDIS. https://doi.org/D3.3.1

High-level functional architecture for the virtual learning environment, EC Framework-V VICTEC technical report
Jin, L. and Aylett, R. 2002. High-level functional architecture for the virtual learning environment, EC Framework-V VICTEC technical report. CORDIS. https://doi.org/D3.2.1

The web-based interactive virtual tour of heritage: temple of heaven
Jin, L. 2002. The web-based interactive virtual tour of heritage: temple of heaven. in: Dredge, S. (ed.) Web 3D London, UK Laurence King. pp. 70-76

Virtual heritages and architecture in virtual environments
Jin, L. 2002. Virtual heritages and architecture in virtual environments. International Workshop on Virtual Heritage. Chongqing, China 14-16 Dec 2002

E-manufacturing in networked virtual environments
Jin, L., Oraifige, I.A., Lister, P.M. and Hall, F.R. 2001. E-manufacturing in networked virtual environments. in: 2001 IEEE International Conference on Systems, Man & Cybernetics: October 7-10, 2001, Tucson Convention Center, Tucson, Arizona, USA USA IEEE .

Distributed VR-based simulation for manufacturing
Jin, L., Oraifige, I.A., Hall, F.R. and Lister, P.M. 2001. Distributed VR-based simulation for manufacturing. in: Giambiasi, N. and Frydman, C. (ed.) Simulation in industry 2001: 13th European simulation symposium Ghent, Belgium SCS-Europe. pp. 289-293

Adorning VRML worlds with environmental aspects
Jin, L. and Wen, Z. 2001. Adorning VRML worlds with environmental aspects. IEEE Computer Graphics and Applications. 21 (1), pp. 6-9. https://doi.org/10.1109/MCG.2001.895123

Permalink - https://westminsterresearch.westminster.ac.uk/item/925y4/real-time-multimodal-interaction-with-animated-virtual-human


Share this

Usage statistics

107 total views
163 total downloads
These values cover views and downloads from WestminsterResearch and are for the period from September 2nd 2018, when this repository was created.