Human Computer Interaction using gestures for mobile devices and serious games: A review

Spanogianopoulos, S., Mentzelopoulos, M., Sirlantzis, K. and Protopsaltis, A. 2014. Human Computer Interaction using gestures for mobile devices and serious games: A review. International Conference on Interactive Mobile Communication Technologies and Learning (IMCL). Thessaloniki 13 Nov 2014 IEEE . https://doi.org/10.1109/IMCTL.2014.7011154

TitleHuman Computer Interaction using gestures for mobile devices and serious games: A review
AuthorsSpanogianopoulos, S., Mentzelopoulos, M., Sirlantzis, K. and Protopsaltis, A.
TypeConference paper
Abstract

The Human-Computer Interaction (HCI) with interfaces is an active challenge field in the industry over the past decades and has opened the way to communicate with the means of verbal, hand and body gestures using the latest technologies for a variety of different applications in areas such as video games, training and simulation. However, accurate recognition of gestures is still a challenge. In this paper, we review the basic principles and current methodologies used for collecting the raw gesture data from the user for recognize actions the users perform and the technologies currently used for gesture-HCI in games enterprise. In addition, we present a set of projects from various applications in games industry that are using gestural interaction.

KeywordsGesture Recognition
Human Computer Interaction
Mobile Computing
Year2014
ConferenceInternational Conference on Interactive Mobile Communication Technologies and Learning (IMCL)
PublisherIEEE
Publication dates
PublishedNov 2014
Journal citationpp. 310-314
Book title2014 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL)
ISBN978-1-4799-4742-3
Digital Object Identifier (DOI)https://doi.org/10.1109/IMCTL.2014.7011154
Web address (URL) of conference proceedingshttp://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=6999021

Related outputs

CrimOPS: Exploring students’ experiences in using virtual simulation for authentic learning and assessment in criminal psychology
Gerard, F.J., Ammerer, K., Mentzelopoulos, M. and Economou, D. 2024. CrimOPS: Exploring students’ experiences in using virtual simulation for authentic learning and assessment in criminal psychology. Journal of Criminal Justice Education. Advanced online publication. https://doi.org/10.1080/10511253.2024.2324179

Work-in-progress-Gamifying the process of Learning Sign Language in VR
Economou, Daphne, Mentzelopoulos, Markos, Ingram, Jack, Martinez-Mukimov, Timur, Primkulova, Shirin and Abduvaliev, Said 2022. Work-in-progress-Gamifying the process of Learning Sign Language in VR. IEEE . https://doi.org/10.23919/ilrn55037.2022.9815988

Work-In-Progress—CrimOPS-Gamified Virtual Simulations for Authentic Assessment in Criminology
Gerard, F. Jeane, Mentzelopoulos, Markos, Economou, Daphne, Khalish, Zeeshan, Ingram, Jack and Ashley, Edwards 2022. Work-In-Progress—CrimOPS-Gamified Virtual Simulations for Authentic Assessment in Criminology. 8th International Conference of the Immersive Learning Research Network (iLRN 2022)). Vienna, Austria 30 May - 04 Jun 2022 IEEE . https://doi.org/10.23919/ilrn55037.2022.9815942

Using Serious Games for Learning British Sign Language Combining Video, Enhanced Interactivity, and VR Technology
Ferguson, J., Gonzalez Russi, M., Doumanis, I., Mentzelopoulos, M., Bouki, V. and Ferguson, J. 2020. Using Serious Games for Learning British Sign Language Combining Video, Enhanced Interactivity, and VR Technology. Journal of Universal Computer Science. 26 (8), pp. 996-1016.

Using serious games for learning sign language combining video, enhanced interactivity and VR technology
Economou, D., Doumanis, I., Bouki, V. and Mentzelopoulos, M. 2020. Using serious games for learning sign language combining video, enhanced interactivity and VR technology. Special Issue of Journal of Universal Computer Science (J.UCS) on Exploring Immersive Technologies in Learning. 26 (8), pp. 996-1016.

Adult Learning Sign Language by combining video, interactivity and play in a 3D game platform
Economou, D., Gonzalez Russi, M., Doumanis, I., Bouki, V., Mentzelopoulos, M. and Ferguson, J. 2019. Adult Learning Sign Language by combining video, interactivity and play in a 3D game platform. Beck, D., Peña-Rios, A., Ogle, T., Economou, D., Mentzelopoulos, M., Eckhardt, C., Morgado, L., Pirker, J., Koitz-Hristov, R., Richter, J., Gütl, C. and Gardner, M. (ed.) 5th International Conference of Immersive Learning Research Network. London 23 - 27 Jun 2019 Graz University Press. https://doi.org/10.3217/978-3-85125-657-4

Immersive Learning Research Network, 5th International Conference, iLRN 2019, London, UK, June 23–27, 2019, Proceedings
Beck, D., Peña-Rios, A., Ogle, Economou, D., Mentzelopoulos, M., Morgado, L., Eckhardt, C., Pirker, J., Koitz-Hristov, R., Richter, J., Gütl, C. and Gardner, M. Beck, D., Peña-Rios, A., Ogle, T., Economou, D., Mentzelopoulos, M., Morgado, L., Eckhardt, C., Pirker, J., Koitz-Hristov, R., Richter, J., Gütl, C. and Gardner, M. (ed.) 2019. Immersive Learning Research Network, 5th International Conference, iLRN 2019, London, UK, June 23–27, 2019, Proceedings. Switzerland Springer.

REVRLaw: Virtual Reality in Legal Education
Kathrani, P. and Mentzelopoulos, M. 2017. REVRLaw: Virtual Reality in Legal Education.

Transforming the teaching experience
Mentzelopoulos, M. 2017. Transforming the teaching experience. Westminster Higher Education Forum UK Headquarters, 4 Bracknell Beeches, Old Bracknell Lane, West Bracknell, Berkshire. RG12 7BW 18 Oct 2017

Virtual Environments and Advanced Interfaces
Economou, D., Mentzelopoulos, M., Georgalas, N., Carretero, J. and Garcia-Blas, J. 2017. Virtual Environments and Advanced Interfaces. Personal and Ubiquitous Computing. 6 (21), pp. 963-964. https://doi.org/10.1007/s00779-017-1076-3

Learning Languages and Complex Subjects with Memory Palaces
Ralby, A., Mentzelopoulos, M. and Cook, H. 2017. Learning Languages and Complex Subjects with Memory Palaces. in: Immersive Learning Research Network. iLRN 2017. Communications in Computer and Information Science, vol 725 Springer. pp. 217-228

An Evaluation of the Efficacy of a Perceptually Controlled Immersive Environment for Learning Acupuncture
Ferguson, J., Mentzelopoulos, M. and Psarrou, A. 2016. An Evaluation of the Efficacy of a Perceptually Controlled Immersive Environment for Learning Acupuncture . IUCC 2016 - 15th International Conference on Ubiquitous Computing and Communications - Virtual Environments and Advanced Interfaces Workshop. Granada, Spain 14 - 16 Dec 2016 IEEE . https://doi.org/10.1109/IUCC-CSS.2016.29

Quiz Cube:an AR mobile learning application
Protopsaltis, A., Ferguson, J., Mentzelopoulos, M. and Kaloyan,K 2016. Quiz Cube:an AR mobile learning application. 11th International Workshop on Semantic and Social Media Adaptation and Personalization. Thessaloniki, Greece 20 - 21 Oct 2016 IEEE . https://doi.org/10.1109/SMAP.2016.7753401

Performance Evaluation of a Statistical and a Neural Network Model for Nonrigid Shape-Based Registration
Angelopoulou, A., Psarrou, A., Garcia-Rodriguez, J. and Mentzelopoulos, M. 2016. Performance Evaluation of a Statistical and a Neural Network Model for Nonrigid Shape-Based Registration. Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA'16). Finland 12 - 15 Dec 2016 IEEE . https://doi.org/10.1109/IPTA.2016.7820990

Virtual reality helps students to master criminal law
Mentzelopoulos, M. and Kathrani, P. 2016. Virtual reality helps students to master criminal law. THE TIMES.

Immersive Learning Research Network
Mentzelopoulos, M., Parrish, J, Kathrani, P. and Economou, D. 2016. Immersive Learning Research Network. in: Allison, C, Morgado, L, Pirker, J., Beck, D, Richter, J and Gutl, C. (ed.) Immersive Learning Research Network: Volume 621 of the series Communications in Computer and Information Science Santa Barbara, CA, USA, June 27 – July 1, 2016 Springer. pp. 73-84

Westminster Serious Games Platform (wmin-SGP) a tool for real-time authoring of roleplay simulations for learning
Economou, D., Doumanis, I., Pedersen, F.S., Kathrani, P., Mentzelopoulos, M., Bouki, V. and Georgalas, N. 2016. Westminster Serious Games Platform (wmin-SGP) a tool for real-time authoring of roleplay simulations for learning. EAI Endorsed Transactions on Future Intelligent Educational Environments. 16 (6), p. e5 e5. https://doi.org/10.4108/eai.27-6-2016.151524

Perceptual user interface framework for immersive information retrieval environments (An experimental framework for testing and rapid iteration)
Mentzelopoulos, M., Ferguson, J. and Protopsaltis, A. 2016. Perceptual user interface framework for immersive information retrieval environments (An experimental framework for testing and rapid iteration). International Journal of Interactive Mobile Technologies (iJIM). 10 (2), pp. 64-71. https://doi.org/10.3991/ijim.v10i2.5643

Perceptually captured gesture interaction with immersive information retrieval environments: An experimental framework for testing and rapid iteration
Mentzelopoulos, M., Ferguson, J. and Protopsaltis, A. 2015. Perceptually captured gesture interaction with immersive information retrieval environments: An experimental framework for testing and rapid iteration. 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL). Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359608

Small and flexible web based framework for teaching QR and AR mobile learning application development
Ferguson, J., Mentzelopoulos, M., Protopsaltis, A. and Economou, D. 2015. Small and flexible web based framework for teaching QR and AR mobile learning application development. IMCL 2015 International Conference on Interactive Mobile Communication Technologies and Learning. Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359624

Treasure hunt pervasive games in cultural organisations
Economou, D., Bouki, V., Kounenis, T., Mentzelopoulos, M. and Georgalas, N. 2015. Treasure hunt pervasive games in cultural organisations. IMCL 2015 International Conference on Interactive Mobile Communication Technologies and Learning. Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359621

Edu-simulation: a serious games platform designed to engage and motivate students
Economou, D., Doumanis, I., Bouki, V., Pedersen, F.S., Kathrani, P., Mentzelopoulos, M. and Georgalas, N. 2015. Edu-simulation: a serious games platform designed to engage and motivate students. IMCL 2015 International Conference on Interactive Mobile Communication Technologies and Learning. Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359596

Hardware Interfaces for VR Applications: Evaluation on Prototypes
Mentzelopoulos, M., Tarpini, F., Emanuele, A. and Protopsaltis, A. 2015. Hardware Interfaces for VR Applications: Evaluation on Prototypes. The 14th IEEE International Conference on Ubiquitous Computing and Communications - IUCC-2-15 (Special session: VEAI). Liverpool - UK 26 Oct 2015 IEEE .

EdCCDroid: An Education Pilot Prototype for Introducing Code-Combat using LUA
Wood, C., Mentzelopoulos, M. and Protopsaltis, A. 2015. EdCCDroid: An Education Pilot Prototype for Introducing Code-Combat using LUA . 1st Immersive Learning Research Network Conference (iLRN'15). Prague - Czech Republic Jul 2015 IOS Press. https://doi.org/10.3233/978-1-61499-530-2-353

A dynamic role-playing platform for simulations in legal and political education
Economou, D., Doumanis, I., Bouki, V., Pedersen, F.S., Kathrani, P., Mentzelopoulos, M. and Georgalas, N. 2014. A dynamic role-playing platform for simulations in legal and political education. International Conference on Interactive Mobile Communication Technologies and Learning (IMCL). Thessaloniki 13 Nov 2014 IEEE . https://doi.org/10.1109/IMCTL.2014.7011138

3D hand pose estimation with neural networks
Serra, J.A., Garcia-Rodriguez, J., Orts Escolano, S., Garcia-Chamizo, J.M., Angelopoulou, A., Psarrou, A., Mentzelopoulos, M., Montoyo-Bojo, J. and Domínguez, E. 2013. 3D hand pose estimation with neural networks. in: Advances in Computational Intelligence: 12th International Work-Conference on Artificial Neural Networks, IWANN 2013 Springer.

Football video annotation based on player motion recognition using enhanced entropy
Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. and Garcia-Rodriguez, J. 2013. Football video annotation based on player motion recognition using enhanced entropy. in: Advances in Computational Intelligence: 12th International Work-Conference on Artificial Neural Networks, IWANN 2013 Springer.

Natural User Interfaces in Volume Visualisation using Microsoft Kinect
Angelopoulou, A., Garcia-Rodriguez, J., Psarrou, A., Mentzelopoulos, M., Reddy, B., Orts Escolano, S., Serra, J.A. and Lewis, A. 2013. Natural User Interfaces in Volume Visualisation using Microsoft Kinect. ICIAP 2013 International Workshops. Naples, Italy 09 Sep 2013 Springer. https://doi.org/10.1007/978-3-642-41190-8_2

Adaptive learning in motion analysis with self-organising maps
Angelopoulou, A., Garcia-Rodriguez, J., Psarrou, A., Gupta, G. and Mentzelopoulos, M. 2013. Adaptive learning in motion analysis with self-organising maps. International Joint Conference on Neural Networks (IJCNN). Dallas, TX 04 Aug 2013 IEEE . https://doi.org/10.1109/IJCNN.2013.6707135

A semi-parametric approach for football video annotation
Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. and Garcia-Rodriguez, J. 2013. A semi-parametric approach for football video annotation. International Joint Conference on Neural Networks (IJCNN). Dallas, TX 04 Aug 2013 IEEE . https://doi.org/10.1109/IJCNN.2013.6706720

3D gesture recognition with growing neural gas
Sera-Perez, J.A., Garcia Rodriguez, J., Orts-Escolano, S., García-Chamizo, J.M., Montoyo-Bojo, J., Angelopoulou, A., Psarrou, A., Mentzelopoulos, M., Lewis, A. and Orts Escolano, S. 2013. 3D gesture recognition with growing neural gas. in: Proceedings of the International Joint Conference in Neural Networks, IJCNN 2013, 2-9 August 2013, Dallas, USA IEEE . pp. 3034-3041

Active foreground region extraction and tracking for sports video annotation
Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. and Garcia-Rodriguez, J. 2013. Active foreground region extraction and tracking for sports video annotation. Neural Processing Letters. 37 (1), pp. 33-46. https://doi.org/10.1007/s11063-012-9267-4

Explosive ordinance disposal: motion sensor simulator in Nintendo Wii
Mentzelopoulos, M., Tanasa, M., Protopsaltis, A. and Economou, D. 2011. Explosive ordinance disposal: motion sensor simulator in Nintendo Wii. in: SIGDOC'11: proceedings of the 29th ACM international conference on design of communication: October 3 - 5, 2011, Pisa, Italy ACM. pp. 227-234

Simulation game for training new teachers in class management
Bouki, V., Mentzelopoulos, M. and Protopsaltis, A. 2011. Simulation game for training new teachers in class management. in: SIGDOC'11: proceedings of the 29th ACM international conference on design of communication: October 3 - 5, 2011, Pisa, Italy ACM. pp. 79-82

Gender patterns in hypertext reading
Protopsaltis, A. and Bouki, V. 2008. Gender patterns in hypertext reading. in: Workshop on Cognition and the Web: Information Processing, Comprehension and Learning, April 24-26, Granada, Spain WebCog. pp. 213-217

Gender and information processing in electronic age
Protopsaltis, A. and Bouki, V. 2008. Gender and information processing in electronic age. in: ACM Special Interest Group for Design of Communication: proceedings of the 26th annual ACM international conference on design of communication New York ACM. pp. 131-138

Does gender matter in hypertext reading?
Protopsaltis, A. and Bouki, V. 2008. Does gender matter in hypertext reading? in: Luca, J. and Weippl, E.R. (ed.) ED-MEDIA 2008 : Proceedings of World Conference on Educational Multimedia, Hypermedia & Telecommunications, Vienna, Austria Chesapeake, VA AACE. pp. 1120-1129

The effects of reading goals in hypertext reading
Protopsaltis, A. and Bouki, V. 2006. The effects of reading goals in hypertext reading. in: Pierce, R. and Stamey, J. (ed.) Proceedings of the 24th annual conference on Design of communication New York, USA ACM. pp. 29-34

Reading strategies in hypertexts and factors influencing link selection
Protopsaltis, A. and Bouki, V. 2006. Reading strategies in hypertexts and factors influencing link selection. in: Pearson, E. and Bohman, P. (ed.) Proceedings of ED-MEDIA 2006: world conference on educational multimedia, hypermedia & telecommunications AACE. pp. 450-457

Reading in Web-based hypertexts: cognitive processes strategies and reading goals
Protopsaltis, A. 2006. Reading in Web-based hypertexts: cognitive processes strategies and reading goals. PhD thesis University of Westminster School of Electronics and Computer Science https://doi.org/10.34737/92701

Towards a hypertext reading/comprehension model
Protopsaltis, A. and Bouki, V. 2005. Towards a hypertext reading/comprehension model. in: Tilley, S. and Newman, R.M. (ed.) Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information ACM. pp. 159-166

Key-frame extraction algorithm using entropy difference
Mentzelopoulos, M. and Psarrou, A. 2004. Key-frame extraction algorithm using entropy difference. in: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval New York, USA ACM. pp. 39-45

Cognitive aspects of web-based hypertext: an experimental approach
Bouki, V. and Protopsaltis, A. 2004. Cognitive aspects of web-based hypertext: an experimental approach. in: Proceedings of WSEAS International Conference on E-ACTIVITIES, Crete, Oct. 2004 WSEAS.

Cognitive aspects of web-based hypertext: an experimental approach
Bouki, V. and Protopsaltis, A. 2004. Cognitive aspects of web-based hypertext: an experimental approach. WSEAS Transactions on Information Science and Applications. 1 (5), pp. 1268-1276.

Permalink - https://westminsterresearch.westminster.ac.uk/item/973zw/human-computer-interaction-using-gestures-for-mobile-devices-and-serious-games-a-review


Share this

Usage statistics

100 total views
0 total downloads
These values cover views and downloads from WestminsterResearch and are for the period from September 2nd 2018, when this repository was created.