Perceptual user interface framework for immersive information retrieval environments (An experimental framework for testing and rapid iteration)

Mentzelopoulos, M., Ferguson, J. and Protopsaltis, A. 2016. Perceptual user interface framework for immersive information retrieval environments (An experimental framework for testing and rapid iteration). International Journal of Interactive Mobile Technologies (iJIM). 10 (2), pp. 64-71. https://doi.org/10.3991/ijim.v10i2.5643

TitlePerceptual user interface framework for immersive information retrieval environments (An experimental framework for testing and rapid iteration)
TypeJournal article
AuthorsMentzelopoulos, M., Ferguson, J. and Protopsaltis, A.
Abstract

The use of perceptual inputs is an emerging area within HCI that suggests a developing Perceptual User Interface (PUI) that may prove advantageous for those involved in mobile serious games and immersive social network environments. Since there are a large variety of input devices, software platforms, possible interactions, and myriad ways to combine all of the above elements in pursuit of a PUI, we propose in this paper a basic experimental framework that will be able to standardize study of the wide range of interactive applications for testing efficacy in learning or information retrieval and also suggest improvements to emerging PUIs by enabling quick iteration. This rapid iteration will start to define a targeted range of interactions that will be intuitive and comfortable as perceptual inputs, and enhance learning and information retention in comparison to traditional GUI systems. The work focuses on the planning of the technical development of two scenarios, and the first steps in developing a framework to evaluate these and other PUIs for efficacy and pedagogy.

Keywordsperceptual, Perceptual User Interface (PUI), Human Computer Interaction (HCI), serious games, Graphical User Interface (GUI)
JournalInternational Journal of Interactive Mobile Technologies (iJIM)
Journal citation10 (2), pp. 64-71
ISSN1865-7923
Year2016
PublisherInternational Association of Online Engineering
Accepted author manuscript
File Access Level
Open (open metadata and files)
Digital Object Identifier (DOI)https://doi.org/10.3991/ijim.v10i2.5643
Web address (URL)http://online-journals.org/index.php/i-jim/article/view/5643
Publication dates
Published28 Apr 2016

Related outputs

CrimOPS: Exploring students’ experiences in using virtual simulation for authentic learning and assessment in criminal psychology
Gerard, F.J., Ammerer, K., Mentzelopoulos, M. and Economou, D. 2024. CrimOPS: Exploring students’ experiences in using virtual simulation for authentic learning and assessment in criminal psychology. Journal of Criminal Justice Education. Advanced online publication. https://doi.org/10.1080/10511253.2024.2324179

Work-in-progress-Gamifying the process of Learning Sign Language in VR
Economou, Daphne, Mentzelopoulos, Markos, Ingram, Jack, Martinez-Mukimov, Timur, Primkulova, Shirin and Abduvaliev, Said 2022. Work-in-progress-Gamifying the process of Learning Sign Language in VR. IEEE . https://doi.org/10.23919/ilrn55037.2022.9815988

Doctoral Colloquium—Artmaking: From a Hands-On Process to a VR Translation
Keleri, Maritina, Economou, Daphne and Ferguson, Jeffrey 2022. Doctoral Colloquium—Artmaking: From a Hands-On Process to a VR Translation. IEEE . https://doi.org/10.23919/ilrn55037.2022.9815907

Work-In-Progress—CrimOPS-Gamified Virtual Simulations for Authentic Assessment in Criminology
Gerard, F. Jeane, Mentzelopoulos, Markos, Economou, Daphne, Khalish, Zeeshan, Ingram, Jack and Ashley, Edwards 2022. Work-In-Progress—CrimOPS-Gamified Virtual Simulations for Authentic Assessment in Criminology. 8th International Conference of the Immersive Learning Research Network (iLRN 2022)). Vienna, Austria 30 May - 04 Jun 2022 IEEE . https://doi.org/10.23919/ilrn55037.2022.9815942

Work-In-Progress Paper: 360-degree immersive storytelling video to create empathetic response
Hollick, M., Acheampong, C., Ahmed, M., Economou, D. and Ferguson, J. 2021. Work-In-Progress Paper: 360-degree immersive storytelling video to create empathetic response. 7th International Conference of the Immersive Learning Research Network (iLRN 2021). IEEE . https://doi.org/10.23919/iLRN52045.2021.9459340

Work-In-Progress Paper: WebXR to support student wellbeing and anxiety
Hossain, M., Economou, D. and Ferguson, J. 2021. Work-In-Progress Paper: WebXR to support student wellbeing and anxiety. 7th International Conference of the Immersive Learning Research Network (iLRN 2021). IEEE . https://doi.org/10.23919/iLRN52045.2021.9459324

Using Serious Games for Learning British Sign Language Combining Video, Enhanced Interactivity, and VR Technology
Ferguson, J., Gonzalez Russi, M., Doumanis, I., Mentzelopoulos, M., Bouki, V. and Ferguson, J. 2020. Using Serious Games for Learning British Sign Language Combining Video, Enhanced Interactivity, and VR Technology. Journal of Universal Computer Science. 26 (8), pp. 996-1016.

Using serious games for learning sign language combining video, enhanced interactivity and VR technology
Economou, D., Doumanis, I., Bouki, V. and Mentzelopoulos, M. 2020. Using serious games for learning sign language combining video, enhanced interactivity and VR technology. Special Issue of Journal of Universal Computer Science (J.UCS) on Exploring Immersive Technologies in Learning. 26 (8), pp. 996-1016.

Adult Learning Sign Language by combining video, interactivity and play in a 3D game platform
Economou, D., Gonzalez Russi, M., Doumanis, I., Bouki, V., Mentzelopoulos, M. and Ferguson, J. 2019. Adult Learning Sign Language by combining video, interactivity and play in a 3D game platform. Beck, D., Peña-Rios, A., Ogle, T., Economou, D., Mentzelopoulos, M., Eckhardt, C., Morgado, L., Pirker, J., Koitz-Hristov, R., Richter, J., Gütl, C. and Gardner, M. (ed.) 5th International Conference of Immersive Learning Research Network. London 23 - 27 Jun 2019 Graz University Press. https://doi.org/10.3217/978-3-85125-657-4

Immersive Learning Research Network, 5th International Conference, iLRN 2019, London, UK, June 23–27, 2019, Proceedings
Beck, D., Peña-Rios, A., Ogle, Economou, D., Mentzelopoulos, M., Morgado, L., Eckhardt, C., Pirker, J., Koitz-Hristov, R., Richter, J., Gütl, C. and Gardner, M. Beck, D., Peña-Rios, A., Ogle, T., Economou, D., Mentzelopoulos, M., Morgado, L., Eckhardt, C., Pirker, J., Koitz-Hristov, R., Richter, J., Gütl, C. and Gardner, M. (ed.) 2019. Immersive Learning Research Network, 5th International Conference, iLRN 2019, London, UK, June 23–27, 2019, Proceedings. Switzerland Springer.

REVRLaw: Virtual Reality in Legal Education
Kathrani, P. and Mentzelopoulos, M. 2017. REVRLaw: Virtual Reality in Legal Education.

Transforming the teaching experience
Mentzelopoulos, M. 2017. Transforming the teaching experience. Westminster Higher Education Forum UK Headquarters, 4 Bracknell Beeches, Old Bracknell Lane, West Bracknell, Berkshire. RG12 7BW 18 Oct 2017

Virtual Environments and Advanced Interfaces
Economou, D., Mentzelopoulos, M., Georgalas, N., Carretero, J. and Garcia-Blas, J. 2017. Virtual Environments and Advanced Interfaces. Personal and Ubiquitous Computing. 6 (21), pp. 963-964. https://doi.org/10.1007/s00779-017-1076-3

Drinking Games: Simulating Alcoholic Behavior Patterns in the ”Pubcrawler” Video Game
Ferguson, J. and Tolentino, C. 2017. Drinking Games: Simulating Alcoholic Behavior Patterns in the ”Pubcrawler” Video Game. Beck, D., Allison, C., Morgado, L., Pirker, J., Khosmood, F., Richter, J. and Gutl, C. (ed.) Immersive Learning Research Network - iLRN2017. Coimbra, Portugal 25 - 29 Jun 2017 Verlag der Technischen Universität Graz. https://doi.org/10.3217/978-3-85125-530-0-45

Learning Languages and Complex Subjects with Memory Palaces
Ralby, A., Mentzelopoulos, M. and Cook, H. 2017. Learning Languages and Complex Subjects with Memory Palaces. in: Immersive Learning Research Network. iLRN 2017. Communications in Computer and Information Science, vol 725 Springer. pp. 217-228

An Evaluation of the Efficacy of a Perceptually Controlled Immersive Environment for Learning Acupuncture
Ferguson, J., Mentzelopoulos, M. and Psarrou, A. 2016. An Evaluation of the Efficacy of a Perceptually Controlled Immersive Environment for Learning Acupuncture . IUCC 2016 - 15th International Conference on Ubiquitous Computing and Communications - Virtual Environments and Advanced Interfaces Workshop. Granada, Spain 14 - 16 Dec 2016 IEEE . https://doi.org/10.1109/IUCC-CSS.2016.29

Quiz Cube:an AR mobile learning application
Protopsaltis, A., Ferguson, J., Mentzelopoulos, M. and Kaloyan,K 2016. Quiz Cube:an AR mobile learning application. 11th International Workshop on Semantic and Social Media Adaptation and Personalization. Thessaloniki, Greece 20 - 21 Oct 2016 IEEE . https://doi.org/10.1109/SMAP.2016.7753401

Performance Evaluation of a Statistical and a Neural Network Model for Nonrigid Shape-Based Registration
Angelopoulou, A., Psarrou, A., Garcia-Rodriguez, J. and Mentzelopoulos, M. 2016. Performance Evaluation of a Statistical and a Neural Network Model for Nonrigid Shape-Based Registration. Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA'16). Finland 12 - 15 Dec 2016 IEEE . https://doi.org/10.1109/IPTA.2016.7820990

Virtual reality helps students to master criminal law
Mentzelopoulos, M. and Kathrani, P. 2016. Virtual reality helps students to master criminal law. THE TIMES.

Immersive Learning Research Network
Mentzelopoulos, M., Parrish, J, Kathrani, P. and Economou, D. 2016. Immersive Learning Research Network. in: Allison, C, Morgado, L, Pirker, J., Beck, D, Richter, J and Gutl, C. (ed.) Immersive Learning Research Network: Volume 621 of the series Communications in Computer and Information Science Santa Barbara, CA, USA, June 27 – July 1, 2016 Springer. pp. 73-84

Westminster Serious Games Platform (wmin-SGP) a tool for real-time authoring of roleplay simulations for learning
Economou, D., Doumanis, I., Pedersen, F.S., Kathrani, P., Mentzelopoulos, M., Bouki, V. and Georgalas, N. 2016. Westminster Serious Games Platform (wmin-SGP) a tool for real-time authoring of roleplay simulations for learning. EAI Endorsed Transactions on Future Intelligent Educational Environments. 16 (6), p. e5 e5. https://doi.org/10.4108/eai.27-6-2016.151524

Perceptually captured gesture interaction with immersive information retrieval environments: An experimental framework for testing and rapid iteration
Mentzelopoulos, M., Ferguson, J. and Protopsaltis, A. 2015. Perceptually captured gesture interaction with immersive information retrieval environments: An experimental framework for testing and rapid iteration. 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL). Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359608

Lessons from digital puppetry - Updating a design framework for a perceptual user interface
Ferguson, J. 2015. Lessons from digital puppetry - Updating a design framework for a perceptual user interface. 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing - The International Workshop on Virtual Environments and Advanced Interfaces. Liverpool, UK 28 Oct 2015 IEEE . https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.239

Small and flexible web based framework for teaching QR and AR mobile learning application development
Ferguson, J., Mentzelopoulos, M., Protopsaltis, A. and Economou, D. 2015. Small and flexible web based framework for teaching QR and AR mobile learning application development. IMCL 2015 International Conference on Interactive Mobile Communication Technologies and Learning. Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359624

Treasure hunt pervasive games in cultural organisations
Economou, D., Bouki, V., Kounenis, T., Mentzelopoulos, M. and Georgalas, N. 2015. Treasure hunt pervasive games in cultural organisations. IMCL 2015 International Conference on Interactive Mobile Communication Technologies and Learning. Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359621

Edu-simulation: a serious games platform designed to engage and motivate students
Economou, D., Doumanis, I., Bouki, V., Pedersen, F.S., Kathrani, P., Mentzelopoulos, M. and Georgalas, N. 2015. Edu-simulation: a serious games platform designed to engage and motivate students. IMCL 2015 International Conference on Interactive Mobile Communication Technologies and Learning. Thessaloniki, Greece 19 Nov 2015 IEEE . https://doi.org/10.1109/IMCTL.2015.7359596

Hardware Interfaces for VR Applications: Evaluation on Prototypes
Mentzelopoulos, M., Tarpini, F., Emanuele, A. and Protopsaltis, A. 2015. Hardware Interfaces for VR Applications: Evaluation on Prototypes. The 14th IEEE International Conference on Ubiquitous Computing and Communications - IUCC-2-15 (Special session: VEAI). Liverpool - UK 26 Oct 2015 IEEE .

EdCCDroid: An Education Pilot Prototype for Introducing Code-Combat using LUA
Wood, C., Mentzelopoulos, M. and Protopsaltis, A. 2015. EdCCDroid: An Education Pilot Prototype for Introducing Code-Combat using LUA . 1st Immersive Learning Research Network Conference (iLRN'15). Prague - Czech Republic Jul 2015 IOS Press. https://doi.org/10.3233/978-1-61499-530-2-353

A dynamic role-playing platform for simulations in legal and political education
Economou, D., Doumanis, I., Bouki, V., Pedersen, F.S., Kathrani, P., Mentzelopoulos, M. and Georgalas, N. 2014. A dynamic role-playing platform for simulations in legal and political education. International Conference on Interactive Mobile Communication Technologies and Learning (IMCL). Thessaloniki 13 Nov 2014 IEEE . https://doi.org/10.1109/IMCTL.2014.7011138

Human Computer Interaction using gestures for mobile devices and serious games: A review
Spanogianopoulos, S., Mentzelopoulos, M., Sirlantzis, K. and Protopsaltis, A. 2014. Human Computer Interaction using gestures for mobile devices and serious games: A review. International Conference on Interactive Mobile Communication Technologies and Learning (IMCL). Thessaloniki 13 Nov 2014 IEEE . https://doi.org/10.1109/IMCTL.2014.7011154

3D hand pose estimation with neural networks
Serra, J.A., Garcia-Rodriguez, J., Orts Escolano, S., Garcia-Chamizo, J.M., Angelopoulou, A., Psarrou, A., Mentzelopoulos, M., Montoyo-Bojo, J. and Domínguez, E. 2013. 3D hand pose estimation with neural networks. in: Advances in Computational Intelligence: 12th International Work-Conference on Artificial Neural Networks, IWANN 2013 Springer.

Football video annotation based on player motion recognition using enhanced entropy
Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. and Garcia-Rodriguez, J. 2013. Football video annotation based on player motion recognition using enhanced entropy. in: Advances in Computational Intelligence: 12th International Work-Conference on Artificial Neural Networks, IWANN 2013 Springer.

Natural User Interfaces in Volume Visualisation using Microsoft Kinect
Angelopoulou, A., Garcia-Rodriguez, J., Psarrou, A., Mentzelopoulos, M., Reddy, B., Orts Escolano, S., Serra, J.A. and Lewis, A. 2013. Natural User Interfaces in Volume Visualisation using Microsoft Kinect. ICIAP 2013 International Workshops. Naples, Italy 09 Sep 2013 Springer. https://doi.org/10.1007/978-3-642-41190-8_2

Adaptive learning in motion analysis with self-organising maps
Angelopoulou, A., Garcia-Rodriguez, J., Psarrou, A., Gupta, G. and Mentzelopoulos, M. 2013. Adaptive learning in motion analysis with self-organising maps. International Joint Conference on Neural Networks (IJCNN). Dallas, TX 04 Aug 2013 IEEE . https://doi.org/10.1109/IJCNN.2013.6707135

A semi-parametric approach for football video annotation
Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. and Garcia-Rodriguez, J. 2013. A semi-parametric approach for football video annotation. International Joint Conference on Neural Networks (IJCNN). Dallas, TX 04 Aug 2013 IEEE . https://doi.org/10.1109/IJCNN.2013.6706720

3D gesture recognition with growing neural gas
Sera-Perez, J.A., Garcia Rodriguez, J., Orts-Escolano, S., García-Chamizo, J.M., Montoyo-Bojo, J., Angelopoulou, A., Psarrou, A., Mentzelopoulos, M., Lewis, A. and Orts Escolano, S. 2013. 3D gesture recognition with growing neural gas. in: Proceedings of the International Joint Conference in Neural Networks, IJCNN 2013, 2-9 August 2013, Dallas, USA IEEE . pp. 3034-3041

Active foreground region extraction and tracking for sports video annotation
Mentzelopoulos, M., Psarrou, A., Angelopoulou, A. and Garcia-Rodriguez, J. 2013. Active foreground region extraction and tracking for sports video annotation. Neural Processing Letters. 37 (1), pp. 33-46. https://doi.org/10.1007/s11063-012-9267-4

Explosive ordinance disposal: motion sensor simulator in Nintendo Wii
Mentzelopoulos, M., Tanasa, M., Protopsaltis, A. and Economou, D. 2011. Explosive ordinance disposal: motion sensor simulator in Nintendo Wii. in: SIGDOC'11: proceedings of the 29th ACM international conference on design of communication: October 3 - 5, 2011, Pisa, Italy ACM. pp. 227-234

Simulation game for training new teachers in class management
Bouki, V., Mentzelopoulos, M. and Protopsaltis, A. 2011. Simulation game for training new teachers in class management. in: SIGDOC'11: proceedings of the 29th ACM international conference on design of communication: October 3 - 5, 2011, Pisa, Italy ACM. pp. 79-82

Gender patterns in hypertext reading
Protopsaltis, A. and Bouki, V. 2008. Gender patterns in hypertext reading. in: Workshop on Cognition and the Web: Information Processing, Comprehension and Learning, April 24-26, Granada, Spain WebCog. pp. 213-217

Gender and information processing in electronic age
Protopsaltis, A. and Bouki, V. 2008. Gender and information processing in electronic age. in: ACM Special Interest Group for Design of Communication: proceedings of the 26th annual ACM international conference on design of communication New York ACM. pp. 131-138

Does gender matter in hypertext reading?
Protopsaltis, A. and Bouki, V. 2008. Does gender matter in hypertext reading? in: Luca, J. and Weippl, E.R. (ed.) ED-MEDIA 2008 : Proceedings of World Conference on Educational Multimedia, Hypermedia & Telecommunications, Vienna, Austria Chesapeake, VA AACE. pp. 1120-1129

The effects of reading goals in hypertext reading
Protopsaltis, A. and Bouki, V. 2006. The effects of reading goals in hypertext reading. in: Pierce, R. and Stamey, J. (ed.) Proceedings of the 24th annual conference on Design of communication New York, USA ACM. pp. 29-34

Reading strategies in hypertexts and factors influencing link selection
Protopsaltis, A. and Bouki, V. 2006. Reading strategies in hypertexts and factors influencing link selection. in: Pearson, E. and Bohman, P. (ed.) Proceedings of ED-MEDIA 2006: world conference on educational multimedia, hypermedia & telecommunications AACE. pp. 450-457

Reading in Web-based hypertexts: cognitive processes strategies and reading goals
Protopsaltis, A. 2006. Reading in Web-based hypertexts: cognitive processes strategies and reading goals. PhD thesis University of Westminster School of Electronics and Computer Science https://doi.org/10.34737/92701

Towards a hypertext reading/comprehension model
Protopsaltis, A. and Bouki, V. 2005. Towards a hypertext reading/comprehension model. in: Tilley, S. and Newman, R.M. (ed.) Proceedings of the 23rd annual international conference on Design of communication: documenting & designing for pervasive information ACM. pp. 159-166

Key-frame extraction algorithm using entropy difference
Mentzelopoulos, M. and Psarrou, A. 2004. Key-frame extraction algorithm using entropy difference. in: Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval New York, USA ACM. pp. 39-45

Cognitive aspects of web-based hypertext: an experimental approach
Bouki, V. and Protopsaltis, A. 2004. Cognitive aspects of web-based hypertext: an experimental approach. in: Proceedings of WSEAS International Conference on E-ACTIVITIES, Crete, Oct. 2004 WSEAS.

Cognitive aspects of web-based hypertext: an experimental approach
Bouki, V. and Protopsaltis, A. 2004. Cognitive aspects of web-based hypertext: an experimental approach. WSEAS Transactions on Information Science and Applications. 1 (5), pp. 1268-1276.

Permalink - https://westminsterresearch.westminster.ac.uk/item/9w83y/perceptual-user-interface-framework-for-immersive-information-retrieval-environments-an-experimental-framework-for-testing-and-rapid-iteration


Share this

Usage statistics

169 total views
139 total downloads
These values cover views and downloads from WestminsterResearch and are for the period from September 2nd 2018, when this repository was created.