Lost in Learning: Hypertext Navigational Efficiency Measures Are Valid for Predicting Learning in Virtual Reality Educational Games.

The lostness measure, an implicit and unobtrusive measure originally designed for assessing the usability of hypertext systems, could be useful in Virtual Reality (VR) games where players need to find information to complete a task. VR locomotion systems with node-based movement mimic actions for exploration and browsing found in hypertext systems. For that reason, hypertext usability measures, such as "lostness" can be used to identify how disoriented a player is when completing tasks in an educational game by examining steps made by the player. An evaluation of two different lostness measures, global and local lostness, based on two different types of tasks, is described in a VR educational game using 13 college students between 14 and 18 years old in a first study and extended using 12 extra participants in a second study. Multiple Linear Regression analyses showed, in both studies, that local lostness, and not global lostness, had a significant effect on a post-game knowledge test. Therefore, we argued that local lostness was able to predict how well-participants would perform on a post-game knowledge test indicating how well they learned from the game. In-game experience aspects (engagement, cognitive interest, and presence) were also evaluated and, interestingly, it was also found that participants learned less when they felt more present in the game. We believe these two measures relate to cognitive overload, which is known to have an adverse effect on learning. Further research should investigate the lostness measure for use in an online adaptive game system and design the game system in such a way that the risk of cognitive overload is minimized when learning, resulting in higher retention of information.

Virtual Reality Aids Game Navigation: Evidence from the Hypertext Lostness Measure.

Instead of traditional free movement, node-based movement can be used in virtual reality (VR) games. In node-based movement systems, players navigate by jumping to set locations. Node-based movement is similar to hypertext navigation. We show that the hypertext lostness measure can be used as a game analytic to evaluate navigational efficiency. In a randomized controlled trial with 25 adolescent participants, an immersive desktop game environment and a VR game environment were compared on the transmission of in-game educational content and navigational efficiency. Results show that the hypertext lostness measure is also valuable outside its original hypertext domain: in VR. VR did not improve players' retention of factual knowledge, but did significantly improve players' spatial knowledge and navigational efficiency. We conclude (a) the hypertext lostness measure is also valuable for node-based VR games and (b) VR games add to spatial learning, even when compared with already immersive desktop games.