Propuesta de una interfaz cognitiva para la exploración distante de entornos virtuales como ayuda a las personas ciegas durante la creación de mapas cognitivos

Zusammenfassung

Unemployment among blind and visually impaired people is very high (70%). These figures are not higher thanks to the effort of organizations such as ONCE, which provides a great number of services for blind people inclusion into the ordinary labour market, in addition to driving the protected labour market, via its subsidiary organizations. The demands from the environment itself, either at the workplace or during commute, were identified to be a major barrier for blind people to get or maintain a job. In particular, activities based on orientation and mobility (O&M) skills (i.e., cognitive mapping, wayfinding, and navigation) are particularly challenging for them. The availability of adapted technologies and aids was identified as one of the top 3 solutions to said challenge. Scientific evidence supports the idea of spatial thought being compatible with blindness. In addition, the prevalence of vision experience among blind and visually impaired people can be presumed to be high. At a symbolic level, there are three types of spatial knowledge, being survey knowledge the most complete and powerful among all three of them. The mental representation of a given piece of survey knowledge is referred to as a cognitive map. Cognitive mapping is the process of acquiring spatial knowledge. There are two cognitive mapping methods: route-based learning (i.e., physically explore an environment to learn its layout) and survey-based learning (i.e., learning an environment without the need of locomotion). Rooms are usually small-scale spaces that can be inspected in their entirety with no need of locomotion. Such small-scale spaces are referred to as vista spaces. However, blind people are compelled to use route-based learning even in vista spaces. Both sighted and blind people can acquire spatial knowledge in a virtual environment and apply it in the corresponding physical space. Thus, visits to simulations of real spaces in virtual reality have been proposed as a means for blind people to gain spatial knowledge regarding the disposition of obstacles in a place before they actually visit its physical location. Those virtual environments are explored according to a proximity approach (i.e., making an avatar to mimic route-based learning). Within the present thesis dissertation, a cognitive mapping tool based on a distant exploration approach is presented. A distant exploration approach allows blind people for exploring an entire room from a single observation point. Said tool consists of two complementary interfaces. On the one hand, a cognitive interface, which is the focus of the present thesis dissertation, referred to as the spotlight, for blind people to control where they want to direct their attention; and on the other hand, a sensitive interface, responsible for providing feedback. This cognitive mapping tool is implemented in the form of a virtual reality video-game for smartphones. It was hypothesised that distant exploration improves efficacy and efficiency of the exploration process without a detrimental impact on the quality or usefulness of the resulting cognitive maps. Cognitive maps are not directly observable, in order to assess their quality, people must build an external representation of them, such as a drawing, a model, or a verbal description; the resulting outcome is referred to as a spatial product. A configurational technique was used; thus, it was possible to produce a set of two-dimensional points describing the spatial layout in the cognitive map. Bidimensional regression is able to account for similarity levels between two planar points-layouts; however, it does not deal well with missing data. Thus, a novel index for the assessment of cognitive-map quality was defined as well. Said quality index is referred to as the Spatial Understanding Quality Index (SUQI). It was defined as the Mahalanobis distance between two four-dimensional vectors representing a spatial product and the original scene, respectively. Being based on the use of the Mahalanobis distance, it is required an estimation of a covariance matrix computed from the elements of a representative set of spatial products. It was hypothesised that a set of spatial products of a single particular room is valid to correctly assess the quality of spatial products representing different rooms. A within-subjects cross-sectional study, where nineteen totally blind people explored three virtual spaces of similar complexity, was conducted. Participants individually explored each virtual space with a different type of spotlight configuration, namely, proximity exploration (noFoA), spherical spotlight (sFoA), and flat spotlight (fFoA). In addition, three independent evaluators ranked all fifty-four spatial products in the eGlance-study dataset according to their similarity to their corresponding original scene. Evidence supports effectiveness improvements due to distant exploration (p-value=0.0006). The fFoA distant-configuration entails a 53% reduction in discovery time (p-value= 0.0027). A trend is observed entailing a 38% reduction in the duration of the overall exploration stage for a flat spotlight configuration (p-value=0.067). Wall-detection effectiveness alters exploration duration (p-value = 0.012). Improvements in effectiveness and discovery time are associated with shorter overall exploration time. Exploration duration after discovery time depends on wall-detection effectiveness. Benefits from a distant exploration configuration are not enough to build better cognitive maps. Compared to human assessment, inter-rater reliability (IRR) of the SUQI was excellent: ICC(A, 1) = 0.999, 95% CI (0.997, 0.999); IRR of the Euclidean distance was moderate to good: ICC(A, 1) = 0.794, 95% CI (0.669, 0.875); and IRR of landmark placement was moderate: ICC(A, 1) = 0.720, 95% CI (0.561, 0.828). IRR between different estimations of the covariance matrix was good to excellent: ICC(A, 1) = 0.886, 95% CI (0.825, 0.929). Thus, the results from spatial-product assessment with the SUQI are equivalent to those obtained from human assessment; and that is so because, conversely to Euclidean distance, the SUQI accounts for variability differences across cognitive-map features. The cognitive map of a scene can be assessed with a covariance matrix based on a different scene.