RUS  ENG
Full version
JOURNALS // Computer Research and Modeling // Archive

Computer Research and Modeling, 2023 Volume 15, Issue 3, Pages 657–674 (Mi crm1081)

MODELS IN PHYSICS AND TECHNOLOGY

Analysis of mixed reality cross-device global localization algorithms based on point cloud registration

A. A. Osipov, M. A. Ostanin, A. S. Klimchik

Innopolis University, 1 Universitetskaya st., Innopolis, 420500, Russia

Abstract: State-of-the-art localization and mapping approaches for augmented (AR) and mixed (MR) reality devices are based on the extraction of local features from the camera. Along with this, modern AR/MR devices allow you to build a three-dimensional mesh of the surrounding space. However, the existing methods do not solve the problem of global device co-localization due to the use of different methods for extracting computer vision features. Using a space map from a 3D mesh, we can solve the problem of collaborative global localization of AR/MR devices. This approach is independent of the type of feature descriptors and localisation and mapping algorithms used onboard the AR/MR device. The mesh can be reduced to a point cloud, which consists of only the vertices of the mesh. We propose an approach for collaborative localization of AR/MR devices using point clouds that are independent of algorithms onboard the device. We have analyzed various point cloud registration algorithms and discussed their limitations for the problem of global co-localization of AR/MR devices indoors.

Keywords: co-localization, augmented and mixed reality, point cloud registration.

UDC: 004.021

Received: 25.10.2022
Revised: 04.02.2023
Accepted: 26.04.2023

DOI: 10.20537/2076-7633-2023-15-3-657-674



© Steklov Math. Inst. of RAS, 2024