Gait series: gait recognition using unsynchronized multi-variate time series

Abstract

The currently existing gait recognition methods mainly focus on de-tecting walking patterns based on synchronized data, especially the appearance-based methods using GEIs as original inputs. These methods need large amount of work to deal with data preprocessing to generate a fine-grained gait cycle for each subject, which is an obstacle to use gait recognition widely in real-word applications. To solve this problem, we propose a model-based gait recognition method that is able to generate gait representations from unsynchronized data and consider the dependencies between joints simultaneously. Firstly, we utilize simple joint-wise autoencoder groups to reconstruct unsynchronized joint se-quences generated by pose estimation, where multi-scale time-patches are em-ployed to capture time series patterns by capturing information from variable length windows. Then, to calculate the inter-joint dependencies, a feature fusion structure based on self-attention mechanism is used to generate final gait repre-sentations considering all joints’ moving patterns. This pipeline gives out tem-poral-spatial gait representations from unsynchronized data. Experimental re-sults demonstrate that the performance can be comparable to the state-of-art synchronized pose-based gait recognition methods. Moreover, extensive abla-tion studies also explain the effectiveness of the proposed method’s structure design.

More information

Identifiers

Catalogue record

Export record