Sparse and Contractive Graph-Based Variational Encoder-Decoder with Multihead Attention for Robust Spatiotemporal Activity Recognition

Abstract

With the increasing adoption of various sensors, human action recognition has gained significant attention across multiple domains, including person surveillance and human-robot interaction. However, existing data-driven approaches struggle with effectively modeling the spatiotemporal dynamics of sensory data and suffer from limited generalization capability. To address these challenges, this paper introduces a novel graph-based deep learning framework, incorporating a Graph-Attentive Variational Sparse Contractive Peephole LSTM (GAVSC-PLSTM) model. The proposed architecture effectively captures spatiotemporal correlations among sensory data from different body parts and introduces a novel encoder-decoder generative framework to extract task-relevant deep spatiotemporal features. Extensive experiments on three widely used public datasets demonstrate that the proposed model outperforms recent baseline methods.