Date of Award
4-1-2022
Thesis Type
phd
Document Type
Thesis (Restricted Access)
Divisions
fsktm
Department
Faculty of Computer Science & Information Technology
Institution
Universiti Malaya
Abstract
The research works on three-dimensional (3D)-skeleton-joints-based human action recognition (HAR) remains demanding. Among the approaches, Echo State Networks (ESNs) are a reservoir computing method that considers skeleton joints human actions as multivariate time series and attempts to identify and model the dynamical temporal features in 3D space. Despite the random initialization of the ESN's input and reservoir weights may reduce the computational cost, this may raise instability and variance in generalization and hence diminish reproducibility. Moreover, ESN remains a black-box algorithm. Notably, it lacks explainability consideration to understand the input-dependent reservoir dynamics, specifically while configuring the optimal hyperparameters for HAR. Besides, following the body of Convolutional Echo State Network (ConvESN) work to incorporate modeling dynamics and multiscale temporal feature in handling HAR problem, the model may be very sensitive to the selection of hyperparameters in Convolutional Neural Network (CNN). This work addresses these issues by proposing a novel approach known as Self-Organizing Convolutional Echo State Network (SO-ConvESN) for HAR. Specifically, this work proposes an unsupervised self-organizing network for learning node centroids and interconnectivity maps compatible with the deterministic initialization of ESN reservoir weights. To ensure stability and echo state property (ESP) in the self-organizing reservoir, this work further exploits the Recurrent Plots (RPs) and Recurrence Quantification Analysis (RQA) techniques for explainability and characterization of the dynamics of the self-organizing reservoir and hence tuning two critical ESN hyperparameters: input scaling (
Note
Thesis (PhD) – Faculty of Computer Science & Information Technology, Universiti Malaya, 2022.
Recommended Citation
Lee, Gin Chong, "Self-organizing kernel-based convolutional echo state network for human action recognition / Lee Gin Chong" (2022). Student Works (2020-2029). 1144.
https://knova.um.edu.my/student_works_2020s/1144