RESUMEN
Action recognition is an exciting research avenue for artificial intelligence since it may be a game changer in emerging industrial fields such as robotic visions and automobiles. However, current deep learning (DL) faces major challenges for such applications because of the huge computational cost and inefficient learning. Hence, we developed a novel brain-inspired spiking neural network (SNN) based system titled spiking gating flow (SGF) for online action learning. The developed system consists of multiple SGF units which are assembled in a hierarchical manner. A single SGF unit contains three layers: a feature extraction layer, an event-driven layer, and a histogram-based training layer. To demonstrate the capability of the developed system, we employed a standard dynamic vision sensor (DVS) gesture classification as a benchmark. The results indicated that we can achieve 87.5% of accuracy which is comparable with DL, but at a smaller training/inference data number ratio of 1.5:1. Only a single training epoch is required during the learning process. Meanwhile, to the best of our knowledge, this is the highest accuracy among the non-backpropagation based SNNs. Finally, we conclude the few-shot learning (FSL) paradigm of the developed network: 1) a hierarchical structure-based network design involves prior human knowledge; 2) SNNs for content-based global dynamic feature detection.
RESUMEN
BACKGROUND: Early detection of gait abnormalities is critical for preventing severe injuries in future falls. The timed up and go (TUG) test is a commonly used clinical gait screening test; however, the interpretation of its results is limited to the TUG total time. RESEARCH QUESTION: What is diagnostic accuracy of the low-cost, markerless, automated gait analyzer, with the aid of vision-based artificial intelligence technology, which extract gait spatiotemporal features and screen for abnormal walking patterns through video recordings of the TUG test? METHODS: Our dataset contained retrospective data from outpatients from the Department of Neurology or Rehabilitation of two tertiary hospitals in Shanghai. A panel of three expert neurologists specialized in movement disorders reviewed the gait performance in each TUG video, and labeled them separately, with the most commonly assigned label being used as the reference standard. The gait analyzer performed the AlphaPose algorithm to track the human joint position and calculated the spatiotemporal parameters by filtering and double-threshold signal detection. Gait spatiotemporal features and expert labels were input into machine learning models, and the accuracy of each model was tested with leave-one-out cross-validation (LOOCV). RESULTS: A total of 284 participants were recruited. Among these, 100 were labeled as having abnormal gait performance by experts. The Naive Bayes classifier achieved the best performance with a full-data accuracy of 90.14% and a LOOCV accuracy of 89.08% for screening abnormal gait performance. SIGNIFICANCE: This study is the first to investigate the accuracy of a vision-based intelligent gait analyzer for screening abnormal clinical gait performance. By virtue of a pose estimation algorithm and machine learning models, our intelligent gait analyzer can detect abnormal walking patterns approximate to judgements made by experienced neurologists, which is expected to be a supplementary gait assessment protocol for basic-level doctors in the future.