A Hybrid Neural Network for Spatiotemporal Pattern Recognition

A hybrid network is presented for spatio-temporal feature detecting, which is called TS-LM-SOFM. Its top layer is a novel single layer temporal sequence recognizer called TS which can transform sparse temporal sequential pattern into abstract spatial feature representations. The bottom layer of TS-LM-SOFM, a modified self-organizing feature map, is used as a spatial feature detector. A learning matrix connects the two layers. Experiments show that the hybrid network can well capture the spatio-temporal features of input signals.