Deep Learning for Detecting Human Activities from Piezoelectric-Based Kinetic Energy Signals

Kinetic energy harvesting technologies have been progressively used to power wearable devices and to sense the context through energy generation patterns. However, detecting human activities with signals from kinetic harvesters still needs improvement due to the use of approaches based on handcrafted features and the overfitting to device location or subjects. Hence, in this article, we present a deep learning architecture that leverages the feature extraction capability of the convolutional neural networks and the construction of the temporal sequences of recurrent neural networks to improve existing classification results. To provide sufficient data for the deep learning classifier, we propose three data augmentation methods to increase intraclass variance simulating new users performing the same activities. The proposed architecture outperforms existing approaches of kinetic harvesting-based human activity recognition by 13% of accuracy when the training data are augmented with the proposed methods. Finally, given the dependency of kinetic harvesting signals on device location and subjects, we employ transfer learning to improve the classification performance when the system is exposed to new subjects and locations. Transfer learning helps to increase classification performance by 30% when the device location is changed and 35% when the data come from a new subject.

Duke Scholars

Author Maria Gorlatova Electrical and Computer Engineering