Virtual Personal Trainer: Fitness Video Recognition Using Convolution Neural Network and Bidirectional LSTM

The increased interest of users towards healthier lifestyles has motivated the development of a virtual personal trainer application using Android as platform. Despite the availability of numerous fitness apps and gyms, everyone needs proper training at their ease and wishes to monitor calories burnt. Thus, this paper proposes a novel idea of virtual personal trainer applications that recognizes user actions through videos. The video data is processed using convolutional neural network and bidirectional long short-term memory network. The motive of work is to recognize exercise accurately from video and calculate the number of calories expended. The proposed application provides not only detailed information about exercise but also ascertains the correct way of performing exercises as this is a major challenge that users face due to lack of knowledge. The idea is implemented on UCF-101 Action Recognition dataset, and experimental results show significant improvements as compared to baseline methods. This study would benefit users who are fitness enthusiasts and are more prone to gadgets.