Swimming Style Recognition with Convolutional Neural Network with Single IMU

Yiran Meng

doi:10.6911/WSRJ.202411_10(11).0004

Swimming Style Recognition with Convolutional Neural Network with Single IMU

Yiran Meng

World Scientific Research Journal, (2024), Vol.10, No.11, pp.39-43

Published: October 22, 2024

DOI: 10.6911/WSRJ.202411_10(11).0004

PDF: Download Full Text PDF

Abstract

The study focuses on swimming style recognition using a Convolutional Neural Network (CNN) and a single inertial measurement unit (IMU) located on the wrist, mimicking the setup of a typical smartwatch. Traditional methods often employ multiple sensors or sensors placed in impractical locations, limiting everyday usability for swimmers. This research utilizes data collected from 40 swimmers, integrating 53,732 input windows from sessions in a 50-meter pool, where swimmers wore a smartwatch on their wrist. The CNN model was modified to enhance pattern recognition capabilities across swimming styles: Butterfly, Backstroke, Breaststroke, Freestyle, and Transitions. Enhanced data processing techniques, including normalization and augmentation (time-scaling, noise addition, reversing, and rotation), were applied to simulate real-world variances. The model was evaluated using a Leave-One-Subject-Out (LOSO) cross-validation method, demonstrating high precision and minimal misclassification, signifying a robust model capable of accurately detecting and classifying swimming strokes with potential for real-time application in sports and health monitoring. This approach offers a significant improvement over previous systems by reducing the sensor complexity and focusing on individual movement patterns, potentially increasing the accessibility and precision of swimming activity recognition.

Keywords: Convolutional Neural Network (CNN); inertial measurement unit (IMU); swimming style recognition.

APA Citation: Yiran Meng (2024). Swimming Style Recognition with Convolutional Neural Network with Single IMU. World Scientific Research Journal, 10(11), 39-43. https://doi.org/10.6911/WSRJ.202411_10(11).0004

References

Bächlin, M., & Tröster, G. (2012). Swimming performance and technique evaluation with wearable acceleration sensors. Pervasive and Mobile Computing, 8(1), 68-81. https://doi.org/10.1016/j.pmcj.2011.05.003
Delhaye, E., Bouvet, A., Nicolas, G., Vilas-Boas, J. P., Bideau, B., & Bideau, N. (2022). Automatic swimming activity recognition and lap time assessment based on a single imu: A deep learning approach. Sensors, 22(15), 5786. https://doi.org/10.3390/s22155786
Fantozzi, S., Coloretti, V., Piacentini, M. F., Quagliarotti, C., Bartolomei, S., Gatta, G., & Cortesi, M. (2022). Integrated timing of stroking, breathing, and kicking in front-crawl swimming: A novel stroke-by-stroke approach using wearable inertial sensors. Sensors, 22(4), 1419. https://doi.org/10.3390/s22041419
Ferrari, A., Micucci, D., Mobilio, M., & Napoletano, P. (2022). Deep learning and model personalization in sensor-based human activity recognition. Journal of Reliable Intelligent Environments, 9(1), 27-39. https://doi.org/10.1007/s40860-021-00167-w
Fiche, G., Sevestre, V., Gonzalez-Barral, C., Leglaive, S., & Séguier, R. (n.d.). SwimXYZ: A large-scale dataset of synthetic swimming motions and videos. MIG '23: Proceedings of the 16th ACM SIGGRAPH Conference on Motion, Interaction and Games. https://doi.org/10.1145/3623264.3624440
Le Sage, T., Bindel, A., Conway, P. P., Justham, L. M., Slawson, S. E., & West, A. A. (2011). Embedded programming and real-time signal processing of swimming strokes. Sports Engineering, 14(1), 1-14. https://doi.org/10.1007/s12283-011-0070-7
Mooney, R., Corley, G., Godfrey, A., Quinlan, L., & ÓLaighin, G. (2015). Inertial sensor technology for elite swimming performance analysis: A systematic review. Sensors, 16(1), 18. https://doi.org/10.3390/s16010018
Nakashima, M., Ohgi, Y., Akiyama, E., & Kazami, N. (2010). Development of a swimming motion display system for athlete swimmers' training using a wristwatch-style acceleration and gyroscopic sensor device. Procedia Engineering, 2(2), 3035-3040. https://doi.org/10.1016/j.proeng.2010.04.107
Ohgi, Y. (n.d.). Microcomputer-based acceleration sensor device for sports biomechanics -stroke evaluation by using swimmer's wrist acceleration. SENSORS, 2002 IEEE. https://doi.org/10.1109/icsens.2002.1037188
Wang, Z., Shi, X., Wang, J., Gao, F., Li, J., Guo, M., Zhao, H., & Qiu, S. (n.d.). Swimming motion analysis and posture recognition based on wearable inertial sensors. IEEE International Conference on Systems, Man and Cybernetics. https://doi.org/10.1109/smc.2019.8913847
Brunner, G., Melnyk, D., Sigfússon, B., & Wattenhofer, R. (n.d.). Swimming style recognition and lap counting using a smartwatch and deep learning. ISWC '19: Proceedings of the 2019 ACM International Symposium on Wearable Computers. https://doi.org/10.1145/3341163.33