Hybrid Transformer-LSTM Model for Athlete Performance Prediction in Sports Training Management
Abstract
Precise athlete performance prediction is required for the optimization of training regimens, the prevention of injuries, and the improvement of performance in competition. In this study, we propose a self-attention mechanism-based transformer LSTM (HTL) Athlete Performance Forecasting (APF) framework using Transformer along with Long Short Term Memory (LSTM) networks to model sequentially. The framework can capture global feature interactions and localized temporal dependencies in athlete performance data. A dataset containing 200 football, basketball, and athletics athletes over 12 months was used to train and evaluate the model. Heart rate, speed, distance, workload and recovery indicators are performance metrics. Indeed, HTL-APF is validated against baseline models such as Transformer only, LSTM only, CNN, and RNN models at segmenting the sequence via a sliding window approach. Precision, Recall, F1-Score and AUC-ROC are the evaluation metrics. We propose HTL-APF that results in an F1-Score of 92.1%, AUC-ROC of 96.3%, which outperforms the Transformer model (F1: 88.1%, AUC-ROC: 92.4%) and Lstm only model (F1: 85.9%, AUC-ROC: 90.1%). Analysis from class to class reveals that there is a high classification accuracy (97%) for top performers and moderate (89%) and bad (90%) performers also have good performance. In addition, precision and F1 scores for cross-domain testing across sports disciplines remained above 91%, indicating the framework's generalizability. HTL-APF is a scalable and accurate solution for athlete performance forecasting for personal training plans, injury prevention, and real-time decisions in sports training management, illustrated by these results. Given that it is intended for real-world sports analytics, future work will investigate the development of lightweight adaptations, enhanced interpretability, and domain-specific extensions to enlarge its application range.
Full Text:
PDFReferences
N. Ragab, "Soccer athlete performance prediction using time series analysis," OsloMet-storbyuniversitetet, 2022. https://doi.org/10.3390/engproc2022018037.
L. Hoel, "Using Soccer Athlete GPS Monitoring Data to Visualize and Predict Features," 2023. https://doi.org/10.46632/jdaai/2/3/12.
J. D. Windt, "Longitudinal workload monitoring to keep athletes healthy and performing: conceptual, methodological, and applied considerations in sports injury aetiology," University of British Columbia, 2018. https://doi.org/10.1136/bjsports-2016-096653.
J. Davis et al., "Methodology and evaluation in sports analytics: challenges, approaches, and lessons learned," Machine Learning, vol. 113, no. 9, pp. 6977-7010, 2024. https://doi.org/10.1007/s10994-024-06585-0.
W. Li, "A Big Data Approach to Forecast Injuries in Professional Sports Using Support Vector Machine," Mobile Networks and Applications, pp. 1-17, 2024. https://doi.org/10.1007/s11036-024-02377-x.
C. Wang, "Optimization of sports effect evaluation technology from random forest algorithm and elastic network algorithm," Plos one, vol. 18, no. 10, p. e0292557, 2023. https://doi.org/10.1371/journal.pone.0292557.
R. Bunker and T. Susnjak, "The application of machine learning techniques for predicting match results in team sport: A review," Journal of Artificial Intelligence Research, vol. 73, pp. 1285-1322, 2022. https://doi.org/10.1613/jair.1.13509.
A. Sherstinsky, "Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network," Physica D: Nonlinear Phenomena, vol. 404, p. 132306, 2020. https://doi.org/10.1016/j.physd.2019.132306.
Y. Yu, X. Si, C. Hu, and J. Zhang, "A review of recurrent neural networks: LSTM cells and network architectures," Neural computation, vol. 31, no. 7, pp. 1235-1270, 2019. https://doi.org/10.1162/neco_a_01199.
S. F. Ahmed et al., "Deep learning modelling techniques: current progress, applications, advantages, and challenges," Artificial Intelligence Review, vol. 56, no. 11, pp. 13521-13617, 2023. https://doi.org/10.1007/s10462-023-10466-8.
S. Ahmed, I. E. Nielsen, A. Tripathi, S. Siddiqui, R. P. Ramachandran, and G. Rasool, "Transformers in time-series analysis: A tutorial," Circuits, Systems, and Signal Processing, vol. 42, no. 12, pp. 7433-7466, 2023. https://doi.org/10.1007/s00034-023-02454-8.
Y. Huang et al., "Advancing transformer architecture in long-context large language models: A comprehensive survey," arXiv preprint arXiv:2311.12351, 2023. https://doi.org/10.20944/preprints202411.2377.v1
X. Xi, C. Zhang, W. Jia, and R. Jiang, "Enhancing human pose estimation in sports training: Integrating spatiotemporal transformer for improved accuracy and real-time performance," Alexandria Engineering Journal, vol. 109, pp. 144-156, 2024. https://doi.org/10.1016/j.aej.2024.08.072.
D. d. A. COSTA, "A machine learning approach comparing predictive performance and interpretability of models for predicting success of NCAA basketball players to reach NBA," 2024. https://doi.org/10.5220/0012390000003636.
A. Jäderberg and P. Linde, "Enhancing Football Match Outcome Prediction: A Comparative Study of Feature Selection Techniques and Support Vector Machines," ed, 2024. https://doi.org/10.1109/icosec61587.2024.10722227.
N. Reyaz, G. Ahamad, N. J. Khan, M. Naseem, and J. Ali, "SVMCTI: support vector machine based cricket talent ıdentification model," International Journal of Information Technology, vol. 16, no. 3, pp. 1931-1944, 2024. https://doi.org/10.1007/s41870-023-01686-w
B. Liu, C.-H. Chen, P. Zheng, and G. Zhang, "An adaptive parallel feature learning and hybrid feature fusion-based deep learning approach for machining condition monitoring," IEEE Transactions on Cybernetics, vol. 53, no. 12, pp. 7584-7595, 2022. https://doi.org/10.1109/tcyb.2022.3178116.
J. Yang et al., "A hierarchical deep convolutional neural network and gated recurrent unit framework for structural damage detection," Information Sciences, vol. 540, pp. 117-130, 2020. https://doi.org/10.1016/j.ins.2020.05.090.
G. Alfattni, N. Peek, and G. Nenadic, "Extraction of temporal relations from clinical free text: A systematic review of current approaches," Journal of biomedical informatics, vol. 108, p. 103488, 2020. https://doi.org/10.1016/j.jbi.2020.103488.
D. Zheng and Y. Yuan, "Time series data prediction and feature analysis of sports dance movements based on machine learning," Computational Intelligence and Neuroscience, vol. 2022, no. 1, p. 5611829, 2022. https://doi.org/10.1155/2022/5611829.
B. Omarov, "A Novel Deep Neural Network to Analyze and Monitoring the Physical Training Relation to Sports Activities," International Journal of Advanced Computer Science and Applications, vol. 14, no. 9, 2023. https://doi.org/10.14569/ijacsa.2023.0140977.
D. Raabe, "Deep Learning with Spatiotemporal Data for Team Sports Analysis," 2024. https://doi.org/10.1007/978-3-662-68313-2_21.
P. Ashalatha, "A STUDY OF RECURRENT NEURAL NETWORKS AND THEIR APPLICATIONS: EXPLORING SEQUENCE UNDERSTANDING AND GENERATION." https://doi.org/10.1201/9781420049176-10.
D. Linsley, J. Kim, V. Veerabadran, C. Windolf, and T. Serre, "Learning long-range spatial dependencies with horizontal gated recurrent units," Advances in neural information processing systems, vol. 31, 2018. https://doi.org/10.32470/ccn.2018.1116-0.
Z. Chen, M. Ma, T. Li, H. Wang, and C. Li, "Long sequence time-series forecasting with deep learning: A survey," Information Fusion, vol. 97, p. 101819, 2023. https://doi.org/10.1016/j.inffus.2023.101819.
A. Sabha and A. Selwal, "Data-driven enabled approaches for criteria-based video summarization: a comprehensive survey, taxonomy, and future directions," Multimedia Tools and Applications, vol. 82, no. 21, pp. 32635-32709, 2023. https://doi.org/10.1007/s11042-023-14925-w.
R. Agrawal, Generalized Learning Models for Structured Data. University of California, Santa Cruz, 2019. https://doi.org/10.21236/ada265625.
C. Song, Towards automatic refereeing systems through deep event detection in soccer game videos. University of Delaware, 2021. https://doi.org/10.1109/fuzz-ieee.2017.8015426.
K. Wang et al., "Multiple convolutional neural networks for multivariate time series prediction," Neurocomputing, vol. 360, pp. 107-119, 2019. https://doi.org/10.1016/j.neucom.2019.05.023.
C. Lea, M. D. Flynn, R. Vidal, A. Reiter, and G. D. Hager, "Temporal convolutional networks for action segmentation and detection," in proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 156-165. https://doi.org/10.1109/cvpr.2017.113.
S. Ishaque, N. Khan, and S. Krishnan, "Trends in heart-rate variability signal analysis," Frontiers in Digital Health, vol. 3, p. 639444, 2021. https://doi.org/10.3389/fdgth.2021.639444.
Z. Liu, Z. Zhu, J. Gao, and C. Xu, "Forecast methods for time series data: a survey," Ieee Access, vol. 9, pp. 91896-91912, 2021. https://doi.org/10.1109/access.2021.3091162.
A. Gillioz, J. Casas, E. Mugellini, and O. Abou Khaled, "Overview of the Transformer-based Models for NLP Tasks," in 2020 15th Conference on computer science and information systems (FedCSIS), 2020: IEEE, pp. 179-183. https://doi.org/10.15439/2020f20.
A. Katrompas, T. Ntakouris, and V. Metsis, "Recurrence and self-attention vs the transformer for time-series classification: a comparative study," in International Conference on Artificial Intelligence in Medicine, 2022: Springer, pp. 99-109. https://doi.org/10.1007/978-3-031-09342-5_10.
A. Zeng, M. Chen, L. Zhang, and Q. Xu, "Are transformers effective for time series forecasting?," in Proceedings of the AAAI conference on artificial intelligence, 2023, vol. 37, no. 9, pp. 11121-11128. https://doi.org/10.1609/aaai.v37i9.26317.
C. Duan, Z. Shu, J. Zhang, and F. Xue, "Real-Time Prediction for Athletes' Psychological States Using BERT-XGBoost: Enhancing Human-Computer Interaction," arXiv preprint arXiv:2412.05816, 2024. https://doi.org/10.54254/2755-2721/2025.19096.
L. Jiang and W. Lu, "Sports competition tactical analysis model of cross-modal transfer learning intelligent robot based on Swin Transformer and CLIP," Frontiers in Neurorobotics, vol. 17, p. 1275645, 2023. https://doi.org/10.3389/fnbot.2023.1275645.
Y. Shen, "TransformHR: A Novel Approach to Athlete Heart Rate Monitoring With Transformer‐Based Wearable Technology," Internet Technology Letters, p. e631, 2024. https://doi.org/10.1002/itl2.631.
M. Bader, I. Shahin, and A. Ahmed, "COVID-19 Tweets Analysis Using Hybrid Bi-LSTM and Transformer Models," in 2024 Advances in Science and Engineering Technology International Conferences (ASET), 2024: IEEE, pp. 1-6. https://doi.org/10.1109/aset60340.2024.10708752.
DOI: https://doi.org/10.31449/inf.v49i24.8013

This work is licensed under a Creative Commons Attribution 3.0 License.