Modern data analysis increasingly relies on time series data across diverse domains, such as biomechanics, medicine, sports, and computer animation. A special case of this data type is generated by optical motion capture systems, enabling precise spatiotemporal tracking of anatomical marker positions. However, during dynamic, fast-moving recordings, some markers may not be registered properly, mainly because they are obscured or because there are insufficient cameras. While continuous trajectories provide the basis for human movement analysis, their utility is heavily dependent on the accurate registration of all measurement points. The post-processing of motion capture data is highly time-consuming; thus, selecting an appropriate, highly reliable gap-filling method is extremely important for subsequent data analysis. In this study, we propose a novel, custom-designed Kalman filter for gap-filling dance motion-capture trajectories. This method integrates the three-dimensional positions, velocities, and accelerations of markers. The proposed method is compared with the basic Kalman filter and a bidirectional Long Short-Term Memory (BiLSTM) model, which is highly effective for imputing sequential data. Given these dual paradigms, this study aims to compare the classical mathematical model with the modern machine learning approach for reconstructing motion capture data, evaluating their respective effectiveness across varying spatial and temporal characteristics of missing data. Several examinations, based on the number of missing markers (from 2 to 14) in the given marker's neighbour group across various frame numbers (from 100 to 500), were performed. The BiLSTM model achieved lower RMSE values than the custom Kalman-based filter across almost all scenarios and was highly stable with a small number of missing markers. However, the accuracy of both methods deteriorated as the number of missing markers increased, indicating a significant impact of the spatial distribution of missing data on reconstruction quality.
References
Aristidou, A., Cameron, J., & Lasenby, J. (2008). Real-time estimation of missing markers in human motion capture. In 2008 2nd International Conference on Bioinformatics and Biomedical Engineering (pp. 1343–1346). IEEE. https://doi.org/10.1109/ICBBE.2008.665
Bai, Y., Yan, B., Zhou, C., Su, T., & Jin, X. (2023). State of art on state estimation: Kalman filter driven by machine learning. Annual Reviews in Control, 56, Article 100909. https://doi.org/10.1016/j.arcontrol.2023.100909
Chen, H.-Y., Cheng, Y.-H., & Lo, A. (2023). Improve dancing skills with motion capture systems: Case study of a Taiwanese high school dance class. Research in Dance Education, 24(4), 342–360. https://doi.org/10.1080/14647893.2021.1980524
Dziuba-Kozieł, M., Kozieł, G., Harasim, D., Kisała, P., & Kochanowicz, M. (2024). Method of automatic calibration and measurement of the light polarisation plane rotation with tilted fibre Bragg grating and discrete wavelet transform usage. Advances in Science and Technology Research Journal, 19(1), 165–177. https://doi.org/10.12913/22998624/194890
Dziuba-Kozieł, M., Kozieł, G., Markiewicz, J., Kochanowicz, M., Dorosz, D., Miluski, P., & Kisała, P. (2026). Machine learning-assisted design of inverted gradient multiring optical fibres for flat-top beam generation. Optics Express, 34(4), 7159–7171. https://doi.org/10.1364/OE.587143
Esaki, K., & Nagao, K. (2024). An efficient immersive self-training system for hip-hop dance performance with automatic evaluation features. Applied Sciences, 14(14), Article 5981. https://doi.org/10.3390/app14145981
Feng, Y., Xiao, J., Zhuang, Y., Yang, X., Zhang, J. J., & Song, R. (2014). Exploiting temporal stability and low-rank structure for motion capture data refinement. Information Sciences, 277, 777–793. https://doi.org/10.1016/j.ins.2014.03.013
FilterPy. (n.d.). FilterPy documentation. Retrieved September 15, 2026, from https://filterpy.readthedocs.io/en/latest/
Gomes, D., Guimarães, V., & Silva, J. (2021). A fully-automatic gap filling approach for motion capture trajectories. Applied Sciences, 11(21), Article 9847. https://doi.org/10.3390/app11219847
Hauenstein, J. D., Huebner, A., Wagle, J. P., Cobian, E. R., Cummings, J., Hills, C., McGinty, M., Merritt, M., Rosengarten, S., Skinner, K., Szemborski, M., & Wojtkiewicz, L. (2024). Reliability of markerless motion capture systems for assessing movement screenings. Orthopaedic Journal of Sports Medicine, 12(3), Article 23259671241234339. https://doi.org/10.1177/23259671241234339
He, Y., Pang, A., Chen, X., Liang, H., Wu, M., Ma, Y., & Xu, L. (2021). ChallenCap: Monocular 3D capture of challenging human performances using multi-modal references. ArXiv, abs/2103.06747. https://doi.org/10.48550/arXiv.2103.06747
Ji, H., Wang, L., Zhang, Y., Li, Z., & Wei, C. (2023). A review of human pose estimation methods in markerless motion capture. Computer-Aided Design and Applications, 21(3), 392–423. https://doi.org/10.14733/cadaps.2024.392-423
Kico, I., Zelnicek, D., & Liarokapis, F. (2020). Assessing the learning of folk dance movements using immersive virtual reality. In 2020 24th International Conference Information Visualisation (IV) (pp. 587–592). IEEE. https://doi.org/10.1109/IV51561.2020.00100
Kucherenko, T., Peristy, D., & Bütepage, J. (2024). Evaluating the evaluators: Towards human-aligned metrics for missing markers reconstruction. ArXiv, abs/2410.14334. https://doi.org/10.48550/arXiv.2410.14334
Lai, R. Y. Q., Yuen, P. C., & Lee, K. K. W. (2011). Motion capture data completion and denoising by singular value thresholding. In Eurographics 2011 — Short Papers (pp. 45–48). The Eurographics Association. https://doi.org/10.2312/EG2011/SHORT/045-048
Lannan, N., Zhou, L., Fan, G., & Hausselle, J. (2020). Human motion enhancement using nonlinear Kalman filter assisted convolutional autoencoders. In 2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE) (pp. 1008–1015). IEEE. https://doi.org/10.1109/BIBE50027.2020.00171
Li, J., Xiao, D., Li, K., & Li, J. (2021). Graph matching for marker labeling and missing marker reconstruction with bone constraint by LSTM in optical motion capture. IEEE Access, 9, 34868–34881. https://doi.org/10.1109/ACCESS.2021.3060385
Maggioni, V., Azevedo-Coste, C., Durand, S., & Bailly, F. (2025). Optimisation and comparison of markerless and marker-based motion capture methods for hand and finger movement analysis. Sensors, 25(4), Article 1079. https://doi.org/10.3390/s25041079
Malekian, L., & Lapeer, R. (2024). Self-occluded human pose recovery in monocular video motion capture. In 2024 14th International Conference on Pattern Recognition Systems (ICPRS) (pp. 1–6). IEEE. https://doi.org/10.1109/ICPRS62101.2024.10677815
Martini, E., Boldo, M., & Bombieri, N. (2024). FLK: A filter with learned kinematics for real-time 3D human pose estimation. Signal Processing, 224, Article 109598. https://doi.org/10.1016/j.sigpro.2024.109598
Millour, G., Velásquez, A. T., & Domingue, F. (2023). A literature overview of modern biomechanical-based technologies for bike-fitting professionals and coaches. International Journal of Sports Science & Coaching, 18(1), 292–303. https://doi.org/10.1177/17479541221123960
Mohaoui, S., & Dmytryshyn, A. (2026). Low-rank completion for motion capture data recovery: Approaches, constraints, and algorithms. Computer Science Review, 60, Article 100878. https://doi.org/10.1016/j.cosrev.2025.100878
Powroznik, P., Skublewska-Paszkowska, M., Dziedzic, K., & Barszcz, M. (2025). Feature fusion graph consecutive-attention network for skeleton-based tennis action recognition. Applied Sciences, 15(10), Article 5320. https://doi.org/10.3390/app15105320
Senecal, S., Nijdam, N. A., Aristidou, A., & Magnenat-Thalmann, N. (2020). Salsa dance learning evaluation and motion analysis in gamified virtual reality environment. Multimedia Tools and Applications, 79(33–34), 24621–24643. https://doi.org/10.1007/s11042-020-09192-y
Skublewska-Paszkowska, M. (2024). Tennis motion recognition: Design of classification approaches and experimental studies. Lublin University of Technology Publishing House.
Skublewska-Paszkowska, M., Powroźnik, P., Barszcz, M., Dziedzic, K., & Aristodou, A. (2024). Identifying and animating movement of Zeibekiko sequences by spatial temporal graph convolutional network with multi attention aodules. Advances in Science and Technology Research Journal, 18(8), 217–227. https://doi.org/10.12913/22998624/193180
Skurowski, P., & Pawlyta, M. (2021). Gap reconstruction in optical motion capture sequences using neural networks. Sensors, 21(18), Article 6115. https://doi.org/10.3390/s21186115
Skurowski, P., & Pawlyta, M. (2024). Tree based regression methods for gap reconstruction of motion capture sequences. Biomedical Signal Processing and Control, 88, Article 105641. https://doi.org/10.1016/j.bspc.2023.105641
van der Kruk, E., & Reijne, M. M. (2018). Accuracy of human motion capture systems for sport applications; state-of-the-art review. European Journal of Sport Science, 18(6), 806–819. https://doi.org/10.1080/17461391.2018.1463397
Vicon Motion Systems. (2022). Plug-in gait reference guide (Vicon Documentation).
Zhou, H., & Hu, H. (2008). Human motion tracking for rehabilitation — A survey. Biomedical Signal Processing and Control, 3(1), 1–18. https://doi.org/10.1016/j.bspc.2007.09.001
Yuhai, O., Choi, A., Cho, Y., Kim, H., & Mun, J. H. (2024). Deep-Learning-Based Recovery of Missing Optical Marker Trajectories in 3D Motion Capture Systems. Bioengineering, 11(6), 560. https://doi.org/10.3390/bioengineering11060560