Yıl: 2021 Cilt: 29 Sayı: 5 Sayfa Aralığı: 2469 - 2485 Metin Dili: İngilizce DOI: 10.3906/elk-2011-45 İndeks Tarihi: 24-06-2022

Real-time motion tracking enhancement via data-fusion based particle filter

Öz:
Motion tracking is a well-defined yet application-specific problem of computer vision field, mostly entailing real-time constraints. Methods addressing such problems are expected also to ensure achievements such as high accuracy and robustness. A probabilistic estimation-based approach is proposed in this paper, in order to enhance the real-time motion tracking process of an RGB-Depth device, in terms of accuracy. A novel method is presented for tracking handpalm of a moving human subject to this end, under a sequence of assumptions such as indoor environment, single object, smooth movement and stable illumination. Tracking accuracy is improved within a particle filter framework by fusing device output with the newly extracted information from RGB and depth images. Experimental results are shared revealing the advantages of the proposed method over the built-in device algorithms. The results demonstrate that the proposed method produces smaller RMSE values both for single implementations and multiexecution trials without violating real-time constraints.
Anahtar Kelime:

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Moeslund TB, Granum E. A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 2001; 81 (3): 231-268.
  • [2] Moeslund TB, Hilton A, Krüger V. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 2006; 104 (2-3): 90-126.
  • [3] Poppe R. Vision-based human motion analysis: an overview. Computer Vision and Image Understanding 2007; 108 (1-2): 4–18.
  • [4] Kumar A, Walia GS, Sharma K. Recent trends in multicue based visual tracking: a review. Expert Systems with Applications 2020; (162): 113711.
  • [5] Jiang H, Li J, Wang D, Lu H. Multi-feature tracking via adaptive weights. Neurocomputing 2016; 207: 189-201.
  • [6] Hu M, Liu Z, Zhang J, Zhang G. Robust object tracking via multi-cue fusion. Signal Processing 2017; 139: 86-95.
  • [7] Tran TH, Le TL, Hoang VN, Vu H. Continuous detection of human fall using multimodal features from Kinect sensors in scalable environment. Computer Methods and Programs in Biomedicine 2017; 146: 151–165.
  • [8] Li X, Liu Q, He Z, Wang H, Zhang C, Chen WS. A multi-view model for visual tracking via correlation filters. Knowledge-Based Systems 2016; 113: 88–99.
  • [9] Z H, Fei M, Sadka A, Zhang Y, Li X. Adaptive fusion of particle filtering and spatio-temporal motion energy for human tracking. Pattern Recognition 2014; 47 (11): 3552–3567.
  • [10] Bueno M, Díaz-Vilariño L, Martínez-Sánchez J, González-Jorge H, Lorenzo H et al. Metrological evaluation of KinectFusion and its comparison with Microsoft Kinect sensor. Measurement 2015; 73: 137-145.
  • [11] Caruso L, Russo R, Savino S. Microsoft Kinect V2 vision system in a manufacturing application. Robotics and Computer-Integrated Manufacturing 2017; 48: 174–181.
  • [12] Boutellaa E, Hadid A, Bengherabi M, Ait-Aoudia S. On the use of Kinect depth data for identity, gender and ethnicity classification from facial images. Pattern Recognition Letters 2015; 68: 270-277.
  • [13] Hbali Y, Hbali S, Ballihi L, Sadgal M. Skeleton-based human activity recognition for elderly monitoring systems. IET Computer Vision 2017; 12 (1): 16-26.
  • [14] Antón D, Kurillo G, Goñi A, Illarramendi A, Bajcsy R. Real-time communication for Kinect-based telerehabilitation. Future Generation Computer Systems 2017; 75: 72-81.
  • [15] Cabrera R, Molina A, Gómez I, García-Heras J. Kinect as an access device for people with cerebral palsy: A preliminary study. International Journal of Human-Computer Studies 2017; 108: 62-69.
  • [16] Yavşan E, Uçar A. Gesture imitation and recognition using Kinect sensor and extreme learning machines. Measurement 2016; (94): 852–861.
  • [17] Napoli A, Glass S, Ward C, Tucker C, Obeid I. Performance analysis of a generalized motion capture system using microsoft kinect 2.0. Biomedical Signal Processing and Control 2017; 38: 265-280.
  • [18] Henseler H, Bonkat SK, Vogt PM, Rosenhahn B. The Kinect recording system for objective three-and fourdimensional breast assessment with image overlays. Journal of Plastic, Reconstructive & Aesthetic Surgery 2016; 69 (2): e27–e34. doi: 10.1016/j.bjps.2015.10.021
  • [19] Hayat M, Bennamoun M, El-Sallam AA. An RGB–D based image set classification for robust face recognition from Kinect data. Neurocomputing 2016; 171: 889-900.
  • [20] Riahi D, Bilodeau GA. Online multi-object tracking by detection based on generative appearance models. Computer Vision and Image Understanding 2016; 152: 88-102.
  • [21] Wang Q, Fang J, Yuan Y. Multi-cue based tracking. Neurocomputing 2014; 131: 227-236.
  • [22] Guipeng D, Gang T, Chunqiao P, Xiaofeng W. A Correlation Particle Filter Target Tracking Algorithm Based on Adaptive Feature Fusion. In: IEEE 13th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI); Chengdu, China; 2020. pp. 419-423.
  • [23] Dong J, Xu Y, Liu C. Multi-feature Fusion Target Tracking Algorithm Based on Global and Local Consistency. In: IEEE 2020 International Conference on Artificial Intelligence and Computer Applications (ICAICA); Dalian, China; 2020. pp. 1280-1284.
  • [24] Lei Q, Li Z, Wang M, Feng J, Zhang R. Research on multi-feature adaptive fusion face tracking algorithm. Journal of Physics: Conference Series 2020; 1518 (1).
  • [25] Kumar A, Walia GS, Sharma K. Real-time visual tracking via multi-cue based adaptive particle filter framework. Multimedia Tools and Applications 2020; 79 (29): 20639-20663.
  • [26] Walia GS, Kumar A, Saxena A, Sharma K, Singh K. Robust object tracking with crow search optimized multi-cue particle filter. Pattern Analysis and Applications 2020; 23 (3): 1439-1455.
  • [27] Shehzad MI, Karam FW, Azmat S. Low-cost multiple object tracking for embedded vision applications. Turkish Journal of Electrical Engineering and Computer Science 2019; 27 (3): 1737-1751.
  • [28] Chen Z. Bayesian filtering: From Kalman filters to particle filters, and beyond. Statistics 2003; 182 (1): 1–69.
  • [29] Taşcı T, Öz C. A closer look to probabilistic state estimation – case: particle filtering. Optoelectronics and Advanced Materials – Rapid Communications 2014; 8 (5-6): 521-534.
APA TAŞCI T, ÇELEBI N (2021). Real-time motion tracking enhancement via data-fusion based particle filter. , 2469 - 2485. 10.3906/elk-2011-45
Chicago TAŞCI Tuğrul,ÇELEBI NUMAN Real-time motion tracking enhancement via data-fusion based particle filter. (2021): 2469 - 2485. 10.3906/elk-2011-45
MLA TAŞCI Tuğrul,ÇELEBI NUMAN Real-time motion tracking enhancement via data-fusion based particle filter. , 2021, ss.2469 - 2485. 10.3906/elk-2011-45
AMA TAŞCI T,ÇELEBI N Real-time motion tracking enhancement via data-fusion based particle filter. . 2021; 2469 - 2485. 10.3906/elk-2011-45
Vancouver TAŞCI T,ÇELEBI N Real-time motion tracking enhancement via data-fusion based particle filter. . 2021; 2469 - 2485. 10.3906/elk-2011-45
IEEE TAŞCI T,ÇELEBI N "Real-time motion tracking enhancement via data-fusion based particle filter." , ss.2469 - 2485, 2021. 10.3906/elk-2011-45
ISNAD TAŞCI, Tuğrul - ÇELEBI, NUMAN. "Real-time motion tracking enhancement via data-fusion based particle filter". (2021), 2469-2485. https://doi.org/10.3906/elk-2011-45
APA TAŞCI T, ÇELEBI N (2021). Real-time motion tracking enhancement via data-fusion based particle filter. Turkish Journal of Electrical Engineering and Computer Sciences, 29(5), 2469 - 2485. 10.3906/elk-2011-45
Chicago TAŞCI Tuğrul,ÇELEBI NUMAN Real-time motion tracking enhancement via data-fusion based particle filter. Turkish Journal of Electrical Engineering and Computer Sciences 29, no.5 (2021): 2469 - 2485. 10.3906/elk-2011-45
MLA TAŞCI Tuğrul,ÇELEBI NUMAN Real-time motion tracking enhancement via data-fusion based particle filter. Turkish Journal of Electrical Engineering and Computer Sciences, vol.29, no.5, 2021, ss.2469 - 2485. 10.3906/elk-2011-45
AMA TAŞCI T,ÇELEBI N Real-time motion tracking enhancement via data-fusion based particle filter. Turkish Journal of Electrical Engineering and Computer Sciences. 2021; 29(5): 2469 - 2485. 10.3906/elk-2011-45
Vancouver TAŞCI T,ÇELEBI N Real-time motion tracking enhancement via data-fusion based particle filter. Turkish Journal of Electrical Engineering and Computer Sciences. 2021; 29(5): 2469 - 2485. 10.3906/elk-2011-45
IEEE TAŞCI T,ÇELEBI N "Real-time motion tracking enhancement via data-fusion based particle filter." Turkish Journal of Electrical Engineering and Computer Sciences, 29, ss.2469 - 2485, 2021. 10.3906/elk-2011-45
ISNAD TAŞCI, Tuğrul - ÇELEBI, NUMAN. "Real-time motion tracking enhancement via data-fusion based particle filter". Turkish Journal of Electrical Engineering and Computer Sciences 29/5 (2021), 2469-2485. https://doi.org/10.3906/elk-2011-45