Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set

Yıl: 2022 Cilt: 54 Sayı: 3 Sayfa Aralığı: 248 - 258 Metin Dili: İngilizce DOI: 10.5152/eurasianjmed.2022.22096 İndeks Tarihi: 06-05-2023

Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set

Öz:
Objective: The artificial intelligence competition in healthcare was organized for the first time at the annual aviation, space, and technology festival (TEKNOFEST), Istanbul/Türkiye, in September 2021. In this article, the data set preparation and competition processes were explained in detail; the anonymized and annotated data set is also provided via official website for further research. Materials and Methods: Data set recorded over the period covering 2019 and 2020 were centrally screened from the e-Pulse and Teleradiology System of the Republic of Türkiye, Ministry of Health using various codes and filtering criteria. The data set was anonymized. The data set was prepared, pooled, curated, and anno- tated by 7 radiologists. The training data set was shared with the teams via a dedicated file transfer protocol server, which could be accessed using private usernames and passwords given to the teams under a non- disclosure agreement signed by the representative of each team. Results: The competition consisted of 2 stages. In the first stage, teams were given 192 digital imaging and communications in medicine images that belong to 1 of 3 possible categories namely, hemorrhage, ischemic, or non-stroke. Teams were asked to classify each image as either stroke present or absent. In the second stage of the competition, qualifying 36 teams were given 97 digital imaging and communications in medicine images that contained hemorrhage, ischemia, or both lesions. Among the employed methods, Unet and DeepLabv3 were the most frequently observed ones. Conclusion: Artificial intelligence competitions in healthcare offer good opportunities to collect data reflect- ing various cases and problems. Especially, annotated data set by domain experts is more valuable.
Anahtar Kelime:

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • 1. Aydoğan A, Türk Havacılık AD, Faaliyetlerinin GelişimFVH. Süreci. Uluslararası Tarih Araştırmaları Derg. 2020;4(2):69-81.
  • 2. TEKNOFEST Official Website; 2021. Available at: https ://te knofe st.or g/tr/ .
  • 3. Kirshner H, Schrag M. Management of intracer- ebral hemorrhage: update and future therapies. Curr Neurol Neurosci Rep. 2021;21(10):57. [CrossRef]
  • 4. Brott T, Bogousslavsky J. Treatment of acute ischemic stroke. N Engl J Med. 2000;343(10):710- 722. [CrossRef]
  • 5. Dyer T, Chawda S, Alkilani R, Morgan TN, Hughes M, Rasalingham S. Validation of an arti- ficial intelligence solution for acute triage and rule-out normal of non-contrast CT head scans. Neuroradiology. 2022;64(4):735-743. [CrossRef]
  • 6. Wang X, Shen T, Yang S, et al. A deep learning algorithm for automatic detection and classifica- tion of acute intracranial hemorrhages in head CT scans. NeuroImage Clin. 2021;32:102785. [CrossRef]
  • 7. Ginat D. Implementation of machine learning software on the radiology worklist decreases scan view delay for the detection of intracranial hemorrhage on CT. Brain Sci. 2021;11(7). [CrossRef]
  • 8. Rava RA, Seymour SE, LaQue ME, et al. Assess- ment of an artificial intelligence algorithm for detection of intracranial hemorrhage. World Neurosurg. 2021;150:e209-e217. [CrossRef]
  • 9. Arab A, Chinda B, Medvedev G, et al. A fast and fully-automated deep-learning approach for accurate hemorrhage segmentation and volume quantification in non-contrast whole-head CT. Sci Rep. 2020;10(1):19389. [CrossRef]
  • 10. Zhao X, Chen K, Wu G, et al. Deep learning shows good reliability for automatic segmenta- tion and volume measurement of brain hemor- rhage, intraventricular extension, and peripheral edema. Eur Radiol. 2021;31(7):5012-5020. [CrossRef]
  • 11. Kellogg RT, Vargas J, Barros G, et al. Segmentation of chronic subdural hematomas using 3D convo- lutional neural networks. World Neurosurg. 2021;148:e58-e65. [CrossRef]
  • 12. Nagel S, Sinha D, Day D, et al. e-ASPECTS soft- ware is non-inferior to neuroradiologists in apply- ing the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke. 2017;12(6):615-622. [CrossRef]
  • 13. Austein F, Wodarg F, Jürgensen N, et al. Auto- mated versus manual imaging assessment of early ischemic changes in acute stroke: compari- son of two software packages and expert con- sensus. Eur Radiol. 2019;29(11):6285-6292. [CrossRef]
  • 14. Kniep HC, Sporns PB, Broocks G, et al. Posterior circulation stroke: machine learning-based detec- tion of early ischemic changes in acute non- contrast CT scans. J Neurol. 2020;267(9):2632- 2641. [CrossRef]
  • 15. Qiu W, Kuang H, Teleg E, et al. Machine learning for detecting early infarction in acute stroke with non-c ontra st-en hance d CT. Radiology. 2020; 294(3):638-644. [CrossRef]
  • 16. Pan J, Wu G, Yu J, Geng D, Zhang J, Wang Y. Detecting the early infarct core on non-contrast CT images with a deep learning residual net- work. J Stroke Cerebrovasc Dis. 2021;30(6):105752. [CrossRef]
  • 17. Bivard A, Churilov L, Parsons M. Artificial intel- ligence for decision support in acute stroke - current roles and potential. Nat Rev Neurol. 2020;16(10):575-585. [CrossRef]
  • 18. PazminoJ, ed. The world science festival. American Astronomical Society Meeting Abstracts. 2011;218.
  • 19. Prevedello LM, Halabi SS, Shih G, et al. Chal- lenges related to artificial intelligence research in medical imaging and the importance of image analysis competitions. Radiol Artif Intell. 2019;1(1): e180031. [CrossRef]
  • 20. Flanders AE, Prevedello LM, Shih G, et al. Con- struction of a machine learning dataset through collaboration: the RSNA 2019 brain CT hemor- rhage challenge. Radiol Artif Intell. 2020;2(3): e190211. [CrossRef]
  • 21. Johnson AE, Pollard TJ, Shen L, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035. [CrossRef]
  • 22. Kim YG, Shin D, Park MY, et al. ECG-ViEW II, a freely accessible electrocardiogram database. PLoS One. 2017;12(4):e0176222. [CrossRef]
  • 23. Liew SL, Anglin JM, Banks NW, et al. A large, open source dataset of stroke anatomical brain images and manual lesion segmentations. Sci Data. 2018;5(5):180011. [CrossRef]
  • 24. Hssayeni M. Computed Tomography Images for Intracranial Hemorrhage Detection and Seg- mentation (version 1.3.1). PhysioNet. 2020.
  • 25. Goldberger AL, Amaral LA, Glass L, et al. Phys- ioBank, PhysioToolkit, and Physionet: compo- nents of a new research resource for complex physiologic signals. Circulation. 2000;101(23): E215-E220. [CrossRef]
  • 26. Clèrigues A, Valverde S, Bernal J, Freixenet J, Oliver A, Lladó X. Acute ischemic stroke lesion core segmentation in CT perfusion images using fully convolutional neural networks. Comput Biol Med. 2019;115:103487. [CrossRef]
  • 27. Rajpurkar P, Chen E, Banerjee O, Topol EJ. AI in health and medicine. Nat Med. 2022;28(1): 31-38. [CrossRef]
  • 28. Gabelloni M, Faggioni L, Borgheresi R, et al. Bridging gaps between images and data: a sys- tematic update on imaging biobanks. Eur Radiol. 2022;32(5):3173-3186. [CrossRef]
  • 29. Martín-Noguerol T, Paulano-Godino F, López- Ortega R, Górriz JM, Riascos RF, Luna A. Artifi- cial intelligence in radiology: relevance of collabo- rative work between radiologists and engineers for building a multidisciplinary team. Clin Radiol. 2021;76(5):317-324. [CrossRef]
APA Koc U, Sezer E, Ozkaya Y, Yarbay Y, Taydas O, AYYILDIZ V, Kızıloglu A, Kesimal U, çankaya i, Beşler M, Karakaş E, Karademir F, Sebik N, BAHADIR M, SEZER Ö, yeşilyurt B, Varlı S, AKDOGAN E, ULGU M, BIRINCI S (2022). Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. , 248 - 258. 10.5152/eurasianjmed.2022.22096
Chicago Koc Ural,Sezer Ebru Akcapinar,Ozkaya Yasar Alper,Yarbay Yasin,Taydas Onur,AYYILDIZ VEYSEL ATİLLA,Kızıloglu Alper,Kesimal Uğur,çankaya imran,Beşler Muhammed Said,Karakaş Emrah,Karademir Fatih,Sebik Nihat Barış,BAHADIR MURAT,SEZER Özgür,yeşilyurt Batuhan,Varlı Songül,AKDOGAN ERHAN,ULGU MUSTAFA MAHIR,BIRINCI Suayip Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. (2022): 248 - 258. 10.5152/eurasianjmed.2022.22096
MLA Koc Ural,Sezer Ebru Akcapinar,Ozkaya Yasar Alper,Yarbay Yasin,Taydas Onur,AYYILDIZ VEYSEL ATİLLA,Kızıloglu Alper,Kesimal Uğur,çankaya imran,Beşler Muhammed Said,Karakaş Emrah,Karademir Fatih,Sebik Nihat Barış,BAHADIR MURAT,SEZER Özgür,yeşilyurt Batuhan,Varlı Songül,AKDOGAN ERHAN,ULGU MUSTAFA MAHIR,BIRINCI Suayip Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. , 2022, ss.248 - 258. 10.5152/eurasianjmed.2022.22096
AMA Koc U,Sezer E,Ozkaya Y,Yarbay Y,Taydas O,AYYILDIZ V,Kızıloglu A,Kesimal U,çankaya i,Beşler M,Karakaş E,Karademir F,Sebik N,BAHADIR M,SEZER Ö,yeşilyurt B,Varlı S,AKDOGAN E,ULGU M,BIRINCI S Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. . 2022; 248 - 258. 10.5152/eurasianjmed.2022.22096
Vancouver Koc U,Sezer E,Ozkaya Y,Yarbay Y,Taydas O,AYYILDIZ V,Kızıloglu A,Kesimal U,çankaya i,Beşler M,Karakaş E,Karademir F,Sebik N,BAHADIR M,SEZER Ö,yeşilyurt B,Varlı S,AKDOGAN E,ULGU M,BIRINCI S Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. . 2022; 248 - 258. 10.5152/eurasianjmed.2022.22096
IEEE Koc U,Sezer E,Ozkaya Y,Yarbay Y,Taydas O,AYYILDIZ V,Kızıloglu A,Kesimal U,çankaya i,Beşler M,Karakaş E,Karademir F,Sebik N,BAHADIR M,SEZER Ö,yeşilyurt B,Varlı S,AKDOGAN E,ULGU M,BIRINCI S "Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set." , ss.248 - 258, 2022. 10.5152/eurasianjmed.2022.22096
ISNAD Koc, Ural vd. "Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set". (2022), 248-258. https://doi.org/10.5152/eurasianjmed.2022.22096
APA Koc U, Sezer E, Ozkaya Y, Yarbay Y, Taydas O, AYYILDIZ V, Kızıloglu A, Kesimal U, çankaya i, Beşler M, Karakaş E, Karademir F, Sebik N, BAHADIR M, SEZER Ö, yeşilyurt B, Varlı S, AKDOGAN E, ULGU M, BIRINCI S (2022). Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. Eurasian Journal of Medicine, 54(3), 248 - 258. 10.5152/eurasianjmed.2022.22096
Chicago Koc Ural,Sezer Ebru Akcapinar,Ozkaya Yasar Alper,Yarbay Yasin,Taydas Onur,AYYILDIZ VEYSEL ATİLLA,Kızıloglu Alper,Kesimal Uğur,çankaya imran,Beşler Muhammed Said,Karakaş Emrah,Karademir Fatih,Sebik Nihat Barış,BAHADIR MURAT,SEZER Özgür,yeşilyurt Batuhan,Varlı Songül,AKDOGAN ERHAN,ULGU MUSTAFA MAHIR,BIRINCI Suayip Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. Eurasian Journal of Medicine 54, no.3 (2022): 248 - 258. 10.5152/eurasianjmed.2022.22096
MLA Koc Ural,Sezer Ebru Akcapinar,Ozkaya Yasar Alper,Yarbay Yasin,Taydas Onur,AYYILDIZ VEYSEL ATİLLA,Kızıloglu Alper,Kesimal Uğur,çankaya imran,Beşler Muhammed Said,Karakaş Emrah,Karademir Fatih,Sebik Nihat Barış,BAHADIR MURAT,SEZER Özgür,yeşilyurt Batuhan,Varlı Songül,AKDOGAN ERHAN,ULGU MUSTAFA MAHIR,BIRINCI Suayip Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. Eurasian Journal of Medicine, vol.54, no.3, 2022, ss.248 - 258. 10.5152/eurasianjmed.2022.22096
AMA Koc U,Sezer E,Ozkaya Y,Yarbay Y,Taydas O,AYYILDIZ V,Kızıloglu A,Kesimal U,çankaya i,Beşler M,Karakaş E,Karademir F,Sebik N,BAHADIR M,SEZER Ö,yeşilyurt B,Varlı S,AKDOGAN E,ULGU M,BIRINCI S Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. Eurasian Journal of Medicine. 2022; 54(3): 248 - 258. 10.5152/eurasianjmed.2022.22096
Vancouver Koc U,Sezer E,Ozkaya Y,Yarbay Y,Taydas O,AYYILDIZ V,Kızıloglu A,Kesimal U,çankaya i,Beşler M,Karakaş E,Karademir F,Sebik N,BAHADIR M,SEZER Ö,yeşilyurt B,Varlı S,AKDOGAN E,ULGU M,BIRINCI S Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set. Eurasian Journal of Medicine. 2022; 54(3): 248 - 258. 10.5152/eurasianjmed.2022.22096
IEEE Koc U,Sezer E,Ozkaya Y,Yarbay Y,Taydas O,AYYILDIZ V,Kızıloglu A,Kesimal U,çankaya i,Beşler M,Karakaş E,Karademir F,Sebik N,BAHADIR M,SEZER Ö,yeşilyurt B,Varlı S,AKDOGAN E,ULGU M,BIRINCI S "Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set." Eurasian Journal of Medicine, 54, ss.248 - 258, 2022. 10.5152/eurasianjmed.2022.22096
ISNAD Koc, Ural vd. "Artificial Intelligence in Healthcare Competition (TEKNOFEST-2021): Stroke Data Set". Eurasian Journal of Medicine 54/3 (2022), 248-258. https://doi.org/10.5152/eurasianjmed.2022.22096