Yıl: 2023 Cilt: 31 Sayı: SI-1 (6) Sayfa Aralığı: 1006 - 1020 Metin Dili: İngilizce DOI: 10.55730/1300-0632.4031 İndeks Tarihi: 22-11-2023

Focal modulation network for lung segmentation in chest X-ray images

Öz:
Segmentation of lung regions is of key importance for the automatic analysis of Chest X-Ray (CXR) images, which have a vital role in the detection of various pulmonary diseases. Precise identification of lung regions is the basic prerequisite for disease diagnosis and treatment planning. However, achieving precise lung segmentation poses significant challenges due to factors such as variations in anatomical shape and size, the presence of strong edges at the rib cage and clavicle, and overlapping anatomical structures resulting from diverse diseases. Although commonly considered as the de-facto standard in medical image segmentation, the convolutional UNet architecture and its variants fall short in addressing these challenges, primarily due to the limited ability to model long-range dependencies between image features. While vision transformers equipped with self-attention mechanisms excel at capturing long-range relationships, either a coarse-grained global self-attention or a fine-grained local self-attention is typically adopted for segmentation tasks on high-resolution images to alleviate quadratic computational cost at the expense of performance loss. This paper introduces a focal modulation UNet model (FMN-UNet) to enhance segmentation performance by effectively aggregating fine-grained local and coarse-grained global relations at a reasonable computational cost. FMN-UNet first encodes CXR images via a convolutional encoder to suppress background regions and extract latent feature maps at a relatively modest resolution. FMN-UNet then leverages global and local attention mechanisms to model contextual relationships across the images. These contextual feature maps are convolutionally decoded to produce segmentation masks. The segmentation performance of FMN-UNet is compared against state-of-the-art methods on three public CXR datasets (JSRT, Montgomery, and Shenzhen). Experiments in each dataset demonstrate the superior performance of FMN-UNet against baselines.
Anahtar Kelime: Focal modulation lung segmentation chest x-ray transformer attention

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Li X, Shen L, Xie X, Huang S, Xie Z et al. Multi-resolution convolutional networks for chest X- ray radiograph based lung nodule detection. Artificial intelligence in medicine 2020; 103: 101744. https://doi.org/10.1016/j.artmed.2019.101744
  • [2] Souza JC, Diniz JOB, Ferreira JL, da Silva GLF, Silva AC et al. An automatic method for lung segmentation and reconstruction in chest X-ray using deep neural networks. Computer methods and programs in biomedicine 2019; 177: 285-296. https://doi.org/10.1016/j.cmpb.2019.06.005
  • [3] Kvak D, Chromcová A, Biroš M, Hrubý R, Kvaková K et al. Chest x-ray abnormality detection by using artificial intelligence: A single-site retrospective study of deep learning model performance. BioMedInformatics 2023; 3 (1): 82-101. https://doi.org/10.3390/biomedinformatics3010006
  • [4] Torres-Mejía G, Smith RA, Carranza-Flores MDLL, Bogart A, Martínez-Matsushita L et al. Radiographers sup- porting radiologists in the interpretation of screening mammography: a viable strategy to meet the shortage in the number of radiologists. BMC cancer 2015; 15 (1): 1-12. https://doi.org/10.1186/s12885-015-1399-2
  • [5] Rahman MF, Zhuang Y, Tseng TLB, Pokojovy M, McCaffrey P et al. Improving lung region segmentation accuracy in chest X-ray images using a two-model deep learning ensemble approach. Journal of Visual Communication and Image Representation 2022; 85: 103521. https://doi.org/10.1016/j.jvcir.2022.103521
  • [6] Chowdary GJ, Kanhangad V. A Dual-Branch Network for Diagnosis of Thorax Diseases From Chest X-Rays. IEEE Journal of Biomedical and Health Informatics 2022; 26 (12): 6081-6092. https://doi.org/10.1109/JBHI.2022.3215694
  • [7] Alshmrani GMM, Ni Q, Jiang R, Pervaiz H, Elshennawy NM. A deep learning architecture for multi-class lung diseases classification using chest X-ray (CXR) images. Alexandria Engineering Journal 2023; 64: 923-935. https://doi.org/10.1016/j.aej.2022.10.053
  • [8] Singh A, Lall B, Panigrahi BK, Agrawal A, Agrawal A et al. Deep LF-Net: Semantic lung segmentation from Indian chest radiographs including severely unhealthy images. Biomedical Signal Processing and Control 2021; 68: 102666. https://doi.org/10.1016/j.bspc.2021.102666
  • [9] Peng T, Gu Y, Ye Z, Cheng X, Wang J. A-LugSeg: Automatic and explainability-guided multi- site lung detection in chest X-ray images. Expert Systems with Applications 2022; 198: 116873. https://doi.org/10.1016/j.eswa.2022.116873
  • [10] Peng T, Xu TC, Wang Y, Li F. Deep belief network and closed polygonal line for lung segmentation in chest radiographs. The Computer Journal 2022; 65 (5): 1107-1128. https://doi.org/10.1093/comjnl/bxaa148
  • [11] Saad MN, Muda Z, Ashaari NS, Hamid HA. Image segmentation for lung region in chest X-ray images using edge detection and morphology. In 2014 IEEE international conference on control system, computing and engineering (ICCSCE 2014); 46-51. https://doi.org/10.1109/ICCSCE.2014.7072687
  • [12] Xu T, Mandal M, Long R, Cheng I, Basu A. An edge-region force guided active shape approach for automatic lung field detection in chest radiographs. Computerized Medical Imaging and Graphics 2012; 36 (6): 452-463. https://doi.org/10.1016/j.compmedimag.2012.04.005
  • [13] Liu C, Zhao R, Pang M. Lung segmentation based on random forest and multi scale edge detection. IET Image Processing 2019; 13 (10): 1745-1754. https://doi.org/10.1049/iet-ipr.2019.0130
  • [14] Ahmad WSHM, Zaki WMD, Ahmad Fauzi MF. Lung segmentation on standard and mobile chest radiographs using oriented Gaussian derivatives filter. Biomedical engineering online 2015; 14: 1-26. https://doi.org/10.1186/s12938- 015-0014-8
  • [15] Sangamithraa PB, Govindaraju S. Lung tumour detection and classification using EK-Mean clustering. In 2016 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET) 2016; 2201- 2206. https://doi.org/10.1109/WiSPNET.2016.7566533
  • [16] Leader JK, Zheng B, Rogers RM, Sciurba FC, Perez A et al. Automated lung segmentation in X-ray computed tomography: development and evaluation of a heuristic threshold-based scheme1. Academic radiology 2003; 10 (11): 1224-1236. https://doi.org/10.1016/S1076-6332(03)00380-5
  • [17] Annangi P, Thiruvenkadam S, Raja A, Xu H, Sun X et al. A region based active contour method for x-ray lung segmentation using prior shape and low level features. In 2010 IEEE international symposium on biomedical imaging: from nano to macro 2010; 892-895. https://doi.org/10.1109/ISBI.2010.5490130
  • [18] Candemir S, Jaeger S, Palaniappan K, Musco JP, Singh RK et al. Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration. IEEE transactions on medical imaging 2013; 33 (2): 577-590. https://doi.org/10.1109/TMI.2013.2290491
  • [19] Öztürk Ş, Çelik E, Çukur T. Content-based medical image retrieval with opponent class adaptive margin loss. Information Sciences 2023; 637: 118938. https://doi.org/10.1016/j.ins.2023.118938
  • [20] Öztürk Ş, Çukur T. Deep clustering via center-oriented margin free-triplet loss for skin lesion detection in highly imbalanced datasets. IEEE Journal of Biomedical and Health Informatics 2022; 26 (9): 4679-4690. https://doi.org/10.1109/JBHI.2022.3187215
  • [21] Saidy L, Lee CC. Chest X-ray image segmentation using encoder-decoder convolutional network. In 2018 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW) 2018; 1-2. https://doi.org/10.1109/ICCE- China.2018.8448537
  • [22] Mittal A, Hooda R, Sofat S. LF-SegNet: A fully convolutional encoder–decoder network for segmenting lung fields from chest radiographs. Wireless Personal Communications 2018; 101: 511-529. https://doi.org/10.1007/s11277- 018-5702-9
  • [23] Rashid R, Akram MU, Hassan T. Fully convolutional neural network for lungs segmentation from chest X-rays. In Image Analysis and Recognition: 15th International Conference, ICIAR 2018; 71-80. https://doi.org/10.1007/978- 3-319-93000-8_9
  • [24] Hooda R, Mittal A, Sofat S. An efficient variant of fully-convolutional network for segmenting lung fields from chest radiographs. Wireless Personal Communications 2018; 101: 1559-1579. https://doi.org/10.1007/s11277-018-5777-3
  • [25] Nishio M, Fujimoto K, Togashi K. Lung segmentation on chest X ray images in patients with severe abnormal findings using deep learning. International Journal of Imaging Systems and Technology 2021; 31 (2): 1002-1008. https://doi.org/10.1002/ima.22528
  • [26] Rajaraman S, Folio LR, Dimperio J, Alderson PO, Antani SK. Improved semantic segmentation of tuberculosis— consistent findings in chest x-rays using augmented training of modality-specific u-net models with weak localiza- tions. Diagnostics 2021; 11 (4): 616. https://doi.org/10.3390/diagnostics11040616
  • [27] Abedalla A, Abdullah M, Al-Ayyoub M, Benkhelifa E. Chest X-ray pneumothorax segmentation using U-Net with EfficientNet and ResNet architectures. PeerJ Computer Science 2021; 7: e607. https://doi.org/10.7717/peerj-cs.607
  • [28] Munawar F, Azmat S, Iqbal T, Grönlund C, Ali H. Segmentation of lungs in chest X-ray image using generative adversarial networks. Ieee Access 2020; 8: 153535-153545. https://doi.org/10.1109/ACCESS.2020.3017915
  • [29] Chen C, Dou Q, Chen H, Heng PA. Semantic-aware generative adversarial nets for unsupervised domain adaptation in chest x-ray segmentation. In Machine Learning in Medical Imaging: 9th International Workshop, MLMI 2018; 143-151. https://doi.org/10.1007/978-3-030-00919-9_17
  • [30] Eslami M, Tabarestani S, Albarqouni S, Adeli E, Navab N et al. Image-to-images translation for multi-task organ segmentation and bone suppression in chest x-ray radiography. IEEE transactions on medical imaging 2020; 39 (7): 2553-2565. https://doi.org/10.1109/TMI.2020.2974159
  • [31] Chen Y, Zhang H, Wang Y, Liu L, Wu QJ et al. TAE-Seg: Generalized Lung Segmentation via Tilewise AutoEncoder Enhanced Network. IEEE Transactions on Instrumentation and Measurement 2022; 71: 1-13. https://doi.org/10.1109/TIM.2022.3217870
  • [32] Xie Y, Wu Z, Han X, Wang H, Wu Y et al. Computer-aided system for the detection of multicategory pulmonary tuberculosis in radiographs. Journal of Healthcare Engineering 2020. https://doi.org/10.1155/2020/9205082
  • [33] Gaggion N, Mansilla L, Mosquera C, Milone DH, Ferrante E. Improving anatomical plausibility in medical image segmentation via hybrid graph neural networks: applications to chest x-ray analysis. IEEE Transactions on Medical Imaging 2023; 42 (2): 546 - 556. https://doi.org/10.1109/TMI.2022.3224660
  • [34] Zhao H, Shi J, Qi X, Wang X, Jia J. Pyramid scene parsing network. In Proceedings of the IEEE conference on computer vision and pattern recognition 2017; 2881-2890. https://doi.org/10.1109/CVPR.2017.660
  • [35] De Silva MS, Narayanan BN, Hardie RC. A Patient-Specific Algorithm for Lung Segmentation in Chest Radiographs. AI 2022; 3 (4): 931-947. https://doi.org/10.3390/ai3040055
  • [36] Arora R, Saini I, Sood N. Multi-label segmentation and detection of COVID-19 abnormalities from chest radiographs using deep learning 2021. Optik; 246: 167780. https://doi.org/10.1016/j.ijleo.2021.167780
  • [37] Arvind S, Tembhurne JV, Diwan T, Sahare P. Improvised light weight deep CNN based U-Net for the semantic segmentation of lungs from chest X-rays. Results in Engineering 2023; 17: 100929. https://doi.org/10.1016/j.rineng.2023.100929
  • [38] Ghali R, Akhloufi MA. ARSeg: An Attention RegSeg Architecture for CXR Lung Segmentation. In 2022 IEEE 23rd International Conference on Information Reuse and Integration for Data Science; 291-296. https://doi.org/10.1109/IRI54793.2022.00068
  • [39] Zhang L, Liu A, Xiao J, Taylor P. Dual encoder fusion u-net (defu-net) for cross-manufacturer chest x-ray segmentation. In 2020 25th International Conference on Pattern Recognition, 9333-9339. https://doi.org/10.1109/ICPR48806.2021.9412718
  • [40] Cao F, Zhao H. Automatic lung segmentation algorithm on chest X-ray images based on fu- sion variational auto-encoder and three-terminal attention mechanism. Symmetry 2021; 13 (5): 814. https://doi.org/10.3390/sym13050814
  • [41] Dalmaz O, Yurt M, Çukur T. ResViT: residual vision transformers for multimodal medical image synthesis. IEEE Transactions on Medical Imaging 2022; 41 (10): 2598-2614. https://doi.org/10.1109/TMI.2022.3167808
  • [42] Chen J, Lu Y, Yu Q, Luo X, Adeli E et al. Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint 2021; arXiv:2102.04306.
  • [43] Chen B, Liu Y, Zhang Z, Lu G, Kong AWK. Transattunet: Multi-level attention-guided u-net with transformer for medical image segmentation. arXiv preprint 2021; arXiv:2107.05274.
  • [44] Huang X, Chen J, Chen M, Chen L, Wan Y. TDD-UNet: Transformer with double decoder UNet for COVID-19 lesions segmentation. Computers in Biology and Medicine 2022; 151: 106306. https://doi.org/10.1016/j.compbiomed.2022.106306
  • [45] Yang J, Li C, Dai X, Gao J. Focal modulation networks. Advances in Neural Information Processing Systems 2022; 35: 4203-4217.
  • [46] Yang J, Li C, Zhang P, Dai X, Xiao B et al. Focal self-attention for local-global interactions in vision transformers. arXiv preprint 2021; arXiv:2107.00641.
  • [47] Shiraishi J, Katsuragawa S, Ikezoe J, Matsumoto T, Kobayashi T et al. Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists’ detection of pulmonary nodules. American Journal of Roentgenology 2000; 174 (1): 71-74. https://doi.org/10.2214/ajr.174.1.1740071
  • [48] Jaeger S, Candemir S, Antani S, Wáng YXJ, Lu PX et al. Two public chest X-ray datasets for computer- aided screening of pulmonary diseases. Quantitative imaging in medicine and surgery 2014; 4 (6): 475. https://doi.org/10.3978/j.issn.2223-4292.2014.11.20
  • [49] Öztürk Ş. Image inpainting based compact hash code learning using modified U-Net. In 2020 4th In- ternational Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT) 2020; 1-5. https://doi.org/10.1109/ISMSIT50672.2020.9255239
  • [50] Yahyatabar M, Jouvet P, Cheriet F. DenseUnet a light model for lung fields segmentation in Chest X-Ray images. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society; 1242-1245. https://doi.org/10.1109/EMBC44109.2020.9176033
  • [51] Liu W, Luo J, Yang Y, Wang W, Deng J et al. Automatic lung segmentation in chest X-ray images using improved U-Net. Scientific Reports 2022; 12 (1): 8649. https://doi.org/10.1038/s41598-022-12743-y
  • [52] Mansilla L, Milone DH, Ferrante E. Learning deformable registration of medical images with anatomical constraints. Neural Networks 2020; 124: 269-279. https://doi.org/10.1016/j.neunet.2020.01.023
  • [53] Özbey M, Dar SU, Bedel HA, Dalmaz O, Özturk Ş et al. Unsupervised medical image translation with adversarial diffusion models. arXiv preprint 2022; arXiv:2207.08208.
  • [54] Dar SU, Öztürk Ş, Korkmaz Y, Elmas G, Özbey M et al. Adaptive diffusion priors for accelerated mri reconstruction. arXiv preprint 2022; arXiv:2207.05876.
APA ÖZTÜRK Ş, Çukur T (2023). Focal modulation network for lung segmentation in chest X-ray images. , 1006 - 1020. 10.55730/1300-0632.4031
Chicago ÖZTÜRK Şaban,Çukur Tolga Focal modulation network for lung segmentation in chest X-ray images. (2023): 1006 - 1020. 10.55730/1300-0632.4031
MLA ÖZTÜRK Şaban,Çukur Tolga Focal modulation network for lung segmentation in chest X-ray images. , 2023, ss.1006 - 1020. 10.55730/1300-0632.4031
AMA ÖZTÜRK Ş,Çukur T Focal modulation network for lung segmentation in chest X-ray images. . 2023; 1006 - 1020. 10.55730/1300-0632.4031
Vancouver ÖZTÜRK Ş,Çukur T Focal modulation network for lung segmentation in chest X-ray images. . 2023; 1006 - 1020. 10.55730/1300-0632.4031
IEEE ÖZTÜRK Ş,Çukur T "Focal modulation network for lung segmentation in chest X-ray images." , ss.1006 - 1020, 2023. 10.55730/1300-0632.4031
ISNAD ÖZTÜRK, Şaban - Çukur, Tolga. "Focal modulation network for lung segmentation in chest X-ray images". (2023), 1006-1020. https://doi.org/10.55730/1300-0632.4031
APA ÖZTÜRK Ş, Çukur T (2023). Focal modulation network for lung segmentation in chest X-ray images. Turkish Journal of Electrical Engineering and Computer Sciences, 31(SI-1 (6)), 1006 - 1020. 10.55730/1300-0632.4031
Chicago ÖZTÜRK Şaban,Çukur Tolga Focal modulation network for lung segmentation in chest X-ray images. Turkish Journal of Electrical Engineering and Computer Sciences 31, no.SI-1 (6) (2023): 1006 - 1020. 10.55730/1300-0632.4031
MLA ÖZTÜRK Şaban,Çukur Tolga Focal modulation network for lung segmentation in chest X-ray images. Turkish Journal of Electrical Engineering and Computer Sciences, vol.31, no.SI-1 (6), 2023, ss.1006 - 1020. 10.55730/1300-0632.4031
AMA ÖZTÜRK Ş,Çukur T Focal modulation network for lung segmentation in chest X-ray images. Turkish Journal of Electrical Engineering and Computer Sciences. 2023; 31(SI-1 (6)): 1006 - 1020. 10.55730/1300-0632.4031
Vancouver ÖZTÜRK Ş,Çukur T Focal modulation network for lung segmentation in chest X-ray images. Turkish Journal of Electrical Engineering and Computer Sciences. 2023; 31(SI-1 (6)): 1006 - 1020. 10.55730/1300-0632.4031
IEEE ÖZTÜRK Ş,Çukur T "Focal modulation network for lung segmentation in chest X-ray images." Turkish Journal of Electrical Engineering and Computer Sciences, 31, ss.1006 - 1020, 2023. 10.55730/1300-0632.4031
ISNAD ÖZTÜRK, Şaban - Çukur, Tolga. "Focal modulation network for lung segmentation in chest X-ray images". Turkish Journal of Electrical Engineering and Computer Sciences 31/SI-1 (6) (2023), 1006-1020. https://doi.org/10.55730/1300-0632.4031