Yıl: 2021 Cilt: 29 Sayı: 4 Sayfa Aralığı: 2154 - 2169 Metin Dili: İngilizce DOI: 10.3906/elk-2009-126 İndeks Tarihi: 24-06-2022

A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination

Öz:
Due to the limitations of the light microscopic system such as limited depth of field and narrow field of view, entire sample areas are invisible and pathologists move the light microscope stage along the X - Y - Z axes with eye-hand coordination. In order to reduce the dependence on the pathologist and to allow whole sample areas to be examined in a short time without any control (without eye-hand coordination), this study creates 2D & 3D panoramic images with wide-view of sample in the light microscopic systems. According to our literature research, there is no study that creates 2D & 3D panoramic images in the microscopic system together. For this reason, it is thought that our study, which is the first one in which 2D & 3D panoramic images are created together in the light microscopic system, will be one of the pioneering studies in this field. Literature studies generally utilize specific microscope types such as laser, stereo and confocal, where 3D shape of the sample is extracted automatically and only 2D & 3D microscopic image stitching techniques are performed. Unlike these studies, due to the use of the light microscope which is requires a procedure to extract the 3D structure of the sample, this study contains an extra phase which creates 2D & 3D adjacent images using series of multi-focus 2D adjacent images before 2D & 3D microscopic image stitching technique. Moreover, a hybrid 2D & 3D microscopic image stitching technique which uses modified ıterative closest point algorithm and combines the stages of 2D and 3D image-based 2D & 3D image stitching techniques is developed in this study. Both qualitative and quantitative evaluations of the proposed study are performed on real microscope image data sets from samples prepared for cytopathologic examination in the light microscopic system. Our hybrid technique creates 2D panoramic images whose values of peak signal to noise ratio (PSNR), correlation coefficient (CC), entropy and average gradient are computed respectively as 30.4267, 0.9997, 7.4670 and 122.2510 and 3D panoramic images whose values of PSNR, universal quality index, root mean square error, CC, kurtosis metric and standard deviation are computed respectively as 17.7458, 0.9702, 8.9230, 0.8702, 5.4981 and 31.006, which are the best values when compared with well-established studies. Moreover, the proposed hybrid technique with 9.8403 and 23.5902 (s) execution times accelerates the process of automatic 2D & 3D panoramic imaging.
Anahtar Kelime:

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Thévenaz P, Unser M. User‐friendly semiautomated assembly of accurate image mosaics in microscopy. Microscopy Research and Technique 2007; 70 (2): 135-146. doi: 10.1002/jemt.20393
  • [2] Ma B, Zimmermann T, Rohde M, Winkelbach S, He F et al. Use of autostitch for automatic stitching of microscope images. Micron 2007; 38 (5): 492-499. doi: 10.1016/j.micron.2006.07.027
  • [3] Piccinini F, Bevilacqua A, Lucarelli E. Automated image mosaics by non‐automated light microscopes: the MicroMos software tool. Journal of Microscopy 2013; 252 (3): 226-250. doi: 10.1111/jmi.12084
  • [4] Dogan H, Ekinci M. Automatic panorama with auto-focusing based on image fusion for microscopic imaging system. Signal, Image and Video Processing 2014; 8 (1): 5-20. doi: 10.1007/s11760-014-0717-5
  • [5] Legesse FB, Chernavskaia O, Heuke S, Bocklitz T, Meyer T et al.. Seamless stitching of tile scan microscope images. Journal of Microscopy 2015; 258 (3): 223-232. doi: 10.1111/jmi.12236
  • [6] Wei L, Zhou S, Dong H, Mao Q, Lin J et al. The plant virus microscope image registration method based on mismatches removing. Micron 2016; 80: 90-95. doi: 10.1016/j.micron.2015.10.002
  • [7] Chernavskaia O, Guo S, Meyer T, Vogler N, Akimov D et al. Correction of mosaicking artifacts in multimodal images caused by uneven illumination. Journal of Chemometrics 2017; 31 (6): e2901. doi: 10.1002/cem.2901
  • [8] Seo JH, Yang S, Kang MS, Her NG, Nam DH et al. Automated stitching of microscope images of fluorescence in cells with minimal overlap. Micron 2019; 126: 102718. doi: 10.1016/j.micron.2019.102718
  • [9] Pang M, Chen Z, Liu S. Scale invariant feature transform gauss mosaic method for blood cell microscopic images. Journal of Medical Imaging and Health Informatics 2019; 9 (1): 134-139. doi: 10.1166/jmihi.2019.2551
  • [10] Ortuño JE, Lin L, del Pilar Ortega M, García-Villena J et al. Stitching methodology for whole slide low-cost robotic microscope based on a smartphone. In: 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI); Iowa City, IA, USA; 2020. pp. 503-507.
  • [11] Li Z, Yin Y. IC microscopic ımage stitching based on ımproved line matching. Journal of Physics: Conference Series 2020; 1607 (1): 012069. doi: 10.1088/1742-6596/1607/1/012069
  • [12] Hast A, Sablina VA, Sintorn IM, Kylberg G. A fast fourier based feature descriptor and a cascade nearest neighbour search with an efficient matching pipeline for mosaicing of microscopy images. Pattern Recognition and Image Analysis 2018; 28 (2): 261-272. doi: 10.1134/S1054661818020050
  • [13] Yang F, Deng ZS, Fan QH. A method for fast automated microscope image stitching. Micron 2013; 48: 17-25. doi: 10.1016/j.micron.2013.01.006
  • [14] Lu Y, Gao Q, Chen S, Sun D, Xia Y et al. Fast implementation of image mosaicing on gpu. In: 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI); Shanghai, China; 2017. pp. 1-5.
  • [15] Ma B, Ban X, Huang H, Liu W, Liu C et al. A fast algorithm for material image sequential stitching. Computational Materials Science 2019; 158: 1-13. doi: 10.1016/j.commatsci.2018.10.044
  • [16] Baik JW, Kim JY, Cho S, Choi S, Kim J et al. Super wide-field photoacoustic microscopy of animals and humans in vivo. IEEE Transactions on Medical Imaging 2019; 39 (4): 975-984. doi: 10.1109/TMI.2019.2938518
  • [17] Voleti V, Patel KB, Li W, Campos CP, Bharadwaj S et al. Real-time volumetric microscopy of in vivo dynamics and large-scale samples with scape 2.0. Nature methods 2019; 16 (10): 1054-1062. doi: 10.1038/s41592-019-0579-4
  • [18] Gurkan G, Gurkan K. Incu-Stream 1.0: An open-hardware live-cell ımaging system based on ınverted bright-field microscopy and automated mechanical scanning for real-time and long-term ımaging of microplates in ıncubator. IEEE Access 2019; 7: 58764-58779. doi: 10.1109/ACCESS.2019.2914958
  • [19] Bowditch E, Kadonosono K, Chang A. Heads-up microscope systems in vitreoretinal surgery. Macular Surgery 2020; 179-188. doi: 10.1007/978-981-15-7644-7_13
  • [20] Emmenlauer M, Ronneberger O, Ponti A, Schwarb P et al. XuvTools: free, fast and reliable stitching of large 3D datasets. Journal of Microscopy 2009; 233 (1): 42-60. doi: 10.1111/j.1365-2818.2008.03094.x
  • [21] Preibisch S, Saalfeld S, Tomancak P. Globally optimal stitching of tiled 3D microscopic image acquisitions. Bioinformatics 2009; 25 (11): 1463-1465. doi: 10.1093/bioinformatics/btp184
  • [22] Bria A, Iannello G. TeraStitcher a tool for fast automatic 3D stitching of teravoxel-sized microscopy images. BMC Bioinformatics 2012; 13 (1): 1-15. doi: 10.1186/1471-2105-13-316
  • [23] Chalfoun J, Majurski M, Blattner T, Keyrouz W, Bajcsy P et al. Mist: accurate and scalable microscopy image stitching tool with stage modeling and error minimization. Scientific Reports 2017; 7 (1): 1-10. doi: 10.1038/s41598- 017-04567-y
  • [24] Millis BA, Tyska MJ. High-resolution image stitching as a tool to assess tissue-level protein distribution and localization. Molecular Profiling 2017; 1606: 281-296. doi: 10.1007/978-1-4939-6990-6_18
  • [25] Ye W, Yu K, Yu Y, Li J. Logical stitching: A panoramic image stitching method based on color calibration box. In: 2018 14th IEEE International Conference on Signal Processing (ICSP); Beijing, China; 2018. pp. 1139-1143.
  • [26] Horl D, Rusak FR, Preusser F et al. Bigstitcher: reconstructing high-resolution image datasets of cleared and expanded samples. Nature Methods 2019; 16 (9): 870-874. doi: 10.1038/s41592-019-0501-0
  • [27] Berman A, Quek F. ThingiPano: a large-scale dataset of 3d printing metadata, ımages, and panoramic renderings for exploring design reuse. In: 2020 IEEE Sixth International Conference on Multimedia Big Data (BigMM); New Delhi, India; 2020. pp. 18-27.
  • [28] Yanny K, Antipa N, Liberti W et al. Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy. Light: Science Applications 2020; 9 (1): 1-13. doi: 10.1038/s41377-020-00403-7
  • [29] Gledhill D, Tian GY, Taylor D, Clarke D. Panoramic imaging — a review. Computers & Graphics 2003; 27 (3): 435-445. doi:10.1016/S0097-8493(03)00038-4
  • [30] Chen Y, Medioni G. Object modelling by registration of multiple range images. Image and Vision Computing 1992; 10 (3): 145-155. doi: 10.1016/0262-8856(92)90066-C
  • [31] Dogan H, Baykal E, Ercin ME, Ersoz S, Ekinci M. A novel 2d and 3d wide-view imaging approach by controlling optimal range for cytopathological analysis in light microscopic system. Optics Communications 2019; 430: 39-50. doi: 10.1016/j.optcom.2018.08.032
APA Dogan H, Baykal Kablan E, EKINCI M, Ercin M, Ersoz S (2021). A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. , 2154 - 2169. 10.3906/elk-2009-126
Chicago Dogan Hulya,Baykal Kablan Elif,EKINCI MURAT,Ercin Mustafa Emre,Ersoz Safak A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. (2021): 2154 - 2169. 10.3906/elk-2009-126
MLA Dogan Hulya,Baykal Kablan Elif,EKINCI MURAT,Ercin Mustafa Emre,Ersoz Safak A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. , 2021, ss.2154 - 2169. 10.3906/elk-2009-126
AMA Dogan H,Baykal Kablan E,EKINCI M,Ercin M,Ersoz S A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. . 2021; 2154 - 2169. 10.3906/elk-2009-126
Vancouver Dogan H,Baykal Kablan E,EKINCI M,Ercin M,Ersoz S A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. . 2021; 2154 - 2169. 10.3906/elk-2009-126
IEEE Dogan H,Baykal Kablan E,EKINCI M,Ercin M,Ersoz S "A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination." , ss.2154 - 2169, 2021. 10.3906/elk-2009-126
ISNAD Dogan, Hulya vd. "A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination". (2021), 2154-2169. https://doi.org/10.3906/elk-2009-126
APA Dogan H, Baykal Kablan E, EKINCI M, Ercin M, Ersoz S (2021). A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. Turkish Journal of Electrical Engineering and Computer Sciences, 29(4), 2154 - 2169. 10.3906/elk-2009-126
Chicago Dogan Hulya,Baykal Kablan Elif,EKINCI MURAT,Ercin Mustafa Emre,Ersoz Safak A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. Turkish Journal of Electrical Engineering and Computer Sciences 29, no.4 (2021): 2154 - 2169. 10.3906/elk-2009-126
MLA Dogan Hulya,Baykal Kablan Elif,EKINCI MURAT,Ercin Mustafa Emre,Ersoz Safak A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. Turkish Journal of Electrical Engineering and Computer Sciences, vol.29, no.4, 2021, ss.2154 - 2169. 10.3906/elk-2009-126
AMA Dogan H,Baykal Kablan E,EKINCI M,Ercin M,Ersoz S A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. Turkish Journal of Electrical Engineering and Computer Sciences. 2021; 29(4): 2154 - 2169. 10.3906/elk-2009-126
Vancouver Dogan H,Baykal Kablan E,EKINCI M,Ercin M,Ersoz S A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination. Turkish Journal of Electrical Engineering and Computer Sciences. 2021; 29(4): 2154 - 2169. 10.3906/elk-2009-126
IEEE Dogan H,Baykal Kablan E,EKINCI M,Ercin M,Ersoz S "A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination." Turkish Journal of Electrical Engineering and Computer Sciences, 29, ss.2154 - 2169, 2021. 10.3906/elk-2009-126
ISNAD Dogan, Hulya vd. "A hybrid technique using modified ICP algorithm for faster and automatic 2D & 3D microscopic image stitching in cytopathologic examination". Turkish Journal of Electrical Engineering and Computer Sciences 29/4 (2021), 2154-2169. https://doi.org/10.3906/elk-2009-126