Yıl: 2023 Cilt: 31 Sayı: 2 Sayfa Aralığı: 381 - 395 Metin Dili: İngilizce DOI: 10.55730/1300-0632.3990 İndeks Tarihi: 12-06-2023

3D point cloud classification with ACGAN-3D and VACWGAN-GP

Öz:
Machine learning and deep learning techniques are widely used to make sense of 3D point cloud data which became ubiquitous and important due to the recent advances in 3D scanning technologies and other sensors. In this work, we propose two networks to predict the class of the input 3D point cloud: 3D Auxiliary Classifier Generative Adversarial Network (ACGAN-3D) and Versatile Auxiliary Conditional Wasserstein Generative Adversarial Network with Gradient Penalty (VACWGAN-GP). Unlike other classifiers, we are able to enlarge the limited data set with the data produced by generative models. We consequently aim to increase the success of the model by training it with more data. As suggested by the conventional ACGAN models, in addition to the real dataset, we train the Discriminator with synthetic data generated by the Generator using the class label. By doing so, we ensure that Discriminator can discriminate between the real data and the synthetic data. Thus, as the training evolves, the Generator is trained to produce more realistic synthetic data, which in turn forces Discriminator to classify or discriminate better. Defined originally on 2D images, our ACGAN-3D modifies this conventional ACGAN model in order to classify 3D point clouds by updating the neural network layers. Our second model VACWGAN-GP, on the other hand, demonstrates similar abilities with more stable training by replacing its Discriminator with Critic and by modifying its loss function. In this model, we managed to merge Wasserstein GAN-GP with conditional GAN in order to improve the classifier’s performance. The proposed models ACGAN-3D and VACWGAN-GP were tested extensively on 3D datasets and comparisons with the other state-of-the-art studies have revealed our clear advantages on various aspects. While ACGAN-3D can be preferred with its compact design, our second method VACWGAN-GP stands out for higher performance.
Anahtar Kelime: Deep learning GAN CGAN ACGAN Wasserstein GAN Wasserstein GAN-GP 3D object classification

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık
  • [1] Nguyen A, Le B. 3D point cloud segmentation: A survey. 6th IEEE conference on robotics, automation and mechatronics 2013; 225-230.
  • [2] Hang S, Subhransu M, Kalogerakis E, Learned-Miller E. Multi-view convolutional neural networks for 3d shape recognition. Proc. IEEE International Conference on Computer Vision 2015; 945-953.
  • [3] Charles Q, Hao S, Mo K, Guibas L. Pointnet: Deep learning on point sets for 3d classification and segmentation. Proc. IEEE Computer Vision and Pattern Recognition 2017; 652-660.
  • [4] Zhirong W, Song S, Khosla A, Yu F, Zhang L et al. 3d shapenets: A deep representation for volumetric shapes. Proc. IEEE Computer Vision and Pattern Recognition 2015; 1912-1920.
  • [5] Zhizhong H, Liu Z, Han J, Vong C-M, Bu S et al. Unsupervised 3D local feature learning by circle convolutional restricted Boltzmann machine. IEEE Transactions on Image Processing 2016; 25 (11): 5331-5344.
  • [6] Zhou Y, Tuzel O. Voxelnet: End-to-end learning for point cloud based 3d object detection. Proc. IEEE conference on computer vision and pattern recognition 2018; 4490-4499.
  • [7] Caltagirone L, Scheidegger S, Svensson L, Wahde M. Fast LIDAR-based road detection using fully convolutional neural networks. IEEE intelligent vehicles symposium 2017; 1019-1024.
  • [8] Abbasi A, Kalkan S, Sahillioğlu Y. Deep 3D semantic scene extrapolation. The Visual Computer 2019; 35 (2):271– 279.
  • [9] Kim E, Medioni G. Urban scene understanding from aerial and ground LIDAR data. Machine Vision and Applica- tions 2011; 22 (4):691-703.
  • [10] Gulrajani I, Ahmed F, Arjovsky M, Dumoulin V, Courville C. Improved training of wasserstein gans. Advances in neural information processing systems 2017; 30.
  • [11] Odena A, Olah C, Shlens J. Conditional image synthesis with auxiliary classifier gans. International conference on machine learning 2017; 2642-2651.
  • [12] Özbay E, Çınar A, Güler Z. Structured Deep Learning Supported with Point Cloud for 3D Human Pose Estimation. Proceedings of the 1st International Symposium on Multidisciplinary Studies and Innovative Technologies 2017, 2-4.
  • [13] Özbay E, Cinar A. A Comparative Study of Object Classification Methods Using 3D Zernike Moment on 3D Point Clouds. Traitement du Signal 2019; 36 (6):549-555.
  • [14] Qi C, Yi L, Su H, Guibas L. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in neural information processing systems 2017; 30.
  • [15] Song W, Liu Z, Tian Y, Fong S. Pointwise CNN for 3D Object Classification on Point Cloud. Journal of Information Processing Systems 2021; 17 (4):787-800.
  • [16] Yao X, Guo J, Hu J, Cao Q. Using deep learning in semantic classification for point cloud data. IEEE Access 2019; 7:37121-37130.
  • [17] Maturana D, Scherer S. Voxnet: A 3d convolutional neural network for real-time object recognition. IEEE/RSJ International Conference on Intelligent Robots and Systems 2015; 922–928.
  • [18] Shi B, Bai S, Zhou Z, Bai X. Deeppano: Deep panoramic representation for 3-d shape recognition. IEEE Signal Processing Letters 2015; 22 (12):2339-2343.
  • [19] Kumawat S, Raman S. Lp-3dcnn: Unveiling local phase in 3d convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2019; 4903-4912.
  • [20] Khan S, Guo Y, Hayat M, Barnes N. Unsupervised primitive discovery for improved 3D generative modeling. Proc. IEEE Computer Vision and Pattern Recognition 2019; 9739-9748.
  • [21] Misra I, Girdhar R, Joulin A. An end-to-end transformer model for 3d object detection. Proceedings of the IEEE International Conference on Computer Vision 2021; 2906-2917;.
  • [22] Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L et al. Attention is all you need. Advances in neural information processing systems 2017; 30.
  • [23] Lu D, Xie Q, Gao K, Xu L, Li J. 3DCTN: 3D convolution-transformer network for point cloud classification. IEEE Transactions on Intelligent Transportation Systems 2022.
  • [24] Yuan W, Held D, Mertz C, Hebert M. Iterative transformer network for 3d point cloud. arXiv preprint arXiv:1811.11209 2018.
  • [25] Zhang J, Chen L, Ouyang B, Liu B, Zhu J et al. Pointcutmix: Regularization strategy for point cloud classification. Neurocomputing 2022; 505:58-67.
  • [26] Gschwandtner M, Kwitt R, Uhl A, Pree W. BlenSor: Blender sensor simulation toolbox. International Symposium on Visual Computing 2011; 199-208.
  • [27] Sahillioğlu Y. Recent advances in shape correspondence. The Visual Computer 2020; 36 (8):1705-1721.
  • [28] Afham M, Dissanayake I, Dissanayake D, Dharmasiri A, Thilakarathna K et al. Crosspoint: Self-supervised cross- modal contrastive learning for 3d point cloud understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2022; 9902-9912.
  • [29] Liu Y, Li Z, Zhou C, Jiang Y, Sun J et al. Generative adversarial active learning for unsupervised outlier detection. IEEE Transactions on Knowledge and Data Engineering 2019; 32 (8):1517-1528.
  • [30] White T. Sampling generative networks. arXiv preprint arXiv:1609.04468 2016.
  • [31] Sahillioğlu Y, Sezgin M. Sketch-based articulated 3d shape retrieval. IEEE computer graphics and applications 2017; 37 (6):88-101.
  • [32] Sahillioğlu Y, Kavan L. Detail-preserving mesh unfolding for nonrigid shape retrieval. ACM Transactions on Graphics 2016; 35 (3):1-11.
APA ERGÜN O, SAHİLLİOĞLU Y (2023). 3D point cloud classification with ACGAN-3D and VACWGAN-GP. , 381 - 395. 10.55730/1300-0632.3990
Chicago ERGÜN Onur,SAHİLLİOĞLU Yusuf 3D point cloud classification with ACGAN-3D and VACWGAN-GP. (2023): 381 - 395. 10.55730/1300-0632.3990
MLA ERGÜN Onur,SAHİLLİOĞLU Yusuf 3D point cloud classification with ACGAN-3D and VACWGAN-GP. , 2023, ss.381 - 395. 10.55730/1300-0632.3990
AMA ERGÜN O,SAHİLLİOĞLU Y 3D point cloud classification with ACGAN-3D and VACWGAN-GP. . 2023; 381 - 395. 10.55730/1300-0632.3990
Vancouver ERGÜN O,SAHİLLİOĞLU Y 3D point cloud classification with ACGAN-3D and VACWGAN-GP. . 2023; 381 - 395. 10.55730/1300-0632.3990
IEEE ERGÜN O,SAHİLLİOĞLU Y "3D point cloud classification with ACGAN-3D and VACWGAN-GP." , ss.381 - 395, 2023. 10.55730/1300-0632.3990
ISNAD ERGÜN, Onur - SAHİLLİOĞLU, Yusuf. "3D point cloud classification with ACGAN-3D and VACWGAN-GP". (2023), 381-395. https://doi.org/10.55730/1300-0632.3990
APA ERGÜN O, SAHİLLİOĞLU Y (2023). 3D point cloud classification with ACGAN-3D and VACWGAN-GP. Turkish Journal of Electrical Engineering and Computer Sciences, 31(2), 381 - 395. 10.55730/1300-0632.3990
Chicago ERGÜN Onur,SAHİLLİOĞLU Yusuf 3D point cloud classification with ACGAN-3D and VACWGAN-GP. Turkish Journal of Electrical Engineering and Computer Sciences 31, no.2 (2023): 381 - 395. 10.55730/1300-0632.3990
MLA ERGÜN Onur,SAHİLLİOĞLU Yusuf 3D point cloud classification with ACGAN-3D and VACWGAN-GP. Turkish Journal of Electrical Engineering and Computer Sciences, vol.31, no.2, 2023, ss.381 - 395. 10.55730/1300-0632.3990
AMA ERGÜN O,SAHİLLİOĞLU Y 3D point cloud classification with ACGAN-3D and VACWGAN-GP. Turkish Journal of Electrical Engineering and Computer Sciences. 2023; 31(2): 381 - 395. 10.55730/1300-0632.3990
Vancouver ERGÜN O,SAHİLLİOĞLU Y 3D point cloud classification with ACGAN-3D and VACWGAN-GP. Turkish Journal of Electrical Engineering and Computer Sciences. 2023; 31(2): 381 - 395. 10.55730/1300-0632.3990
IEEE ERGÜN O,SAHİLLİOĞLU Y "3D point cloud classification with ACGAN-3D and VACWGAN-GP." Turkish Journal of Electrical Engineering and Computer Sciences, 31, ss.381 - 395, 2023. 10.55730/1300-0632.3990
ISNAD ERGÜN, Onur - SAHİLLİOĞLU, Yusuf. "3D point cloud classification with ACGAN-3D and VACWGAN-GP". Turkish Journal of Electrical Engineering and Computer Sciences 31/2 (2023), 381-395. https://doi.org/10.55730/1300-0632.3990