Gender Detection Via Voice Using Artificial Intelligence Algorithms

Serkan GÖNEN, (İstanbul Gelişim Üniversitesi, Bilgisayar Mühendisliği Bölümü, 34310, İstanbul, Türkiye)
Mehmet Ali BARIŞKAN, (İstanbul Gelişim Üniversitesi, Bilgisayar Mühendisliği Bölümü, 34310, İstanbul, Türkiye)
Gökçe KARACAYILMAZ, (Hacettepe Üniversitesi, Enstitü Bilim ve Mühendislik, Bilgisayar Mühendisliği Bölümü, 06532, Ankara, Türkiye)
Birkan ALHAN, (İstanbul Gelişim Üniversitesi, Bilgisayar Mühendisliği Bölümü, 34310, İstanbul, Türkiye)
Ercan Nurcan YILMAZ, (Gazi Üniversitesi, Teknoloji Fakültesi, Elektrik Bölümü ve Elektronik Mühendisliği, 06560, Ankara, Türkiye)
Harun ARTUNER (Hacettepe Üniversitesi, Bilgisayar Mühendisliği, 06532, Ankara, Türkiye)
Gazi Mühendislik Bilimleri Dergisi
8 0
Yıl: 2022 Cilt: 8 Sayı: 3 Sayfa Aralığı: 567 - 575 Metin Dili: İngilizce DOI: 10.30855/gmbd.0705043 İndeks Tarihi: 06-09-2023

Gender Detection Via Voice Using Artificial Intelligence Algorithms

Öz:
As a result of the developments in science and technology, all our living spaces, from health, education, and trade to our social life, have been moved to the digital environment. With this process, artificial intelligence, which is the ultimate goal of creating systems that think and act like human beings, has started to be used in all areas of our lives. This study focuses on gender determination by using artificial intelligence algorithms on voice data. Thanks to this determination, significant contributions will be made in various fields such as social engineering and cyber security such as fraud, person detection, and advertising investments. The study used a completely open-source R application for various artificial intelligence algorithms. In this way, a solution has been provided to take the security as mentioned above measures with low cost instead of high-cost systems and increase the sales figures in areas such as marketing. In the study, supervised learning artificial intelligence algorithms were examined. The artificial intelligence analysis results of the study have shown that the gender of the person could be determined at very successful rates through the voice data.
Anahtar Kelime: Artificial Intelligence Gender Recognition Cyber Security Voice Analysis Feature Extraction Supervised Learning Gradient Boosting Machine

Yapay Zeka Algoritmaları Kullanılarak Sesle Cinsiyet Tespiti

Öz:
Bilim ve teknolojideki gelişmeler sonucunda sağlıktan eğitime, ticaretten sosyal hayatımıza kadar tüm yaşam alanlarımız dijital ortama taşınmıştır. Bu süreçle birlikte insan gibi düşünen ve hareket eden sistemler oluşturmak amacıyla geliştirilmiş yapay zeka kavramı da hayatımızın her alanında kullanılmaya başlanmıştır. Bu çalışmada, yapay zeka algoritmaları kullanılarak ses verilerinin incelenmesiyle cinsiyet belirlemeyi hedefleyen bir algoritma geliştirilmiştir. Cinsiyet tespitine yönelik olarak yapılan Bu tespit sayesinde sosyal mühendislik gibi çeşitli alanlarda ve dolandırıcılık, kişi tespiti, reklam yatırımları gibi siber güvenlik alanlarında önemli katkılar sağlanması hedeflenmiştir. Uygulama geliştirilirken, çeşitli yapay zeka algoritmaları için tamamen açık kaynak kodlu R yazılımı kullanılmıştır. Bu sayede yukarıda bahsedilen güvenlik önlemlerinin yüksek maliyetli sistemler yerine düşük maliyetli önlemler alınmasına ve pazarlama gibi alanlarda satış rakamlarının artırılmasına çözüm aranmıştır. Ayrıca çalışmada yapay zeka algoritması olarak denetimli öğrenme kullanılmıştır. Çalışmanın yapay zeka analiz sonuçları, ses verileri aracılığıyla kişinin cinsiyetinin çok başarılı oranlarda belirlenebildiğini göstermiştir.
Anahtar Kelime: Yapay Zeka Cinsiyet Tanıma Siber Güvenlik Ses Analizi Özellik Çıkarma Denetimli Öğrenme Gradyan Artırma Makinesi

Belge Türü: Makale Makale Türü: Konferans Bildirisi Erişim Türü: Erişime Açık
  • [1] A. Ross, S. Banerjee, and A. Chowdhury, "Security in smart cities: A brief review of digital forensic schemes for biometric data," Pattern Recognition Letters, vol. 138, pp. 346-354, 2020. doi:10.1016/j.patrec.2020.07.009
  • [2] M. A. Ferrag, L. Maglaras, A. Derhab, and H. Janicke, "Authentication schemes for smart mobile devices: Threat models, countermeasures, and open research issues," Telecommunication Systems, vol. 73, no. 2, pp. 317-348, 2020. doi:10.1007/s11235- 019-00612-5
  • [3] A. Abozaid, A. Haggag, H. Kasban, and M. Eltokhy, "Multimodal biometric scheme for human authentication technique based on voice and face recognition fusion." Multimedia tools and applications, vol. 78, no. 12, pp. 16345-16361, 2019. doi:10.1007/s11042-018-7012-3
  • [4] S. Tanwar, M. S. Obaidat, S. Tyagi, and N. Kumar, "Online signature-based biometric recognition," in Biometric-based physical and cybersecurity systems: Springer, pp. 255-285. 2019. doi:10.1007/978-3-319-98734-7_10
  • [5] C. Chen, W. Wang, Y. He, & J. Han, “A bilevel framework for joint optimization of session compensation and classification for speaker identification.” Digital Signal Processing, 89, 104-115, 2019. doi:10.1016/j.dsp.2019.03.008
  • [6] Z. Qawaqneh, A. A. Mallouh, & B. D. Barkana, “Deep neural network framework and transformed MFCCs for speaker's age and gender classification,” Knowledge-Based Systems, vol. 115, pp. 5-14, 2017. doi:10.1016/j.knosys.2016.10.008
  • [7] J. Chu, “Artificial intelligence model detects asymptomatic Covid-19 infections through cellphone-recorded coughs,” 2020. [Online]. Available: https://news. mit. edu/2020/covid-19-cough-cellphone-detection [Access Date: 08.04. 2022].
  • [8] P. Gupta, S. Goel, and A. Purwar, "A stacked technique for gender recognition through voice," in 2018 Eleventh International Conference on Contemporary Computing (IC3), Noida, India, 2018. pp. 1-3. doi:10.1109/IC3.2018.8530520
  • [9] F. Ertam, "An effective gender recognition approach using voice data via deeper LSTM networks," Applied Acoustics, vol. 156, pp. 351-358, 2019. doi:10.1016/j.apacoust.2019.07.033
  • [10] M. Buyukyilmaz and A. O. Cibikdiken, "Voice gender recognition using deep learning," in 2016 International Conference on Modeling, Simulation and Optimization Technologies and Applications (MSOTA2016), Xiamen, China, Dec. 18-19, 2016, Atlantis Press, 2016. pp. 409-411, 2016,. doi: 10.2991/msota-16.2016.90
  • [11] M. Li, C. S. Jung, & K. J. Han, “Combining five acoustic level modeling methods for automatic speaker age and gender recognition.” In Eleventh annual conference of the international speech communication association (INTERSPEECH 2010), Makuhari, Chiba, Japan, Sept. 26-30, 2010, International Speech Communication Association (ISCA), 2010. pp. 2826-2829. doi:10.21437/Interspeech.2010-74
  • [12] F. Metze, J. Ajmera, R. Englert, U. Bub, F. Burkhardt, J. Stegmann, & B. Littel, “Comparison of four approaches to age and gender recognition for telephone applications.” In 2007 IEEE International Conference on Acoustics, Speech and Signal Processing- ICASSP'07, Honolulu, HI, USA, Ap. 15-20, 2007. vol. 4, pp. IV-1089. doi:10.1109/ICASSP.2007.367263
  • [13] A. Acero, & X. Huang, “Speaker and gender normalization for continuous-density hidden Markov models.” In 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings, Atlanta, GA, USA, May, 1996, IEEE Publication, 1996. vol. 1, pp. 342-345. doi:10.1109/icassp.1996.541102
  • [14] A. Suppa et al., "Voice analysis with machine learning: one step closer to an objective diagnosis of essential tremor," Movement Disorders, vol. 36, no. 6, pp. 1401-1410, 2021. doi:10.1002/mds.28508
  • [15] K. Schultebraucks, V. Yadav, and I. R. Galatzer-Levy, "Utilization of machine learning-based computer vision and voice analysis to derive digital biomarkers of cognitive functioning in trauma survivors," Digital biomarkers, vol. 5, no. 1, pp. 16-23, 2021. doi:10.1159/000512394
  • [16] C. Robotti et al., "Machine learning-based voice assessment for the detection of positive and recovered COVID-19 patients," Journal of Voice, vol. In Press., 2021. doi:10.1016/j.jvoice.2021.11.004
  • [17] C. Shimon, G. Shafat, I. Dangoor, and A. Ben-Shitrit, "Artificial intelligence enabled preliminary diagnosis for COVID-19 from voice cues and questionnaires," The Journal of the Acoustical Society of America, vol. 149, no. 2, pp. 1120-1124, 2021. doi:10.1121/10.0003434
  • [18] F. T. Al-Dhief et al., "Voice pathology detection and classification by adopting online sequential extreme learning machine," IEEE Access, vol. 9, pp. 77293-77306, 2021. doi:10.1109/ACCESS.2021.3082565
  • [19] D. Shin et al., "Detection of minor and major depression through voice as a biomarker using machine learning," Journal of Clinical Medicine, vol. 10, no. 14, p. 3046, 2021. doi:10.3390/jcm10143046
  • [20] C. W. Espinola, J. C. Gomes, J. M. S. Pereira, and W. P. dos Santos, "Detection of major depressive disorder using vocal acoustic analysis and machine learning - an exploratory study," Research on Biomedical Engineering, vol. 37, no. 1, pp. 53-64, 2021. doi:10.1007/s42600-020-00100-9
  • [21] J. Carrón, Y. Campos-Roca, M. Madruga, and C. J. Pérez, "A mobile-assisted voice condition analysis system for Parkinson’s disease: assessment of usability conditions," BioMedical Engineering OnLine, vol. 20, no. 1, pp. 1-24, 2021. doi:10.1186/s12938- 021-00951-y
  • [22] L. Moro-Velazquez, J. A. Gomez-Garcia, J. D. Arias-Londoño, N. Dehak, and J. I. Godino-Llorente, "Advances in Parkinson's disease detection and assessment using voice and speech: A review of the articulatory and phonatory aspects," Biomedical Signal Processing and Control, vol. 66, pp. 102418, 2021. doi:10.1016/j.bspc.2021.102418
  • [23] E. Majda-Zdancewicz, A. Potulska-Chromik, J. Jakubowski, M. Nojszewska, and A. Kostera-Pruszczyk, "Deep learning vs feature engineering in the assessment of voice signals for diagnosis in Parkinson’s disease," Bulletin of the Polish Academy of Sciences. Technical Sciences, vol. 69, no. 3, 2021. doi: 10.24425/bpasts.2021.137347.
  • [24] K. Becker, “Gender recognition by voice,” Kaggle.com 2016. [Online] Available: https://www.kaggle.com/datasets/primaryobjects/voicegender. [Accessed: 08.04. 2022].
  • [25] M. M. Ramadhan, I. S. Sitanggang, F. R. Nasution, & A. Ghifari, “Parameter tuning in random forest based on grid search method for gender classification based on voice frequency,” DEStech Transactions on Computer Science and Engineering, vol. 10, pp. 625-629, 2017. doi:10.12783/dtcse/cece2017/14611
  • [26] F. Ertam, “An effective gender recognition approach using voice data via deeper LSTM networks,” Applied Acoustics, vol.156, pp. 351–358. 2019. doi:10.1016/j.apacoust.2019.07.033
  • [27] S. M. Huestegge and T. Raettig, “Crossing Gender Borders: Bidirectional Dynamic Interaction Between Face-Based and Voice- Based Gender Categorization,” JVoice, vol. 34, no. 3 pp. 487 -487, 2018. doi:10.1016/j.jvoice.2018.09.020
  • [28] A. Zourmand, H. N. Ting andS. M. Mirhassani, “Gender classification in children based on speech characteristics: using fundamental and formant frequencies of Malay vowels,” J Voice, vol. 27 no. 2 pp. 201-209, 2013. doi:10.1016/j.jvoice.2012.12.006.
  • [29] K. Zvarevashe and O. O. Olugbara, “Gender Voice Recognition Using Random Forest Recursive Feature Eliminationwith Gradient Boosting Machines,” In Proceedings of the 2018 International Conference on Advances in Big Data,Computing and Data Communication Systems (icABCD), pp. 1–6, 6-7 Augest 2018, Durban, South Africa. doi: 10.1109/ICABCD.2018.8465466
  • [30] I. E. Livieris, E. Pintelas, P. Pintelas, “Gender Recognition by Voice Using an Improved Self-Labeled Algorithm,” Mach. Learn. Knowl. Extr., vol. 1, no. 1, pp. 492–503, 2019. doi;10.3390/make1010030
  • [31] A. A. Alnuaim, M. Zakariah, C. Shashidhar, W A. Hatamleh, H. Tarazi, P. K. Shukla, and R. Ratna, "Speaker Gender Recognition Based on Deep Neural Networks and ResNet50," Wireless Communications and Mobile Computing, vol. 2022, pp. 1-13, 2022. doi:10.1155/2022/4444388
APA GONEN S, Barışkan M, KARACAYILMAZ G, ALHAN B, YILMAZ E, Artuner H (2022). Gender Detection Via Voice Using Artificial Intelligence Algorithms. , 567 - 575. 10.30855/gmbd.0705043
Chicago GONEN Serkan,Barışkan Mehmet Ali,KARACAYILMAZ Gökçe,ALHAN Birkan,YILMAZ Ercan Nurcan,Artuner Harun Gender Detection Via Voice Using Artificial Intelligence Algorithms. (2022): 567 - 575. 10.30855/gmbd.0705043
MLA GONEN Serkan,Barışkan Mehmet Ali,KARACAYILMAZ Gökçe,ALHAN Birkan,YILMAZ Ercan Nurcan,Artuner Harun Gender Detection Via Voice Using Artificial Intelligence Algorithms. , 2022, ss.567 - 575. 10.30855/gmbd.0705043
AMA GONEN S,Barışkan M,KARACAYILMAZ G,ALHAN B,YILMAZ E,Artuner H Gender Detection Via Voice Using Artificial Intelligence Algorithms. . 2022; 567 - 575. 10.30855/gmbd.0705043
Vancouver GONEN S,Barışkan M,KARACAYILMAZ G,ALHAN B,YILMAZ E,Artuner H Gender Detection Via Voice Using Artificial Intelligence Algorithms. . 2022; 567 - 575. 10.30855/gmbd.0705043
IEEE GONEN S,Barışkan M,KARACAYILMAZ G,ALHAN B,YILMAZ E,Artuner H "Gender Detection Via Voice Using Artificial Intelligence Algorithms." , ss.567 - 575, 2022. 10.30855/gmbd.0705043
ISNAD GONEN, Serkan vd. "Gender Detection Via Voice Using Artificial Intelligence Algorithms". (2022), 567-575. https://doi.org/10.30855/gmbd.0705043
APA GONEN S, Barışkan M, KARACAYILMAZ G, ALHAN B, YILMAZ E, Artuner H (2022). Gender Detection Via Voice Using Artificial Intelligence Algorithms. Gazi Mühendislik Bilimleri Dergisi, 8(3), 567 - 575. 10.30855/gmbd.0705043
Chicago GONEN Serkan,Barışkan Mehmet Ali,KARACAYILMAZ Gökçe,ALHAN Birkan,YILMAZ Ercan Nurcan,Artuner Harun Gender Detection Via Voice Using Artificial Intelligence Algorithms. Gazi Mühendislik Bilimleri Dergisi 8, no.3 (2022): 567 - 575. 10.30855/gmbd.0705043
MLA GONEN Serkan,Barışkan Mehmet Ali,KARACAYILMAZ Gökçe,ALHAN Birkan,YILMAZ Ercan Nurcan,Artuner Harun Gender Detection Via Voice Using Artificial Intelligence Algorithms. Gazi Mühendislik Bilimleri Dergisi, vol.8, no.3, 2022, ss.567 - 575. 10.30855/gmbd.0705043
AMA GONEN S,Barışkan M,KARACAYILMAZ G,ALHAN B,YILMAZ E,Artuner H Gender Detection Via Voice Using Artificial Intelligence Algorithms. Gazi Mühendislik Bilimleri Dergisi. 2022; 8(3): 567 - 575. 10.30855/gmbd.0705043
Vancouver GONEN S,Barışkan M,KARACAYILMAZ G,ALHAN B,YILMAZ E,Artuner H Gender Detection Via Voice Using Artificial Intelligence Algorithms. Gazi Mühendislik Bilimleri Dergisi. 2022; 8(3): 567 - 575. 10.30855/gmbd.0705043
IEEE GONEN S,Barışkan M,KARACAYILMAZ G,ALHAN B,YILMAZ E,Artuner H "Gender Detection Via Voice Using Artificial Intelligence Algorithms." Gazi Mühendislik Bilimleri Dergisi, 8, ss.567 - 575, 2022. 10.30855/gmbd.0705043
ISNAD GONEN, Serkan vd. "Gender Detection Via Voice Using Artificial Intelligence Algorithms". Gazi Mühendislik Bilimleri Dergisi 8/3 (2022), 567-575. https://doi.org/10.30855/gmbd.0705043
Sayfa Oluşturulma Tarihi
24-04-2024 9:2

İLETİŞİM

TÜBİTAK ULAKBİM TR Dizin

Yüzüncüyıl, İşçi Blokları Mahallesi

Muhsin Yazıcıoğlu Caddesi No:51/C

06530 Çankaya / ANKARA +90 (312) 298 92 00

trdizin@tubitak.gov.tr

TÜBİTAK ULAKBİM Ulusal Akademik Ağ ve Bilgi Merkezi Cahit Arf Bilgi Merkezi © Tüm Hakları Saklıdır. Gizlilik Politikası Kullanım Şartları