TY - JOUR TI - Evaluation of social bot detection models AB - Social bots are employed to automatically perform online social network activities; thereby, they can also be utilized in spreading misinformation and malware. Therefore, many researchers have focused on the automatic detection of social bots to reduce their negative impact on society. However, it is challenging to evaluate and compare existing studies due to difficulties and limitations in sharing datasets and models. In this study, we conduct a comparative study and evaluate four different bot detection systems in various settings using 20 different public datasets. We show that high-quality datasets covering various social bots are critical for a reliable evaluation of bot detection methods. In addition, our experiments suggest that Botometer is preferable to others in order to detect social bots. AU - ŞAHİN, Deniz AU - Ünal, Kübranur AU - Uysal, Sema AU - Yılmaz, Fatma Meriç AU - ERCAN KARADAĞ, MÜJGAN AU - BOĞDAYCIOĞLU, Nihal AU - OĞUZ, Esra AU - EKİCİ, Mehmet Fatih AU - ZEREN, Sezgin AU - Korkmaz, Mehmet AU - Bayhan, Zulfu AU - DEGER, Ayşe Nur AU - UCAR, Bercis Imge AU - dörterler, mustafa erman AU - AKIN, Yigit AU - yeni, ercan AU - PELİT, Eyyüp Sabri AU - ÇİFTÇİ, Halil AU - Ordek, Eser AU - Kati, Bulent AU - ULUÇAKAR, MUSTAFA AU - AKTAŞ, SAVAŞ AU - Sucu, Nehir AU - vezir, özden AU - AYAZ, LOKMAN AU - AYTAÇOĞLU, Barlas Naim AU - Kahyaoglu, Muzaffer AU - Geçmen, Çetin AU - kılıçgedik, alev AU - Cakmak, Ender AU - İZGİ, brahim Akın AU - AKDUMAN, GÜLBENIZ AU - HATİPOĞLU, Zeynep AU - Demir, Bulent AU - Bozgeyik, Bilgin AU - Kekeç, Ahmet Fevzi AU - GÜLEN, SALİH AU - Yaman, Süleyman AU - TANRISEVER, Murat AU - Cevik, Aydın AU - KARABULUT, BURAK AU - Ozturk, Halime AU - BASAR, MUSTAFA AYDIN AU - ALTAY, CANAN AU - SEÇİL, Mustafa AU - demir, ömer faruk AU - Aslan, Guven AU - MD, Kutsal Yörükoğlu AU - Bozkurt, Ozan AU - TUNA, Burçin AU - gürsoy, elif AU - ÖZTÜRK, YASEMİN AU - Küçük, Ayşegül AU - murat öztürk, duygu AU - sahin, leyla AU - Müsüroğlu Keloğlan, Seval AU - BILGIN, MUSTAFA AU - Lenger, Dinçer Savaş AU - Kutlu, Mucahid AU - Selcuk, Ali Aydin AU - TORUSDAĞ, MUHAMMET BUĞRA DO - 10.55730/1300-0632.3848 PY - 2022 JO - Turkish Journal of Electrical Engineering and Computer Sciences VL - 45 IS - 1 SN - 1300-0632 SP - 1269 EP - 1283 DB - TRDizin UR - http://search/yayin/detay/533998 ER -