Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study

TANER IŞIK, YAsemen; SOYSAL, Azime Şebnem; KARAKAŞ, Sirel; ERDOGAN BAKAR, EMEL; TURGAY, Atilla

Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study

EMEL ERDOĞAN BAKAR, (Ufuk Üniversitesi, Psikoloji Bölümü, Ankara, Türkiye)

YAsemen TANER IŞIK, (Gazi Üniversitesi, Tıp Fakültesi, Çocuk Psikiyatrisi Anabilim Dalı, Ankara, Türkiye)

Azime Şebnem SOYSAL, (Gazi Üniversitesi, Tıp Fakültesi, Pediatri Anabilim Dalı, Ankara, Türkiye)

Sirel KARAKAŞ, (Hacettepe Üniversitesi, KOSGEB Teknoloji Geliştirme Merkezi, Ankara, Türkiye)

Atilla TURGAY (University of Toronto, Department of Family and Community Medicine, Toronto, Canada)

Klinik Psikofarmakoloji Bülteni

18 7

Yıl: 2011 Cilt: 21 Sayı: 4 Sayfa Aralığı: 302 - 316 Metin Dili: Türkçe İndeks Tarihi: 29-07-2022

Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study

Öz:

Amaç: Bu çalışmanın amacı yönetici işlevleri (Yİ) ölçme açısından günlük yaşamdaki davranışları değerlendiren ekolojik bir test ile laboratuvar testleri ile arasındaki örtüşmeyi incelemek, ekolojik testin Dikkat Eksikliği Hiperaktivite Bozukluğunun (DEHB) tanısında kullanılabilirliğini incelemektir. Yöntem: Örneklem ilaç almamış ve kliniğe ilk kez başvurmuş olan, sadece DEHB tanısı olan ve alt tiplere göre ayrışmış bulunan (dikkat dağınıklığının önde geldiği grupta 22 çocuk, hiperaktivite/dürtüselliğin önde geldiği grupta 17; birleşik grupta 22 çocuk). Sağlıklı kontrol grubu yaş açısından eşleştirilmiş 19 erkek çocuktan oluşmuştur. Yİ’nin günlük yaşamda derecelendirilmesi için Davranış Derecelendirme Envanterinin (Behavioral Rating Inventory of Executive Functions: BRIEF) öğretmen ve ebeveyn formları kullanılmıştır (BRIEF-Ö ve BRIEF-E). Laboratuvar testleri Stroop Testi, Wisconsin Kart Eşleme Testi ve Raven Standart Progresif Matrisler Testinden oluşmuştur. Bulgular: DEHB grubunda, BRIEF’in faktör yapısı davranışsal düzenleme göstergesi ve üstbiliş göstergesinden oluşmuştur (açıklanan varyanslar BRIEF-Ö için %70.07 ve BRIEF-Ö için %72.29). Yönetici işlevleri ölçen ekolojik ve laboratuvar testleri aynı faktör altında yer almamıştır. Çok Değişkenli varyans analizi BRİEF puanları açısından grup etkisinin anlamlı olduğunu ancak altgruplar arasında anlamlı fark olmadığını ortaya koymuştur. BRIEF puanları ile yapılan lojistik regresyon analizinde duyarlık %90.20, özgüllük %63.20 olarak bulunmuştur. Tartışma: Çalışma Yİ’ye özel bilişsel özellikleri ve bunların davranışsal göstergelerini belirleyebilmek için ilgili özelliklerin bir arada taranmasını sağlayan ekolojik ve laboratuvar testlerinin kullanılması, bilgilerin hem öğretmen hem de ebeveynden ayrı ayrı alınması gerektiği ortaya konmuştur. BRIEF’in ve laboratuvar testlerinin ölçtüğü Yİ’nin aynı özellikler kümesinden oluşmadığına gösteren sonuçlar BRIEF’in Türk kültürü üzerindeki geçerliğine de ışık tutmaktadır.

Anahtar Kelime:

Konular: Farmakoloji ve Eczacılık

Davranış derecelendirme envanteri ve laboratuvar testleri erkek çocuklarda yönetici fonksiyonların farklı yönlerini ölçmektedir: Bir geçerlik çalışması

Öz:

Objective: The aim of this study is to investigate the correspondence between an ecological test of everyday behavior and laboratory tests of executive functions (EF) and to analyze whether the prior can be used in the diagnosis of Attention Deficit Hyperactivity Disorder (ADHD). Method: Sample consisted of 61 unmedicated first referral males who were diagnosed only with ADHD and were classified into subtypes (predominantly inattentive subtype: n= 22; predominantly hyperactive/impulsive subtype: n= 17; combined subtype: n= 22). Healthy control group consisted of age-matched healthy males (n= 19). Rating of everyday behavior of EF was performed using both the teacher and parent forms (BRIEF-T and P, respectively) of Behavioral Rating Inventory of Executive Functions (BRIEF). Laboratory tests consisted of the Stroop Test, Wisconsin Card Sorting Test and Raven Standard Progressive Matrices. Results: In the ADHD group, factor structure of BRIEF consisted of behavioral regulation index and metacognition index (explained variances: 70.07% in BRIEF-T and 72.29% in BRIEF-P). In no case did the laboratory and ecological measures of EF took place under the factors that the BRIEF scores loaded. Multivariate analyses of variance showed a significant effect of group but not of subgroup on BRIEF scores. Logistic regression analyses showed a sensitivity of 90.20% and specificity of 63.20% of BRIEF scores. Discussion: A multi-trait and multi-method approach, covering both the laboratory tests and ecological rating scales and both the teacher and parent informants should be used in order to capture the specific cognitive processes of EF and their behavioral manifestations. The findings showing the dissimilarity between the EF that BRIEF and the laboratory tests measure and shed light on the validity of BRIEF on the Turkish culture.

Anahtar Kelime:

Konular: Farmakoloji ve Eczacılık

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık

1. American Psychiatric Association. Attention deficit and disruptive behavior disorder. In American Psychiatric Association: Diagnostic and statistical manual of mental disorders, American Psychiatric Association (editors). Washington DC: American Psychiatric Association; 2000.p.134-5.
2. World Health Organization ICD-10. Hyperkinetic disorder. In World Health Organization ICD-10: The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines, World Health Organization (editors). Geneva: World Health Organization; 1992.p.155-7.
3. Barkley RA. Behavioural inhibition, sustained attention, and executive functions: Constructing a unifying theory of AD/HD. Psychol Bull 1997a; 121(1): 65-94.
4. Brown TE. Executive functions and attention deficit hyperactivity disorder: Implications of two conflicting views. Int J Disability Develop Educ 2006; 53(1): 35-46.
5. Lawrence V, Houghton S, Douglas G, Durkin K, Whiting K, Tannock R. Executive function and ADHD: a comparison of children’s performance during neuropsychological testing and realworld activities. J Atten Disord 2004; 7(3): 137-49.
6. Lawrence V, Houghton S, Tannock R, Douglas G, Durkin K, Whiting K. ADHD outside the laboratory: boys’ executive function performance on tasks in videogame play and on a visit to the zoo. J Abnorm Child Psychol 2002; 30(5): 447-62.
7. Biederman J, Monuteaux MC, Doyle AE, Seidman LJ, Wilens TE, Ferrero F, et al. Impact on executive function deficits and attentiondeficit/ hyperactivity disorder (ADHD) on academic outcomes in children. J Consult Clin Psychol. 2004;72(5):757-66
8. Biederman J, Petty CR, Doyle AE, Spencer T, Henderson CS, Marion B, et al. Stability of executive function deficits in girls with ADHD: a prospective longitudinal followup study into adolescence. Dev Neuropsychol 2008; 33(1): 44-61.
9. Benson F. The role of frontal dysfunction in attention deficit hyperactivity disorder. J Child Neurol 1991; 6 (Suppl.1): 9-12.
10. Stuss DT, Benson, DF. The Frontal lobes and the control of cognition and memory. In Perecman E (editor). The Frontal Lobes Revisited. New York: Raven Press; 1987.p.141-158.
11. Willcutt EG, Pennington BF, Olson RK, Chhabildas N, Hulslander J. Neuropsychological analyses of comorbidity between reading disability and attention deficit hyperactivity disorder: in search of the common deficit. Dev. Neuropsychol. 2005; 27(1): 35-78.
12. Scheres A, Oosterlaan J, Geurts H, Morein-Zamir S, Meiran N, Schut H. Executive functioning in boys with ADHD: primarily an inhibition deficit? Arch Clin Neuropsychol 2004; 19(4): 569-94.
13. Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior Rating Inventory of Executive Function Professional Manual. Lutz FL: Psychological Assessment Resources Inc.; 2000a.
14. Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior Rating Inventory of Executive Function. Child Neuropsychol. 2000b; 6(3): 235-8.
15. Gioia GA, Isquith PK, Kenealy LE. Assessment of behavioral aspects of executive function. In Executive Functions And The Frontal Lobes: A lifespan perspective, V. AndersonV, Jacobs R, Anderson PJ (editors). New York: Psychology Press; 2008. p. 179- 218.
16. Burgess PW. Theory and methodology in executive function research. In Rabbitt P (editors). Methodology of Frontal and Executive Function, East Sussex, U.K.: Psychology Press; 1997.p. 81-116.
17. Gilotty L, Kenworthy L, Sirian L, Black DO, Wagner AE. Adaptive skills and executive function in autism spectrum disorders. Child Neuropsychol 2002; 8(4): 241-8.
18. Gioia GA, Isquith PK, Retzlaff PD, Espy KA. Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychol 2002; 8(4): 249- 57.
19. Mahone EM, Cirino PT, Cutting LE, Cerrone PM, Hagelthorn KM, Hiemenz JR, et al. Validity of the behavior rating inventory of executive function in children with ADHD and/or Tourette syndrome. Arch Clin Neuropsychol 2002; 17(7): 643-62.
20. Slick DJ Lautzenhiser A, Sherman EM, Eyrl K. Frequency of scale elevations and factor structure of the Behavior Rating Inventory of Executive Function (BRIEF) in children and adolescents with intractable epilepsy. Child Neuropsychol 2006; 12(3): 181-9.
21. Gioia GA, Isquith PK. Ecological assessment of executive function in traumatic brain injury. Dev Neuropsychol 2004; 25 (1-2): 135-58.
22. Pennington BF, Ozonoff S. Executive functions and developmental psychopathology. J Child Psychol Psychiatry 1996; 37(1): 51-87.
23. Karatekin C, Asarnow RF. Working memory in childhood onset schizophrenia and attention deficit hyperactivity disorder. Psychiatry Res 1998; 80(2): 165-76.
24. Pennington BF. Dimensions of executive function in normal and abnormal development. In Development Of The Prefrontal Cortex: Evolution, Neurobiology, and Behavior, Krasnegor NA, Lyon GR, Goldman-Rakic PS (editors). Baltimore, MD: Brooks Publ.;1997.p. 265-81.
25. Pennington BF. The working memory functions of the prefrontal cortices: Implication for development and individual differences in cognition. In Future Oriented Processes and Development, Haith M, Benson J, Roberts R, (editors). Chicago: Univ. Chicago Press; 1994.p.243-89.
26. Barkley RA. Attention-deficit/hyperactivity disorder, selfregulation, and time: toward a more comprehensive theory. J Dev Behav Pediatr 1997b; 18(4): 215-85.
27. Stroop RJ. Studies of interference in serial verbal reactions. J Exp Psychol 1935; 18(6): 643-61.
28. Jensen AR, Rohwer WD, Jr. The Stroop Color-Word Test: A review. Acta Psychologica 1966; 25(1): 36-93.
29. MacLeod CM. Half a century of research on the Stroop Effect: An integrative review. Psychol Bull 1991; 109(2): 162-203.
30. MacLeod CM. The Stroop task: The “Gold Standard” of attentional measures. J Exp Psychol 1992; 121(1): 12-4.
31. Berg EA. A simple objective technique for measuring flexibility in thinking. J Gen Psychol 1948; 39: 15-22.
32. Heaton RK, Chelune GJ, Talley JL, Kay GG, Curtis G. Wisconsin Card Sorting Test Manual-Revised and Expanded. Lutz FL: Psychological Assessment Resources Inc.; 1993.
33. Heaton RK. Wisconsin Card Sorting Test Manual. Odessa, Florida: Psychological Assessment Resources; 1981.
34. King MC, Snow, WG. Problem-solving task performance in braindamaged subjects. J Clin Psychol 1981; 37(2): 400-4.
35. Pendleton MG, Heaton RKA. Comparison of the Wisconsin Card Sorting Test and The Category Test. J Clin Psychol 1982; 38(2): 392-96.
36. Berman KF, Ostrem JL, Randolph C, Gold J, Goldberg T, Coppola R, et al. Physiological activation of a cortical network during performance of the Wisconsin Card Sorting Test: A positron emission tomography study. Neuropsychologia 1995; 33(8): 1027- 46
37. Gold JM, Carpenter C, Randolph C, Goldberg TE, Weinberger DR. Auditory working memory and Wisconsin Card Sorting Test performance in schizophrenia. Arch Gen Psychiatry 1997; 54 (2): 159-65.
38. Raven JC Guide to the Standard Progressive Matrices. New York: The Psychological Corporation; 1956.
39. Raven JC, Court JH, Raven J. Manual for Raven’s Standard Progressive Matrices. Oxford: Oxford Psychologists Press; 1992.
40. Lezak MD. Principles of neuropsychological assesment. In Behavioral neurology and neuropsychology. Feinberg TE, Farah MJ (editors). New York: McGraw-Hill; 1997.
41. Carpenter P, Just MA, Shell P. What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test. Psychol Rev 1990; 97(3): 404-31.
42. Conway ARA, Cowan N, Bunting MF, Therriault SRB, Minkoff SRB. A latent variabe analysis of working memory capacity, shortterm memory, processing speed, and general fluid intelligence. Intelligence 2002; 30(2): 163-83.
43. Fry AF, Hale S. Relationships among processing speed, working memory, and fluid intelligence in children. Biol Psychol 2000; 54(1- 3):1-34.
44. O’Leary MU, Rush KM, Guastello SJ. Estimating age-stratified WAIS-R IQ from scores on the Raven Standart Progressive Matrices. J Clin Psychol 1991; 47(2): 277-84.
45. Spreen O, Strauss E. A Compendium Of Neuropsychological Tests: Administration, Norms And Commentary. New York: Oxford University Press; 1991.
46. Mitrushina M, Boone KB, Razani J, D’Elia, LF. Handbook of Normative Data for Neuropsychological Assessment. NewYork: Oxford University Press; 2005.
47. Kaufman J, Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, et al. Schedule for affective disorders and schizophrenia fo schoolage children-present and lifetime version (K-SADS-PL): İnitial reliability and validity data. J Am Acad Child Adolesc Psychiatry 1997; 36(7): 980-8.
48. Matthews A. Cognitive processes in anxiety and depression. J Royal Soc Med 1986; 79(2): 158-61.
49. Öy B. Child Depression Inventory: Reliability and Validity Study. Turk Psikiyatri Derg 1991; 2(2): 132-6 (Turkish).
50. Kovacs M. Rating Scales to assess depression in school aged children. Acta Paedopsychiatr 1981; 46(5-6): 305- 13.
51. Kovacs M. The Children’s Depression Inventory (CDI). Psychopharmacol Bull 1985; 21(4): 995-98.
52. Özusta Ş. The Turkish Standardization reliability and validity of State Trait Anxiety Inventory for Children. Türk Psikoloji Dergisi 1995; 10(1): 32-44 (Turkish).
53. Spielberger CD, Gorsuch RL, Cushene RE. Manual for the State- Trait Anxiety Inventory. California: Consulting Psychologists Press; 1970.
54. Luria A. Higher Cortical Functions in Man. New York: Basic Books; 1966.
55. Karakaş S. A Neuropsychological Test Battery Standardized To The Turkish Culture: BILNOT Battery. 2nd ed. Ankara: Eryılmaz Ofset; 2006 (Turkish).
56. Karakaş S, Erdoğan E, Sak L, Soysal AŞ, Ulusoy T, Yüceyurt Ulusoy İ, et al. The standardization of the Stroop Test to the Turkish culture: reliability and validity. Klinik Psikiyatri Dergisi 1999a; 2(2): 75-88 (Turkish).
57. Karakaş S, Bekçi B, Doğutepe E, Erzengin ÖU. The electrophysiology of Stroop Test performance: Event-related potentilas and brain maps. Klinik Psikiyatri Dergisi 2005; 8(4): 155-71 (Turkish).
58. Karakaş S, Bekçi B, Doğutepe E. Stroop Test performance: perceptual conflict or response competition. 13th World Congress of Psychophysiology. The Olympics of the Brain. Int J Psychophysiol 2006; 61(3): 371.
59. Karakaş S, Doğutepe E, Sosyal AŞ, Erdoğan Bakar E. Path analysis of Stroop Test performance: attention and/or interference? 13th World Congress of Psychophysiology. The Olympics of the Brain. Int J Psychophysiol 2006; 61(3): 347.
60. Karakaş S, Irak M, Kurt M, Erzengin ÖU. Wisconsin Card Sorting Test and StroopTest TBAG Version: Comparative analysis. J Psych Psychol and Psychopharmacol 1999b; 7(3): 179-92.
61. Yalçın K, Karakaş S. The age level where Wisconsin Card Sorting Test scores represent the cognitive processes found for adults. 13th World Congress of Psychophysiology. The Olympics of the Brain. Int J Psychophysiol 2006; 61(3): 344.
62. Kurt M, Karakaş S. The effect of an original attention-related training program on visuospatial neglect. 12th World Congress of Psychophysiology (IOP) Int J Psychophysiol 2004; 54 (1-2): 152-3.
63. Şahin N, Düzen E. A validation study on teacher nominations of gifted children. In Competence and Responsibility (Vol. 2), Heller KA, Heny EA (editors). Göttingen: Hogrefe and Huber; 1994.
64. Şahin N, Düzen E. Ability profiles of the teacher-nominated gifted children. Competence and responsibility. The Third European Conference of the European Council for the High Ability (Vol. 1), Ernst AH, Heller AK (editors). Göttingen: Hogrefe and Huber; 1992.
65. Şahin N, Düzen E. Turkish Standardization of the Raven’s SPM (ages 6-15). 23rd International Congress of Applied Psychology, July 1994, Madrid, Spain.
66. Kılıç BG, Koçkar IA, Irak M, Şener Ş, Karakaş K. The standardization study of Stroop test TBAG version on children between 6 and 11 years of age. Çocuk ve Ergen Ruh Sağlığı Dergisi 2002; 9(2): 86-99 (Turkish).
67. Kurt M, Karakaş S. The factor structure of three neuropsychological tests sensitive to right hemispheric functioning. Psikiyatri Psikoloji Psikofarmakoloji Dergisi 2000; 8(4): 251-65 (Turkish).
68. Barcelo F, Sanz M, Molina V, Rubia FJ. The Wisconsin Card Sorting Test and the assessment of frontal function: A validation study with event. Neuropsychologia 1997; 24(3): 288-397.
69. Karzmark P. Factor analysis of special Wisconsin Card Sorting measures in a comprehensive neuropsychological assessment. J Clin Exp Neuropsychol 1992; 14 (3): 339-53.
70. Perrine K. Differential aspects of conceptual processing in the Category Test and the Wisconsin Card Sorting Test. J Clin Exp Neuropsychol 1993; 15(4): 461-73.
71. Vriezen ER, Pigott SE. The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychol 2002; 8(4): 296-303
72. Toplak ME, Bucciarelli SM, Jain U, Tannock R. Executive functions: performance-based measures and the Behavior Rating Inventory of Executive Function (BRIEF) in adolescents with Attention/Deficit hyperactivity Disorder. Child Neuropsychol 2009; 15(1): 53-72.
73. Burgess P, Alderman N, Evans J, Emslie H, Wilson BA. The ecological validity of tests of executive function. J Int Neuropsychol Soc 1998; 4(6): 547-58.
74. Alloway TC, Gathercole SE, Holmes J, Place M, Elliott JG, Hilton K. The diagnostic utility of Behavioral Checklists in identifying children with ADHD and children with working memory deficits. Child Psychiatry Hum Dev 2009; 40(3): 353-66.
75. McCandles S, O’Laughlin L. The clinical utility of the Behavior rating Inventory of Executive Function (BRIEF) in the diagnosis of ADHD. J Atten Disord 2007; 10(4): 381-89.
76. Jarratt KP, Riccio CA, Siekierski BM. Assessment of attention deficit hyperactivity disorder (ADHD) using the BASC and BRIEF. Appl Neuropsychol 2005; 12(2):83-93.
77. Stevens J, Quittner AL, Abikoff H. Factors influencing elementary school teachers ratings’ of ADHD and ODD behaviors. J Clin Child Psychol 1998; 27(2): 406-14.

APA	ERDOGAN BAKAR E, TANER IŞIK Y, SOYSAL A, KARAKAŞ S, TURGAY A (2011). Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. , 302 - 316.
Chicago	ERDOGAN BAKAR EMEL,TANER IŞIK YAsemen,SOYSAL Azime Şebnem,KARAKAŞ Sirel,TURGAY Atilla Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. (2011): 302 - 316.
MLA	ERDOGAN BAKAR EMEL,TANER IŞIK YAsemen,SOYSAL Azime Şebnem,KARAKAŞ Sirel,TURGAY Atilla Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. , 2011, ss.302 - 316.
AMA	ERDOGAN BAKAR E,TANER IŞIK Y,SOYSAL A,KARAKAŞ S,TURGAY A Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. . 2011; 302 - 316.
Vancouver	ERDOGAN BAKAR E,TANER IŞIK Y,SOYSAL A,KARAKAŞ S,TURGAY A Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. . 2011; 302 - 316.
IEEE	ERDOGAN BAKAR E,TANER IŞIK Y,SOYSAL A,KARAKAŞ S,TURGAY A "Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study." , ss.302 - 316, 2011.
ISNAD	ERDOGAN BAKAR, EMEL vd. "Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study". (2011), 302-316.

APA	ERDOGAN BAKAR E, TANER IŞIK Y, SOYSAL A, KARAKAŞ S, TURGAY A (2011). Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. Klinik Psikofarmakoloji Bülteni, 21(4), 302 - 316.
Chicago	ERDOGAN BAKAR EMEL,TANER IŞIK YAsemen,SOYSAL Azime Şebnem,KARAKAŞ Sirel,TURGAY Atilla Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. Klinik Psikofarmakoloji Bülteni 21, no.4 (2011): 302 - 316.
MLA	ERDOGAN BAKAR EMEL,TANER IŞIK YAsemen,SOYSAL Azime Şebnem,KARAKAŞ Sirel,TURGAY Atilla Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. Klinik Psikofarmakoloji Bülteni, vol.21, no.4, 2011, ss.302 - 316.
AMA	ERDOGAN BAKAR E,TANER IŞIK Y,SOYSAL A,KARAKAŞ S,TURGAY A Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. Klinik Psikofarmakoloji Bülteni. 2011; 21(4): 302 - 316.
Vancouver	ERDOGAN BAKAR E,TANER IŞIK Y,SOYSAL A,KARAKAŞ S,TURGAY A Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study. Klinik Psikofarmakoloji Bülteni. 2011; 21(4): 302 - 316.
IEEE	ERDOGAN BAKAR E,TANER IŞIK Y,SOYSAL A,KARAKAŞ S,TURGAY A "Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study." Klinik Psikofarmakoloji Bülteni, 21, ss.302 - 316, 2011.
ISNAD	ERDOGAN BAKAR, EMEL vd. "Behavioral rating inventory and laboratory tests measure different aspects of executive functioning in boys: a validity study". Klinik Psikofarmakoloji Bülteni 21/4 (2011), 302-316.