The Reliability and Validity of the Turkish Version of the Telehealth
Usability Questionnaire and the Telemedicine Satisfaction Questionnaire
in Patients with Multiple Sclerosis

EKMEKÇİ, Özgül; SARI, Zübeyir; Özkeskin, Mehmet; YUCEYAR, NUR; ÖZDEN, Fatih

doi:10.4103/nsn.nsn_41_21

The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis

Fatih ÖZDEN, (Ege Üniversitesi, Sağlık Bilimleri Fakültesi, Fizyoterapi ve Rehabilitasyon Bölümü, İzmir, Türkiye)

Mehmet ÖZKESKİN, (Ege Üniversitesi, Sağlık Bilimleri Fakültesi, Fizyoterapi ve Rehabilitasyon Bölümü, İzmir, Türkiye)

Zübeyir SARI, (Marmara Üniversitesi, Sağlık Bilimleri Fakültesi, Fizyoterapi ve Rehabilitasyon Anabilim Dalı, İstanbul, Türkiye)

Özgül EKMEKÇİ, (Ege Üniversitesi, Tıp Fakültesi, Nöroloji Anabilim Dalı, İzmir, Türkiye)

Nur YÜCEYAR (Ege Üniversitesi, Tıp Fakültesi, Nöroloji Anabilim Dalı, İzmir, Türkiye)

Neurological sciences and neurophysiology (Online)

4 1

Yıl: 2021 Cilt: 38 Sayı: 3 Sayfa Aralığı: 173 - 179 Metin Dili: İngilizce DOI: 10.4103/nsn.nsn_41_21 İndeks Tarihi: 11-06-2022

The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis

Öz:

Objective: The aim of the study was to translate and cross‑culturally adapt the Telehealth Usability Questionnaire (TUQ) and the Telemedicine Satisfaction Questionnaire (TSQ) into Turkish and also to analyze the reliability and validity of both questionnaires. Materials and Methods: A total of 107 multiple sclerosis (MS) patients were recruited. The department clinician monitored all participants with telemedicine for 4 years. Internal consistency was evaluated with Cronbach’s alpha coefficient. The test–retest reliability was calculated with intraclass correlation coefficient by analyzing the scores of retested 52 patients 1 week later. The construct validity was examined by Pearson’s correlation coefficient (r). Besides, the internal consistency for the subscores of the TUQ and exploratory factor analysis of the TSQ was analyzed.Results: The mean age was 40.5 ± 11.0 years. Internal consistency of all items and the total score of the TUQ were excellent (>0.80; ranged: 0.976–0.979). On the other hand, the internal consistency of all items and total score of the TSQ was excellent, either (>0.80; ranged: 0.969–0.973). The reproducibility of the total score for the TUQ was excellent (>0.80). The test–retest reliability of all items and the total score of the TSQ were within limits ranging from acceptable to excellent (0.617–0.860). The reliability of the total score for the TSQ was excellent (>0.80). The internal consistency of all subscales of the TUQ was excellent (>0.80). The correlation between TUQ and TSQ was strong (r = 0.882, P < 0.001). The factor loading scores of the TSQ were high (0.814–0.919). Conclusions: The Turkish version of the TUQ and the TSQ are valid and reliable in MS patients.

Anahtar Kelime:

Belge Türü: Makale Makale Türü: Araştırma Makalesi Erişim Türü: Erişime Açık

1. Galea MD. Telemedicine in rehabilitation. Phys Med Rehabil Clin N Am 2019;30:473‑83.
2. Kruse CS, Krowski N, Rodriguez B, Tran L, Vela J, Brooks M. Telehealth and patient satisfaction: A systematic review and narrative analysis. BMJ Open 2017;7:e016242.
3. Hatcher‑Martin JM, Adams JL, Anderson ER, Bove R, Burrus TM, Chehrenama M,et al. Telemedicine in neurology: Telemedicine Work Group of the American Academy of Neurology update. Neurology 2020;94:30‑8.
4. Chumbler NR, Quigley P, Li X, Morey M, Rose D, Sanford J, et al. Effects of telerehabilitation on physical function and disability for stroke patients: A randomized, controlled trial. Stroke 2012;43:2168‑74.
5. Amatya B, Galea MP, Kesselring J, Khan F. Effectiveness of telerehabilitation interventions in persons with multiple sclerosis: A systematic review. Mult Scler Relat Disord 2015;4:358‑69.
6. Cavalera C, Pagnini F, Rovaris M, Mendozzi L, Pugnetti L, Garegnani M, et al. A telemedicine meditation intervention for people with multiple sclerosis and their caregivers: Study protocol for a randomized controlled trial. Trials 2016;17:4.
7. Robb JF, Hyland MH, Goodman AD. Comparison of telemedicine versus in‑person visits for persons with multiple sclerosis: A randomized crossover study of feasibility, cost, and satisfaction. Mult Scler Relat Disord 2019;36:101258.
8. Minden SL, Hoaglin DC, Hadden L, Frankel D, Robbins T, Perloff J. Access to and utilization of neurologists by people with multiple sclerosis. Neurology 2008;70:1141‑9.
9. Rogante M, Grigioni M, Cordella D, Giacomozzi C. Ten years of telerehabilitation: A literature overview of technologies and clinical applications. NeuroRehabilitation 2010;27:287‑304.
10. Hailey D, Roine R, Ohinmaa A, Dennett L. Evidence of benefit from telerehabilitation in routine care: A systematic review. J Telemed Telecare 2011;17:281‑7.
11. Syed MJ, Shah Z, Awan S, Wasay M, Fredrikson S. Telephone validation of an Urdu translated version of the extended disability severity scale in multiple sclerosis patients. Mult Scler Relat Disord 2021;48:102684.
12. Domingues RB, Mantese CE, Aquino ED, Fantini FG, Prado GF, Nitrini R. Telemedicine in neurology: Current evidence. Arq Neuropsiquiatr 2020;78:818‑26.
13. Yeroushalmi S, Maloni H, Costello K, Wallin MT. Telemedicine and multiple sclerosis: A comprehensive literature review. J Telemed Telecare 2020;26:400‑13.
14. Khan F, Amatya B, Kesselring J, Galea M. Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev 2015;2015:CD010508.
15. Di Tella S, Pagliari C, Blasi V, Mendozzi L, Rovaris M, Baglio F. Integrated telerehabilitation approach in multiple sclerosis: A systematic review and meta‑analysis. J Telemed Telecare 2020;26:385‑99.
16. Parmanto B, Lewis AN Jr., Graham KM, Bertolet MH. Development of the Telehealth Usability Questionnaire (TUQ). Int J Telerehabil 2016;8:3‑10.
17. Yip MP, Chang AM, Chan J, MacKenzie AE. Development of the telemedicine satisfaction questionnaire to evaluate patient satisfaction with telemedicine: A preliminary study. J Telemed Telecare 2003;9:46‑50.
18. Bakken S, Grullon‑Figueroa L, Izquierdo R, Lee NJ, Morin P, Palmas W, et al. Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire. J Am Med Inform Assoc 2006;13:660‑7.
19. Klaassen B, van Beijnum BJ, Hermens HJ. Usability in telemedicine systems – A literature survey. Int J Med Inform 2016;93:57‑69.
20. Brooke J. Sus: A “Quick and Dirty’usability. Usability Evaluation in Industry. Taylor & Francis: London; 1996. p. 189.
21. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross‑cultural adaptation of self‑report measures. Spine (Phila Pa 1976) 2000;25:3186‑91.
22. Guillemin F, Bombardier C, Beaton D. Cross‑cultural adaptation of health‑related quality of life measures: Literature review and proposed guidelines. J Clin Epidemiol 1993;46:1417‑32.
23. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: A flexibl statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007;39:175‑91.
24. Schermelleh‑Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness‑of‑fit measures. Psychol Methods 2003;8:23‑74.
25. Baumgartner TA, Chung H. Confidence limits for intraclass reliability coefficients. Meas Phys Educ Exerc Sci 2001;5:179‑88.
26. Portney LG, Watkins MP. Foundations of Clinical Research: Applications to Practice. Upper Saddle River, NJ: Pearson/ Prentice Hall; 2009.
27. Juniper EF. How to develop and validate a new health‑related quality of life instrument. In: Quality of Life and Pharamacoeconomics in Clinical Trials. Vol. 1. Lippincott‑Raven Publishers:Philadelphia; 1996. p. 49‑56.
28. Tuğay U, Tuğay N, Gelecek N, Özkan M. Oxford shoulder score: Cross‑cultural adaptation and validation of the Turkish version. Arch Orthop Trauma Surg 2011;131:687‑94.
29. Barit A. Updated guidelines on telemedicine – A step in the right direction. S Afr Med J 2020;110:566.
30. Torre AC, Bibiloni N, Sommer J, Plazzotta F, Angles MV, Terrasa SA, et al. Spanish translation and transcultural adaptation of a questionnaire on telemedicine usability. Medicina (B Aires) 2020;80:134‑7.
31. Portnoy J, Waller M, Elliott T. Telemedicine in the era of COVID‑19. J Allergy Clin Immunol Pract 2020;8:1489‑91.

APA	ÖZDEN F, Özkeskin M, SARI Z, EKMEKÇİ Ö, YUCEYAR N (2021). The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. , 173 - 179. 10.4103/nsn.nsn_41_21
Chicago	ÖZDEN Fatih,Özkeskin Mehmet,SARI Zübeyir,EKMEKÇİ Özgül,YUCEYAR NUR The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. (2021): 173 - 179. 10.4103/nsn.nsn_41_21
MLA	ÖZDEN Fatih,Özkeskin Mehmet,SARI Zübeyir,EKMEKÇİ Özgül,YUCEYAR NUR The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. , 2021, ss.173 - 179. 10.4103/nsn.nsn_41_21
AMA	ÖZDEN F,Özkeskin M,SARI Z,EKMEKÇİ Ö,YUCEYAR N The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. . 2021; 173 - 179. 10.4103/nsn.nsn_41_21
Vancouver	ÖZDEN F,Özkeskin M,SARI Z,EKMEKÇİ Ö,YUCEYAR N The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. . 2021; 173 - 179. 10.4103/nsn.nsn_41_21
IEEE	ÖZDEN F,Özkeskin M,SARI Z,EKMEKÇİ Ö,YUCEYAR N "The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis." , ss.173 - 179, 2021. 10.4103/nsn.nsn_41_21
ISNAD	ÖZDEN, Fatih vd. "The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis". (2021), 173-179. https://doi.org/10.4103/nsn.nsn_41_21

APA	ÖZDEN F, Özkeskin M, SARI Z, EKMEKÇİ Ö, YUCEYAR N (2021). The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. Neurological sciences and neurophysiology (Online), 38(3), 173 - 179. 10.4103/nsn.nsn_41_21
Chicago	ÖZDEN Fatih,Özkeskin Mehmet,SARI Zübeyir,EKMEKÇİ Özgül,YUCEYAR NUR The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. Neurological sciences and neurophysiology (Online) 38, no.3 (2021): 173 - 179. 10.4103/nsn.nsn_41_21
MLA	ÖZDEN Fatih,Özkeskin Mehmet,SARI Zübeyir,EKMEKÇİ Özgül,YUCEYAR NUR The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. Neurological sciences and neurophysiology (Online), vol.38, no.3, 2021, ss.173 - 179. 10.4103/nsn.nsn_41_21
AMA	ÖZDEN F,Özkeskin M,SARI Z,EKMEKÇİ Ö,YUCEYAR N The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. Neurological sciences and neurophysiology (Online). 2021; 38(3): 173 - 179. 10.4103/nsn.nsn_41_21
Vancouver	ÖZDEN F,Özkeskin M,SARI Z,EKMEKÇİ Ö,YUCEYAR N The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis. Neurological sciences and neurophysiology (Online). 2021; 38(3): 173 - 179. 10.4103/nsn.nsn_41_21
IEEE	ÖZDEN F,Özkeskin M,SARI Z,EKMEKÇİ Ö,YUCEYAR N "The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis." Neurological sciences and neurophysiology (Online), 38, ss.173 - 179, 2021. 10.4103/nsn.nsn_41_21
ISNAD	ÖZDEN, Fatih vd. "The Reliability and Validity of the Turkish Version of the Telehealth Usability Questionnaire and the Telemedicine Satisfaction Questionnaire in Patients with Multiple Sclerosis". Neurological sciences and neurophysiology (Online) 38/3 (2021), 173-179. https://doi.org/10.4103/nsn.nsn_41_21