This article is a narrative review that discusses the recommended sample size requirements to design a pilot study to assess the reliability of a questionnaire. A list of various sample size tables that are based on the kappa agreement test, intra-class correlation test and Cronbach’s alpha test has been compiled together. For all calculations, type I error (alpha) was set at a maximum value of 0.05, and power was set at a minimum value of 80.0%. For the kappa agreement test, intra-class correlation test, and Cronbach’s alpha test, the recommended minimum sample size requirement based on the ideal effect sizes shall be at least 15, 22, and 24 subjects respectively. By making allowances for a non-response rate of 20.0%, a minimum sample size of 30 respondents will be sufficient to assess the reliability of the questionnaire. The clear guideline of minimum sample size requirement for the pilot study to assess the reliability of a questionnaire is discussed and this will ease researchers in preparation for the pilot study. This study provides justification for a minimum requirement of a sample size of 30 respondents specifically to test the reliability of a questionnaire.

Citations

Citations to this article as recorded by  

• Enhancing energy resilience in manufacturing enterprises: A systematic mapping of challenges to strategies
  P. Lebepe, T.N.D. Mathaba
  Journal of Economy and Technology.2025; 3: 82.     CrossRef
• Impact of digital device utilization on public health surveillance to enhance city resilience during the public health emergency response: A case study of SARS-CoV-2 response in Thailand (2020–2023)
  Watcharaporn Chutarong, Roongaroon Thammalikhit, Rungwasun Kraiklang, Anurak Sawangwong, Orachorn Saechang, Yuqian Guo, Weiwen Zhang
  DIGITAL HEALTH.2025;[Epub]     CrossRef
• Quality of Life and the Role of Gender in Patients With Non-Melanoma Skin Cancer in Greece
  Nikolitsa S Dareioti, Christos Τ Lampropoulos, Balasis B Stavros, Sophia Georgiou, Philippos Gourzis, Nicholas S Mastronikolis
  Cureus.2025;[Epub]     CrossRef
• Exploring public perspectives on solar energy adoption in Mexico
  Ana Sofia Andrade-Arias, Golam Kabir, Mehdi Mirmohammadsadeghi, Angappa Gunasekaran, Armando Elizondo-Noriega
  Renewable and Sustainable Energy Reviews.2025; 212: 115410.     CrossRef
• Development and Initial Validation of the Psychosocial Stress Scale for Dancers
  Yuqianqian Dong, Young-Eun Noh, Siqi Liu, Eliza Hafiz
  SSRN Electronic Journal.2025;[Epub]     CrossRef
• Analyzing factors influencing students’ decisions to adopt smart classrooms in higher education
  Long Kim, Rungrawee Jitpakdee, Wasin Praditsilp, Sook Fern Yeo
  Education and Information Technologies.2025;[Epub]     CrossRef
• Collaborative Working Relationships Between Community Prevention Coalitions and Their Technical Assistance Providers: A Mixed Methods Approach for the Development of an Innovative Implementation Measure
  Sarah M. Chilenski, Meg Small, Jochebed G. Gayles, Brittany Rhoades Cooper, Louis D. Brown
  Prevention Science.2025; 26(2): 193.     CrossRef
• Intentions of hospital pharmacists to use digital technology in their daily practice: a cross-sectional survey using the Theory of Planned Behaviour
  Kamer Tecen-Yucel, Nesligül Ozdemir-Ayduran, Emre Kara, Kutay Demirkan, Betul Okuyan
  International Journal of Clinical Pharmacy.2025;[Epub]     CrossRef
• Development and validation of the nurses’ touch comfort evaluation scale in China
  Yaohong Liu, Sainan Qiu, Hao Li, Chong Chen, Renhe Yu, Su’e Yuan
  BMC Nursing.2025;[Epub]     CrossRef
• Sequential mediator and moderator model of intention for the implementation of chatbots in Malaysian government agencies
  Ramizatunnisah Jais, Abdul Hafaz Ngah
  Journal of Decision Systems.2025;[Epub]     CrossRef
• Freshmen’s Perceptions of the Effect of Technology on Learning English: A Case Study at the National University of Battambang, Cambodia
  Keo Vireak, Sam Rany, Lan Bunrosy, Rouet Wen
  Journal of Social Knowledge Education (JSKE).2025; 6(1): 54.     CrossRef
• Exploring EFL students’ challenges in oral presentations at National University of Battambang
  Vireak Keo, Bunrosy Lan, Rany Sam, Wen Rouet
  International Journal of Professional Development, Learners and Learning.2025; 7(2): e2513.     CrossRef
• Development and validation of the Persian Prosthesis Embodiment Scale for Lower Limb Amputees
  Alireza Khani, Robin Bekrater-Bodmann, Zahra Fattahi, Vahideh Moradi, Mehdi Rezaee, Taher Babaee
  Disability and Rehabilitation.2025; : 1.     CrossRef
• Psychometric properties of the Persian version of the treatment satisfaction questionnaire for medication (TSQM) among Iranian hypertensive patients
  Ali Khalooei, Mohadeseh Ghasemi, Sahar Salehi, Farshid Sharifi, Mehran Nakhaeizadeh
  Chronic Illness.2025;[Epub]     CrossRef
• The SCIEPR checklist: A tool for standardizing chest X-ray interpretation in resource-constrained settings – A pilot study
  K.M. Sethole, N. Mshunqane
  Radiography.2025; 31(3): 102912.     CrossRef
• Preliminary efficacy of an online intervention based on Acceptance and Commitment Therapy for family caregivers of people with dementia: a feasibility study
  Golnaz L. Atefi, Rosalie J. M. van Knippenberg, Sara Laureen Bartels, Andrés Losada-Baltar, María Márquez-González, Frans R. J. Verhey, Marjolein E. de Vugt
  Cognitive Behaviour Therapy.2025; : 1.     CrossRef
• Extracurricular physical activities and academic achievement in Saudi female physical education students: the mediating effect of motivation, enjoyment, and BMI
  Mohamed Frikha
  Frontiers in Psychology.2025;[Epub]     CrossRef
• Development and validation of the Thai Halitosis Associated Life-Quality Test (T-HALT): an evaluation of psychometric properties
  Yodhathai Satravaha, Katkarn Thitiwatpalakarn, Supakit Peanchitlertkajorn, Supatchai Boonpratham, Chaiyapol Chaweewannakorn, Kawin Sipiyaruk
  BMC Oral Health.2024;[Epub]     CrossRef
• Developing and validating a culturally tailored questionnaire to assess COVID-19 vaccine hesitancy in Israel’s ultraorthodox Jewish population
  Imanuel Ber, Wasef Na’amnih, Saritte Perlman, Ben Kasstan, Yehuda Lerman, Khitam Muhsen
  Human Vaccines & Immunotherapeutics.2024;[Epub]     CrossRef
• Construct Validity and Reliability of the Effective Early Childhood Physical Literacy Pedagogue (ECE-PLP) Self-Report Instrument
  Jaime Barratt, Dean Dudley, Michalis Stylianou, George Thomas, Kai Wheeler, John Cairney
  Measurement in Physical Education and Exercise Science.2024; : 1.     CrossRef
• Exploring Blood Lead Level Determinants in Refinery Workers: A Cross-Sectional Study
  Luay M Mohammed , Manoochehr Karami, Yadollah Mehrabi , Seyed S Hashemi, Somayeh Farhang Dehghan, Mohammed Rafiee, Hasan Baiee
  Cureus.2024;[Epub]     CrossRef
• Effects of intervention by trained care managers on advance care planning engagement among long-term care service users in Japan: a pre- and post-pilot comparative study across multiple institutions
  Shozo Okochi, Kyoko Oshiro, Noriyasu Takeuchi, Mariko Miyamichi, Tomoe Nakamura, Terumi Matsushima, Masako Okada, Yoshimi Kudo, Takehiro Ishiyama, Tomoyasu Kinoshita, Hideki Kojima, Mitsunori Nishikawa
  Palliative Care and Social Practice.2024;[Epub]     CrossRef
• Cross-cultural adaptation and validation of the Arabic version of the knee and hip health-related quality of life (Mini-OAKHQOL) questionnaire in male Saudi patients with osteoarthritis: a methodological observational design
  Madi Talal Alharbi, Mahamed Ateef, Ahmad Alanazi, Msaad Alzhrani
  PeerJ.2024; 12: e18122.     CrossRef
• The psychometric properties of the Turkish version of the parents' perception of satisfaction with care from pediatric nurse practitioners instrument
  Dilek Demir Kösem, Şenay Demir, Murat Bektaş, Frances DiAnna Kinder
  Journal of Pediatric Nursing.2024; 78: e75.     CrossRef
• Advanced Work Packaging (AWP): Implementation and Challenges in the Malaysian Oil and Gas Sector
  Muhammad Ali Musarat, Wesam Salah Alaloul, Mohd Al-Azahary bin Abdullah Sani, Ng Wei Chong
  Sustainability.2024; 16(23): 10234.     CrossRef
• The assessment of reliability and validity of the Thai Versions of the Thirst Distress Scale for patients with Heart Failure and the Simplified Nutritional Appetite Questionnaire in heart failure patients
  Jenjiratchaya Thanapholsart, Ehsan Khan, Satit Janwanishstaporn, Porntipa Thongma, Saowanee Naowapanich, Pornpoj Pramyothin, Srisakul Chirakarnjanakorn, Porntera Sethalao, Thitipong Tankumpuan, Nana Waldréus, Geraldine A. Lee
  Journal of Research in Nursing.2024; 29(8): 622.     CrossRef
• Measuring internalized health-related stigma across health conditions: development and validation of the I-HEARTS Scale
  Rebecca L. Pearl, Yulin Li, Laurie C. Groshon, Marian Hernandez, Danielle Saunders, Miriam Sheynblyum, Kimberly A. Driscoll, Joel M. Gelfand, Preeti Manavalan, Marjorie Montanez-Wiscovich, Deidre B. Pereira, Rebecca M. Puhl, Thomas A. Wadden, Lori B. Waxe
  BMC Medicine.2024;[Epub]     CrossRef
• A Modular XR Collaborative Platform for Occupational Safety and Health Training: A Case Study in Circular Logistics Facilities
  Ali Vatankhah Barenji, Jorge E. Garcia, Benoit Montreuil
  Information.2024; 15(9): 570.     CrossRef

Citations

Citations to this article as recorded by  

• Quality of Patient-Centered eHealth Information on Erosive Tooth Wear: Systematic Search and Evaluation of Websites and YouTube Videos
  Lena Holland, Amelie Friederike Kanzow, Annette Wiegand, Philipp Kanzow
  Journal of Medical Internet Research.2024; 26: e49514.     CrossRef
• Is it safe to learn about vital pulp capping from YouTube™ videos? A content and quality analysis
  Celalettin Topbaş, Tuğçe Paksoy, Ayşe Gülnihal İslamoğlu, Kemal Çağlar, Abdurrahman Kerim Kul
  International Journal of Medical Informatics.2024; 185: 105409.     CrossRef
• Assessment of the quality of oral biopsy procedure videos shared on YouTube
  A. Díaz‐Rodríguez, J. Limeres‐Posse, R. Albuquerque, V. Brailo, R. Cook, J. C. Fricain, G. Lodi, L. Monteiro, L. Silva, B. Carey, M. Diniz‐Freitas
  Oral Diseases.2024; 30(5): 3081.     CrossRef
• İmplant üstü protezler hakkında bilgi veren internet sitelerinin okunabilirliklerinin değerlendirilmesi
  Tugba TEMİZCİ
  Selcuk Dental Journal.2023; 10(4): 156.     CrossRef
• Online Audio-Visual Information on the Treatment of OSA with Mandibular Advancement Devices: Analysis of Quality, Reliability and Contents
  Serena Incerti-Parenti, Maria Lavinia Bartolucci, Elena Biondi, Andrea Fiordelli, Corrado Paganelli, Giulio Alessandri-Bonetti
  Applied Sciences.2023; 13(9): 5727.     CrossRef
• Evaluating YouTube as a Patient Information Source for the Risks of Root Canal Treatment
  Stewart McLean, Neil Cook, Alexander Rovira-Wilde, Shanon Patel, Shalini Kanagasingam
  Journal of Endodontics.2023; 49(2): 155.     CrossRef
• Assessment of reliability and information quality of YouTube videos about root canal treatment after 2016
  Myoung-jun Jung, Min-Seock Seo
  BMC Oral Health.2022;[Epub]     CrossRef
• Is the YouTube™ a useful resource of information about orthognathic surgery?: A cross-sectional study
  Seyma Bayazıt, Bilal Ege, Mahmut Koparal
  Journal of Stomatology, Oral and Maxillofacial Surgery.2022; 123(6): e981.     CrossRef
• YoutubeTM Content Analysis as a Means of Information in Oral Medicine: A Systematic Review of the Literature
  Antonio Romano, Fausto Fiori, Massimo Petruzzi, Fedora Della Vella, Rosario Serpico
  International Journal of Environmental Research and Public Health.2022; 19(9): 5451.     CrossRef