This article is a narrative review that discusses the recommended sample size requirements to design a pilot study to assess the reliability of a questionnaire. A list of various sample size tables that are based on the kappa agreement test, intra-class correlation test and Cronbach’s alpha test has been compiled together. For all calculations, type I error (alpha) was set at a maximum value of 0.05, and power was set at a minimum value of 80.0%. For the kappa agreement test, intra-class correlation test, and Cronbach’s alpha test, the recommended minimum sample size requirement based on the ideal effect sizes shall be at least 15, 22, and 24 subjects respectively. By making allowances for a non-response rate of 20.0%, a minimum sample size of 30 respondents will be sufficient to assess the reliability of the questionnaire. The clear guideline of minimum sample size requirement for the pilot study to assess the reliability of a questionnaire is discussed and this will ease researchers in preparation for the pilot study. This study provides justification for a minimum requirement of a sample size of 30 respondents specifically to test the reliability of a questionnaire.

Citations

Citations to this article as recorded by  

• Enhancing energy resilience in manufacturing enterprises: A systematic mapping of challenges to strategies
  P. Lebepe, T.N.D. Mathaba
  Journal of Economy and Technology.2025; 3: 82.     CrossRef
• Impact of digital device utilization on public health surveillance to enhance city resilience during the public health emergency response: A case study of SARS-CoV-2 response in Thailand (2020–2023)
  Watcharaporn Chutarong, Roongaroon Thammalikhit, Rungwasun Kraiklang, Anurak Sawangwong, Orachorn Saechang, Yuqian Guo, Weiwen Zhang
  DIGITAL HEALTH.2025;[Epub]     CrossRef
• Quality of Life and the Role of Gender in Patients With Non-Melanoma Skin Cancer in Greece
  Nikolitsa S Dareioti, Christos Τ Lampropoulos, Balasis B Stavros, Sophia Georgiou, Philippos Gourzis, Nicholas S Mastronikolis
  Cureus.2025;[Epub]     CrossRef
• Exploring public perspectives on solar energy adoption in Mexico
  Ana Sofia Andrade-Arias, Golam Kabir, Mehdi Mirmohammadsadeghi, Angappa Gunasekaran, Armando Elizondo-Noriega
  Renewable and Sustainable Energy Reviews.2025; 212: 115410.     CrossRef
• Development and Initial Validation of the Psychosocial Stress Scale for Dancers
  Yuqianqian Dong, Young-Eun Noh, Siqi Liu, Eliza Hafiz
  SSRN Electronic Journal.2025;[Epub]     CrossRef
• Analyzing factors influencing students’ decisions to adopt smart classrooms in higher education
  Long Kim, Rungrawee Jitpakdee, Wasin Praditsilp, Sook Fern Yeo
  Education and Information Technologies.2025;[Epub]     CrossRef
• Collaborative Working Relationships Between Community Prevention Coalitions and Their Technical Assistance Providers: A Mixed Methods Approach for the Development of an Innovative Implementation Measure
  Sarah M. Chilenski, Meg Small, Jochebed G. Gayles, Brittany Rhoades Cooper, Louis D. Brown
  Prevention Science.2025; 26(2): 193.     CrossRef
• Intentions of hospital pharmacists to use digital technology in their daily practice: a cross-sectional survey using the Theory of Planned Behaviour
  Kamer Tecen-Yucel, Nesligül Ozdemir-Ayduran, Emre Kara, Kutay Demirkan, Betul Okuyan
  International Journal of Clinical Pharmacy.2025;[Epub]     CrossRef
• Development and validation of the nurses’ touch comfort evaluation scale in China
  Yaohong Liu, Sainan Qiu, Hao Li, Chong Chen, Renhe Yu, Su’e Yuan
  BMC Nursing.2025;[Epub]     CrossRef
• Sequential mediator and moderator model of intention for the implementation of chatbots in Malaysian government agencies
  Ramizatunnisah Jais, Abdul Hafaz Ngah
  Journal of Decision Systems.2025;[Epub]     CrossRef
• Freshmen’s Perceptions of the Effect of Technology on Learning English: A Case Study at the National University of Battambang, Cambodia
  Keo Vireak, Sam Rany, Lan Bunrosy, Rouet Wen
  Journal of Social Knowledge Education (JSKE).2025; 6(1): 54.     CrossRef
• Exploring EFL students’ challenges in oral presentations at National University of Battambang
  Vireak Keo, Bunrosy Lan, Rany Sam, Wen Rouet
  International Journal of Professional Development, Learners and Learning.2025; 7(2): e2513.     CrossRef
• Development and validation of the Persian Prosthesis Embodiment Scale for Lower Limb Amputees
  Alireza Khani, Robin Bekrater-Bodmann, Zahra Fattahi, Vahideh Moradi, Mehdi Rezaee, Taher Babaee
  Disability and Rehabilitation.2025; : 1.     CrossRef
• Psychometric properties of the Persian version of the treatment satisfaction questionnaire for medication (TSQM) among Iranian hypertensive patients
  Ali Khalooei, Mohadeseh Ghasemi, Sahar Salehi, Farshid Sharifi, Mehran Nakhaeizadeh
  Chronic Illness.2025;[Epub]     CrossRef
• The SCIEPR checklist: A tool for standardizing chest X-ray interpretation in resource-constrained settings – A pilot study
  K.M. Sethole, N. Mshunqane
  Radiography.2025; 31(3): 102912.     CrossRef
• Development and validation of the Thai Halitosis Associated Life-Quality Test (T-HALT): an evaluation of psychometric properties
  Yodhathai Satravaha, Katkarn Thitiwatpalakarn, Supakit Peanchitlertkajorn, Supatchai Boonpratham, Chaiyapol Chaweewannakorn, Kawin Sipiyaruk
  BMC Oral Health.2024;[Epub]     CrossRef
• Developing and validating a culturally tailored questionnaire to assess COVID-19 vaccine hesitancy in Israel’s ultraorthodox Jewish population
  Imanuel Ber, Wasef Na’amnih, Saritte Perlman, Ben Kasstan, Yehuda Lerman, Khitam Muhsen
  Human Vaccines & Immunotherapeutics.2024;[Epub]     CrossRef
• Construct Validity and Reliability of the Effective Early Childhood Physical Literacy Pedagogue (ECE-PLP) Self-Report Instrument
  Jaime Barratt, Dean Dudley, Michalis Stylianou, George Thomas, Kai Wheeler, John Cairney
  Measurement in Physical Education and Exercise Science.2024; : 1.     CrossRef
• Exploring Blood Lead Level Determinants in Refinery Workers: A Cross-Sectional Study
  Luay M Mohammed , Manoochehr Karami, Yadollah Mehrabi , Seyed S Hashemi, Somayeh Farhang Dehghan, Mohammed Rafiee, Hasan Baiee
  Cureus.2024;[Epub]     CrossRef
• Effects of intervention by trained care managers on advance care planning engagement among long-term care service users in Japan: a pre- and post-pilot comparative study across multiple institutions
  Shozo Okochi, Kyoko Oshiro, Noriyasu Takeuchi, Mariko Miyamichi, Tomoe Nakamura, Terumi Matsushima, Masako Okada, Yoshimi Kudo, Takehiro Ishiyama, Tomoyasu Kinoshita, Hideki Kojima, Mitsunori Nishikawa
  Palliative Care and Social Practice.2024;[Epub]     CrossRef
• Cross-cultural adaptation and validation of the Arabic version of the knee and hip health-related quality of life (Mini-OAKHQOL) questionnaire in male Saudi patients with osteoarthritis: a methodological observational design
  Madi Talal Alharbi, Mahamed Ateef, Ahmad Alanazi, Msaad Alzhrani
  PeerJ.2024; 12: e18122.     CrossRef
• The psychometric properties of the Turkish version of the parents' perception of satisfaction with care from pediatric nurse practitioners instrument
  Dilek Demir Kösem, Şenay Demir, Murat Bektaş, Frances DiAnna Kinder
  Journal of Pediatric Nursing.2024; 78: e75.     CrossRef
• Advanced Work Packaging (AWP): Implementation and Challenges in the Malaysian Oil and Gas Sector
  Muhammad Ali Musarat, Wesam Salah Alaloul, Mohd Al-Azahary bin Abdullah Sani, Ng Wei Chong
  Sustainability.2024; 16(23): 10234.     CrossRef
• The assessment of reliability and validity of the Thai Versions of the Thirst Distress Scale for patients with Heart Failure and the Simplified Nutritional Appetite Questionnaire in heart failure patients
  Jenjiratchaya Thanapholsart, Ehsan Khan, Satit Janwanishstaporn, Porntipa Thongma, Saowanee Naowapanich, Pornpoj Pramyothin, Srisakul Chirakarnjanakorn, Porntera Sethalao, Thitipong Tankumpuan, Nana Waldréus, Geraldine A. Lee
  Journal of Research in Nursing.2024; 29(8): 622.     CrossRef
• Measuring internalized health-related stigma across health conditions: development and validation of the I-HEARTS Scale
  Rebecca L. Pearl, Yulin Li, Laurie C. Groshon, Marian Hernandez, Danielle Saunders, Miriam Sheynblyum, Kimberly A. Driscoll, Joel M. Gelfand, Preeti Manavalan, Marjorie Montanez-Wiscovich, Deidre B. Pereira, Rebecca M. Puhl, Thomas A. Wadden, Lori B. Waxe
  BMC Medicine.2024;[Epub]     CrossRef
• A Modular XR Collaborative Platform for Occupational Safety and Health Training: A Case Study in Circular Logistics Facilities
  Ali Vatankhah Barenji, Jorge E. Garcia, Benoit Montreuil
  Information.2024; 15(9): 570.     CrossRef