Developing a Scale for Assessing Feasibility of Psychoeducational and Psychotherapy Protocols: A Guide for Researchers

Document Type : Original Article

Authors

1 Ph.D. Student, Department of Psychology, Faculty of Humanities, Tarbiat Modares University, Tehran, Iran.

2 Associate Professor, Department of Psychology, Faculty of Humanities, Tarbiat Modares University, Tehran, Iran.

3 Assistance Professor, Department of Psychology, Faculty of Humanities, Tarbiat Modares University, Tehran, Iran.

Abstract

Aim: This study aims to assess the effectiveness of educational and therapeutic programs in interventional studies, necessitating the initial evaluation of the program provided in the feasibility study. The primary objective is to present a comprehensive examination of the feasibility study and its components, accompanied by the development of a scale for researchers to evaluate the feasibility of psychological programs and protocols.
 
Method: Initially, a checklist consisting of 54 questions was prepared based on feasibility components. For content validity, 12 experts were selected using purposive sampling, who evaluated the appropriateness and necessity of each question. The results, including content validity ratio, content validity index, S-CVI/UA, S-CVI/Ave, and Cronbach’s alpha, were analyzed.
 
Results: The questions demonstrated high appropriateness scores ranging from 0.83 to 1. Content validity results, S-CVI/UA, S-CVI/Ave, and Cronbach’s alpha indicated that the checklist possesses high content validity index and reliability.
 
Conclusion: Feasibility studies are crucial for the successful implementation of randomized controlled trial interventions. This checklist, with high content validity and reliability, serves as a valuable tool for assessing the feasibility of psychological programs and protocols, contributing to the generation of robust evidence supporting intervention effectiveness and long-term implementation.

Keywords

References

Armstrong, T. S., Cohen, M. Z., Eriksen, L., & Cleeland, C. (2005). Content validity of self-report measurement instruments: an illustration from the development of the Brain Tumor Module of the MD Anderson Symptom Inventory. Oncology nursing forum, 32)3(, 669. [Link]
Arnold, D. M., Burns, K. E., Adhikari, N. K., Kho, M. E., Meade, M. O., & Cook, D. J. (2009). The design and interpretation of pilot trials in clinical research in critical care. Critical care medicine, 37(1), 69-S74. [Link]
Bland, J. M., & Altman, D. G. (1997). Statistics notes: Cronbach's alpha. Bmj, 314(7080), 572. [Link]
Bowen, D. J., Kreuter, M., Spring, B., Cofta-Woerpel, L., Linnan, L., Weiner, D., Bakken, S., Kaplan, C. P., Squiers, L., & Fabrizio, C. (2009). How we design feasibility studies. American Journal of Preventive Medicine, 36(5), 452-457. [Link]
Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Vol. 17: Sage publications. [Link]
Collins, D. (2003). Pretesting survey instruments: an overview of cognitive methods. Quality of life research, 12(3), 229-238. [Link]
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008). Developing and evaluating complex interventions: the new Medical Research Council guidance. Bmj, 337. [Link]
Davis, L. L. (1992). Instrument review: Getting the most from a panel of experts. Applied nursing research, 5(4), 194-197. [Link]
Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016). Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PloS one, 11(3), e0150205. [Link]
Farahani, H., & Roshan Chesli, R. (2020). Essentials for developing and validating psychological scales: Guide to best practices. Clinical Psychology and Personality, 17(2), 197-212. [Link]
Gadke, D. L., Kratochwill, T. R., & Gettinger, M. (2021). Incorporating feasibility protocols in intervention research. Journal of School Psychology, 84, 1-18. [Link]
Haynes, S. N., Richard, D., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological assessment, 7(3), 238. [Link]
 
Jones, T. A., Olds, T. S., Currow, D. C., & Williams, M. T. (2017). Feasibility and pilot studies in palliative care research: a systematic review. Journal of pain and symptom management, 54(1), 139-151. e134. [Link]
Kazdin, A. E. (2018). Innovations in psychosocial interventions and their delivery: Leveraging cutting-edge science to improve the world’s mental health. Oxford University Press. [Link]
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel psychology, 28(4), 563-575. [Link]
Moore, L., Hallingberg, B., Wight, D., Turley, R., Segrott, J., Craig, P., ... & Moore, G. (2018). Exploratory studies to inform full-scale evaluations of complex public health interventions: the need for guidance. J Epidemiol Community Health. 72(10): 865–866. [Link]
Orsmond, G. I., & Cohn, E. S. (2015). The distinctive features of a feasibility study: objectives and guiding questions. OTJR: occupation, participation and health, 35(3), 169-177. [Link]
Sanson-Fisher, R. W., Bonevski, B., Green, L. W., & D’Este, C. (2007). Limitations of the randomized controlled trial in evaluating population-based health interventions. American Journal of Preventive Medicine, 33(2), 155-161. [Link]
Saw, S. M., & Ng, T. P. (2001). The design and assessment of questionnaires in clinical research. Singapore medical journal, 42(3), 131-135. [Link]
Shi, J., Mo, X., & Sun, Z. (2012). Content validity index in scale development. Zhong nan da xue xue bao. Yi xue ban= Journal of Central South University. Medical Sciences, 37(2), 152-155. [Link]
Stein, K. F., Sargent, J. T., & Rafaels, N. (2007). Intervention research: establishing fidelity of the independent variable in nursing clinical trials. Nursing research, 56(1), 54-62. [Link]
Stone, D. H. (1993). Design a questionnaire. British Medical Journal, 307(6914), 1264-1266. [Link]
Tickle-Degnen, L. (2013). Nuts and bolts of conducting feasibility studies. American Journal of Occupational Therapy, 67(2), 171-176. [Link]
Wong, P. T. P., & Roy, S. (2018). Critique of positive psychology and positive interventions. In N. J. L. Brown, T. Lomas, & F. J. Eiroa-Orosa (Eds.), The Routledge international handbook of critical positive psychology (pp. 142–160). Routledge/Taylor & Francis Group. [Link]
Yamada, J., Stevens, B., Sidani, S., Watt‐Watson, J., & De Silva, N. (2010). Content validity of a process evaluation checklist to measure intervention implementation fidelity of the EPIC intervention. Worldviews on Evidence‐Based Nursing, 7(3), 158-164. [Link]
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. R. (2015). Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of caring sciences, 4(2), 165. [Link]

Files

Share

How to cite

Statistics