Health  Vol.7 No.12 , December 2015
Fidelity of Intervention Implementation: A Review of Instruments
ABSTRACT
Background: Interventions, whether simple or complex, are increasing in health care in response to the growing complexity and acuity of patient’s conditions. Monitoring the fidelity of implementing interventions is challenging. A common method to assess and monitor fidelity of intervention implementation is through a structured, reliable and valid instrument. Purpose: The purpose of this paper is to examine existing instruments measuring fidelity of intervention implementation in order to determine aspects of fidelity that have been assessed and reported on the reliability and validity of these instruments. Design: A descriptive review was conducted. Studies were included if they described and reported on the fidelity of intervention implementation instruments, their psychometric properties were published between 1980 and 2015. Methods: Data were extracted on the study characteristics, levels and aspects of fidelity and the psychometric properties, specifically the reliability and validity of the fidelity of intervention implementation instruments. Results: In total, 21 studies were included in the review. Overall results showed that some aspects and levels of fidelity of intervention implementation are included in the instruments. At the theoretical level, fidelity of intervention implementation is not accounted for majority of the studies and few explicitly reports on the use of instruments to evaluate intervention differentiation. At the operational level, interventionists’ adherence and competence are included in the instruments; however, participants’ engagement, exposure and enactment are not. The instruments demonstrate acceptable level of validity and reliability. Conclusion: Sustained focus on developing psychometrically sound instruments that account for all levels (i.e. theoretical and operational) and aspects of fidelity of intervention implementation is imperative to strengthen the methodological literature for interventions research; and for researchers to correctly interpret research findings and to arrive at valid conclusions on the effectiveness of interventions, whether simple or complex.

Cite this paper
Ibrahim, S. and Sidani, S. (2015) Fidelity of Intervention Implementation: A Review of Instruments. Health, 7, 1687-1695. doi: 10.4236/health.2015.712183.
References
[1]   Sidani, S. and Braden, C.J. (2011) Design, Evaluation, and Translation of Nursing Interventions. Wiley-Blackwell, Ames.

[2]   Eysenck, H. (1952) The Effects of Psychotherapy, an Evaluation. Journal of Consulting Psychology, 16, 319-324.
http://dx.doi.org/10.1037/h0063633

[3]   VandenBos, G.R. (1980) Psychotherapy: Practice, Research, Policy. Sage, Beverly Hills.

[4]   Moncher, F.J. and Prinz, R.J. (1991) Treatment Fidelity in Outcome Studies. Clinical Psychology Review, 11, 247-266.
http://dx.doi.org/10.1016/0272-7358(91)90103-2

[5]   Gearing, R.E., El-Bassel, N., Ghesquiere, A., Baldwin, S., Gillies, J. and Ngeow, E. (2011) Major Ingredients of Fidelity: A Review and Scientific Guide to Improving Quality of Intervention Research Implementation. Clinical Psychology Review, 31, 79-88.
http://dx.doi.org/10.1016/j.cpr.2010.09.007

[6]   Bellg, A.J., Borrelli, B., Resnick, B., Hecht, J., Minicucci, D.S., Ory, M., et al. (2004) Enhancing Treatment Fidelity in Health Behavior Change Studies: Best Practices and Recommendations from the NIH Behaviour Change Consortium. Health Psychology, 23, 443-451.
http://dx.doi.org/10.1037/0278-6133.23.5.443

[7]   Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J. and Balain, S. (2007) A Conceptual Framework for Implementation Fidelity. Implementation Science, 2, 40.
http://dx.doi.org/10.1186/1748-5908-2-40

[8]   Stein, K.F., Sargent, J.T. and Rafaels, N. (2007) Intervention Research: Establishing Fidelity of the Independent Variable in Nursing Clinical Trials. Nursing Research, 56, 54-62.
http://dx.doi.org/10.1097/00006199-200701000-00007

[9]   Shadish, W.R., Cook, T.D. and Campbell, D.T. (2002) Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Houghton Mifflin Company, Boston.

[10]   Dusenbury, L., Brannigan, R., Falco, M. and Hansen, W.B. (2003) A Review of Research on Fidelity of Implementation: Implications for Drug Abuse Prevention in School Settings. Health Education Research, 18, 237-256.
http://dx.doi.org/10.1093/her/18.2.237

[11]   Brandt, P.A., Kirsch, S.D., Lewis, F.M. and Casey, S.M. (2004) Assessing the Strength and Integrity of an Intervention. Oncology Nursing Forum, 31, 833-837.
http://dx.doi.org/10.1188/04.ONF.833-837

[12]   Dumas, J.E., Lynch, A.M., Laughlin, J.E., Smith, P.E. and Prinze, R.J. (2001) Promoting Intervention Fidelity: Conceptual Issues, Methods, and Preliminary Results from the EARLY ALLIANCE Prevention Trial. American Journal of Preventive Medicine, 20, 38-47.
http://dx.doi.org/10.1016/S0749-3797(00)00272-5

[13]   Borrelli, B., Sepinwall, D., Ernst, D., Bellg, A.J., Czajkowski, S., Breger, R., et al. (2005) A New Tool to Assess Treatment Fidelity and Evaluation of Treatment Fidelity across 10 Years of Health Behaviour Research. Journal of Consulting and Clinical Psychology, 73, 852-860.
http://dx.doi.org/10.1037/0022-006X.73.5.852

[14]   Santacroce, S.J., Maccarelli, L.M. and Grey, M. (2004) Intervention Fidelity. Nursing Research, 53, 63-66.
http://dx.doi.org/10.1097/00006199-200401000-00010

[15]   Mowbray, C.T., Holter, M.C., Teague, G.B. and Bybee, D. (2003) Fidelity Criteria: Development, Measurement, and Validation. American Journal of Evaluation, 24, 315-340.
http://dx.doi.org/10.1016/S1098-2140(03)00057-2

[16]   Faiburn, C.G. and Cooper, Z. (2011) Therapist Competence, Therapy Quality and Therapist Training. Behavioral Research and Therapy, 49, 373-378.
http://dx.doi.org/10.1016/j.brat.2011.03.005

[17]   Streiner, D.L. and Norman, G.R. (2008) Health Measurement Scales: A Practical Guide to Their Development and Use. 4th Edition, Oxford University Press Inc., New York.
http://dx.doi.org/10.1093/acprof:oso/9780199231881.001.0001

[18]   DeVon, H.A., Block, M.E., Moyle-Wright, P., Ernst, D.M., Hayden, S.J., Lazzara, D.J., et al. (2007) A Psychometric Toolbox for Testing Validity and Reliability. Journal of Nursing Scholarship, 39, 155-164.
http://dx.doi.org/10.1111/j.1547-5069.2007.00161.x

[19]   Fayers, P.M. and Machin, D. (2007) Quality of Life. 2nd Edition, John Wiley & Sons Inc., Hobo-ken.
http://dx.doi.org/10.1002/9780470024522

[20]   Eigenmann, C.A., Colagiuri, T.C., Skinner, T.C. and Trevena, L. (2009) Are Current Psychometric Tools Suitable for Measuring Outcomes for Diabetes Education? Diabetes Medicine, 26, 425-436.
http://dx.doi.org/10.1111/j.1464-5491.2009.02697.x

[21]   Breitenstein, S.M., Fogg, L., Garvey, C., Hill, C., Resnick, B. and Gross, D. (2010) Measuring Implementation Fidelity in a Community-Based Parenting Intervention. Nursing Research, 59, 158-165.
http://dx.doi.org/10.1097/NNR.0b013e3181dbb2e2

[22]   Di Rezze, B., Law, M., Gorter, J.W., Eva, K. and Pollock, N. (2012) A Narrative Review of Generic Intervention Fidelity Measures. Physical and Occupational Therapy in Pediatrics, 32, 430-446.
http://dx.doi.org/10.3109/01942638.2012.713454

[23]   Hogue, A., Liddle, H.A. and Rowe, C. (1996) Treatment Adherence Process Research in Family Therapy: A Rationale and Some Practical Guidelines. Psychotherapy, 33, 332-345.
http://dx.doi.org/10.1037/0033-3204.33.2.332

[24]   Barber, J.P. and Crits-Christoph, P. (1996) Development of a Therapist Adherence/Competence Rating Scale for Supportive-Expressive Dynamic Psychotherapy: A Preliminary Report. Psychotherapy Research, 6, 81-94.
http://dx.doi.org/10.1080/10503309612331331608

[25]   Perepletchikova, F., Treat, T.A. and Kazdin, A.E. (2007) Treatment Integrity in Psychotherapy Research: Analysis of the Studies and Examination of the Associated Factors. Journal of Consulting and Clinical Psychology, 75, 829-841.
http://dx.doi.org/10.1037/0022-006X.75.6.829

[26]   Waltz, J., Addis, M., Koerner, K. and Jacobson, N.S. (1993) Testing the Integrity of a Psychotherapy Protocol: Assessment of Adherence and Competence. Journal of Consulting and Clinical Psychology, 61, 620-630.
http://dx.doi.org/10.1037/0022-006X.61.4.620

[27]   Leventhal, H. and Friedman, M.A. (2004) Does Establishing Fidelity of Treatment Help in Understanding Treatment Efficacy? Comment on Bellg et al. (2004). Health Psychology, 23, 452-456.
http://dx.doi.org/10.1037/0278-6133.23.5.452

[28]   Lichstein, K.L., Riedel, B.W. and Grieve, R. (1994) Fair Tests of Clinical Trials: A Treatment Implementation Model. Advances in Behaviour Research and Therapy, 16, 1-29.
http://dx.doi.org/10.1016/0146-6402(94)90001-9

[29]   Sidani, S. (2015) Health Intervention Research: Understanding Research Design and Methods. Sage, Thousand Oaks.

 
 
Top