1932

Abstract

The wide variety of dissemination and implementation designs now being used to evaluate and improve health systems and outcomes warrants review of the scope, features, and limitations of these designs. This article is one product of a design workgroup that was formed in 2013 by the National Institutes of Health to address dissemination and implementation research, and whose members represented diverse methodologic backgrounds, content focus areas, and health sectors. These experts integrated their collective knowledge on dissemination and implementation designs with searches of published evaluations strategies. This article emphasizes randomized and nonrandomized designs for the traditional translational research continuum or pipeline, which builds on existing efficacy and effectiveness trials to examine how one or more evidence-based clinical/prevention interventions are adopted, scaled up, and sustained in community or service delivery systems. We also mention other designs, including hybrid designs that combine effectiveness and implementation research, quality improvement designs for local knowledge, and designs that use simulation modeling.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-publhealth-031816-044215
2017-03-20
2024-03-28
Loading full text...

Full text loading...

/deliver/fulltext/publhealth/38/1/annurev-publhealth-031816-044215.html?itemId=/content/journals/10.1146/annurev-publhealth-031816-044215&mimeType=html&fmt=ahah

Literature Cited

  1. Aarons GA, Hurlburt M, Horwitz SM. 1.  2011. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm. Policy Ment. Health Ment. Health Serv. Res. 38:4–23 [Google Scholar]
  2. Aarons GA, Sommerfeld DH, Walrath-Greene CM. 2.  2009. Evidence-based practice implementation: the impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implement. Sci. 4:83 [Google Scholar]
  3. Angrist JD, Imbens GW, Rubin DB. 3.  1996. Identification of causal effects using instrumental variables. J. Am. Stat. Assoc. 91:444–55 [Google Scholar]
  4. Aspry KE, Furman R, Karalis DG, Jacobson TA, Zhang AM. 4.  et al. 2013. Effect of health information technology interventions on lipid management in clinical practice: a systematic review of randomized controlled trials. J. Clin. Lipidol. 7:546–60 [Google Scholar]
  5. Baer DM, Wolf MM, Risley TR. 5.  1968. Some current dimensions of applied behavior analysis. J. Appl. Behav. Anal. 1:91–97 [Google Scholar]
  6. Belenko S, Wiley T, Knight D, Dennis M, Wasserman G, Taxman F. 6.  2015. A new behavioral health services cascade framework for measuring unmet addiction health services needs and adolescent offenders: conceptual and measurement challenges. Addict. Sci. Clin. Pract. 10:Suppl. 1A4 [Google Scholar]
  7. Biglan A, Ary D, Wagenaar AC. 7.  2000. The value of interrupted time-series experiments for community intervention research. Prev. Sci. 1:31–49 [Google Scholar]
  8. Blackstock OJ, King JR, Mason RD, Lee CC, Mannheimer SB. 8.  2010. Evaluation of a rapid HIV testing initiative in an urban, hospital-based dental clinic. AIDS Patient Care STDs 24:781–85 [Google Scholar]
  9. Bloom HS. 9.  1984. Accounting for no-shows in experimental evaluation designs. Eval. Rev. 8:225–46 [Google Scholar]
  10. Brown CA, Lilford RJ. 10.  2006. The stepped wedge trial design: a systematic review. BMC Med. Res. Methodol. 6:54 [Google Scholar]
  11. Brown CH, Chamberlain P, Saldana L, Padgett C, Wang W, Cruden G. 11.  2014. Evaluation of two implementation strategies in fifty-one child county public service systems in two states: results of a cluster randomized head-to-head implementation trial. Implement. Sci. 9:134 [Google Scholar]
  12. Brown CH, Liao J. 12.  1999. Principles for designing randomized preventive trials in mental health: an emerging developmental epidemiology paradigm. Am. J. Commun. Psychol. 27:673–710 [Google Scholar]
  13. Brown CH, Mohr DC, Gallo CG, Mader C, Palinkas L. 13.  et al. 2013. A computational future for preventing HIV in minority communities: how advanced technology can improve implementation of effective programs. J. Acquir. Immune Defic. Syndr. 63:S72–84 [Google Scholar]
  14. Brown CH, Ten Have TR, Jo B, Dagne G, Wyman PA. 14.  et al. 2009. Adaptive designs for randomized trials in public health. Annu. Rev. Public Health 30:1–25 [Google Scholar]
  15. Brown CH, Wang W, Kellam SG, Muthén BO, Petras H. 15.  et al. 2008. Methods for testing theory and evaluating impact in randomized field trials: intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug Alcohol Depend 95:S74–104 [Google Scholar]
  16. Brown CH, Wyman PA, Brinales JM, Gibbons RD. 16.  2007. The role of randomized trials in testing interventions for the prevention of youth suicide. Int. Rev. Psychiatry 19:617–31 [Google Scholar]
  17. Brown CH, Wyman PA, Guo J, Peña J. 17.  2006. Dynamic wait-listed designs for randomized trials: new designs for prevention of youth suicide. Clin. Trials 3:259–71 [Google Scholar]
  18. Brown EC, Hawkins JD, Arthur MW, Briney JS, Abbott RD. 18.  2007. Effects of communities that care on prevention services systems: findings from the Community Youth Development Study at 1.5 years. Prev. Sci. 8:180–91 [Google Scholar]
  19. Brown EC, Hawkins JD, Rhew IC, Shapiro VB, Abbott RD. 19.  et al. 2014. Prevention system mediation of communities that care effects on youth outcomes. Prev. Sci. 15:623–32 [Google Scholar]
  20. Brownson RC, Colditz GA, Proctor EK. 20.  2012. Dissemination and Implementation Research in Health: Translating Science to Practice London: Oxford Univ. Press
  21. Brownson RC, Diez Roux AV, Swartz K. 21.  2014. Commentary: Generating rigorous evidence for public health: the need for new thinking to improve research and practice. Annu. Rev. Public Health 35:1–7 [Google Scholar]
  22. Caldwell LL, Patrick ME, Smith EA, Palen L-A, Wegner L. 22.  2010. Influencing adolescent leisure motivation: intervention effects of HealthWise South Africa. J. Leis. Res. 42:203–20 [Google Scholar]
  23. Caldwell LL, Smith EA, Collins LM, Graham JW, Lai M. 23.  et al. 2012. Translational research in South Africa: evaluating implementation quality using a factorial design. Child Youth Care Forum 41:2119–36 [Google Scholar]
  24. Chamberlain P. 24.  2003. Treating Chronic Juvenile Offenders: Advances Made Through the Oregon Multidimensional Treatment Foster Care Model Washington, DC: Am. Psychol. Assoc.
  25. Chamberlain P, Brown CH, Saldana L. 25.  2011. Observational measure of implementation progress in community based settings: the Stages of Implementation Completion (SIC). Implement. Sci. 6:116 [Google Scholar]
  26. Chamberlain P, Brown CH, Saldana L, Reid J, Wang W. 26.  et al. 2008. Engaging and recruiting counties in an experiment on implementing evidence-based practice in California. Adm. Policy Ment. Health 35:250–60 [Google Scholar]
  27. Chamberlain P, Price J, Leve LD, Laurent H, Landsverk JA, Reid JB. 27.  2008. Prevention of behavior problems for children in foster care: outcomes and mediation effects. Prev. Sci. 9:17–27 [Google Scholar]
  28. Cheung K, Duan N. 28.  2013. Design of implementation studies for quality improvement programs: an effectiveness-cost-effectiveness framework. Am. J. Public Health 104:e23–30 [Google Scholar]
  29. Cheung YK, Chakraborty B, Davidson KW. 29.  2015. Sequential Multiple Assignment Randomized Trial (SMART) with adaptive randomization for quality improvement in depression treatment program. Biometrics 71:450–59 [Google Scholar]
  30. Collins LM, Baker TB, Mermelstein RJ, Piper ME, Jorenby DE. 30.  et al. 2011. The multiphase optimization strategy for engineering effective tobacco use interventions. Ann. Behav. Med. 41:208–26 [Google Scholar]
  31. Collins LM, Dziak JJ, Li R. 31.  2009. Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychol. Methods 14:202–24 [Google Scholar]
  32. Collins LM, Murphy SA, Bierman KL. 32.  2004. A conceptual framework for adaptive preventive interventions. Prev. Sci. 5:185–96 [Google Scholar]
  33. Collins LM, Nahum-Shani I, Almirall D. 33.  2014. Optimization of behavioral dynamic treatment regimens based on the Sequential, Multiple Assignment, Randomized Trial (SMART). Clin. Trials 11:426–34 [Google Scholar]
  34. Coulton S, Perryman K, Bland M, Cassidy P, Crawford M. 34.  et al. 2009. Screening and brief interventions for hazardous alcohol use in accident and emergency departments: a randomised controlled trial protocol. BMC Health Serv. Res. 9:114 [Google Scholar]
  35. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I. 35.  et al. 2008. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ (Clin. Res. Ed.) 337:a1655 [Google Scholar]
  36. Cross W, West J, Wyman PA, Schmeelk-Cone K, Xia Y. 36.  et al. 2015. Observational measures of implementer fidelity for a school-based prevention intervention: development, reliability, and validity. Prev. Sci. 16:122–32 [Google Scholar]
  37. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. 37.  2012. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med. Care 50:217–26 [Google Scholar]
  38. Dziak JJ, Nahum-Shani I, Collins LM. 38.  2012. Multilevel factorial experiments for developing behavioral interventions: power, sample size, and resource considerations. Psychol. Methods 17:153–75 [Google Scholar]
  39. Elliott DS, Mihalic S. 39.  2004. Issues in disseminating and replicating effective prevention programs. Prev. Sci. 5:47–53 [Google Scholar]
  40. Fisher RAS. 40.  1935. The Design of Experiments Edinburgh: Oliver and Boyd
  41. Flay BR. 41.  1986. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Prev. Med. 15:451–74 [Google Scholar]
  42. Folks B, LeBlanc WG, Staton EW, Pace WD. 42.  2011. Reconsidering low-dose aspirin therapy for cardiovascular disease: a study protocol for physician and patient behavioral change. Implement. Sci. 6:65 [Google Scholar]
  43. Friedman LM, Furberg C, DeMets DL. 43.  1996. Fundamentals of Clinical Trials St. Louis: Mosby-Year Book
  44. Fuller C, Michie S, Savage J, McAteer J, Besser S. 44.  et al. 2012. The Feedback Intervention Trial (FIT)—improving hand-hygiene compliance in UK healthcare workers: a stepped wedge cluster randomised controlled trial. PLOS ONE 7:e41617 [Google Scholar]
  45. Garner BR, Godley SH, Dennis ML, Hunter BD, Bair CML, Godley MD. 45.  2012. Using pay for performance to improve treatment implementation for adolescent substance use disorders: results from a cluster randomized trial. Arch. Pediatr. Adolesc. Med. 166:938–44 [Google Scholar]
  46. Gibbons RD, Brown CH, Hur K, Marcus SM, Bhaumik DK. 46.  et al. 2007. Early evidence on the effects of regulators’ suicidality warnings on SSRI prescriptions and suicide in children and adolescents. Am. J. Psychiatry 164:1356–63 [Google Scholar]
  47. Gibbons RD, Segawa E, Karabatsos G, Amatya AK, Bhaumik DK. 47.  et al. 2008. Mixed-effects Poisson regression analysis of adverse event reports: the relationship between antidepressants and suicide. Stat. Med. 27:1814–33 [Google Scholar]
  48. Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA. 48.  2005. Practical clinical trials for translating research to practice: design and measurement recommendations. Med. Care 43:551–57 [Google Scholar]
  49. Glasgow RE, Vinson C, Chambers D, Khoury MJ, Kaplan RM, Hunter C. 49.  2012. National Institutes of Health approaches to dissemination and implementation science: current and future directions. Am. J. Public Health 102:1274–81 [Google Scholar]
  50. Glasgow RE, Vogt TM, Boles SM. 50.  1999. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am. J. Public Health 89:1322–27 [Google Scholar]
  51. Grant RM, Lama JR, Anderson PL, McMahan V, Liu AY. 51.  et al. 2010. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N. Engl. J. Med. 363:2587–99 [Google Scholar]
  52. Green LW, Glasgow RE. 52.  2006. Evaluating the relevance, generalization, and applicability of research: issues in external validation and translation methodology. Eval. Health Prof. 29:126–53 [Google Scholar]
  53. Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. 53.  2004. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 82:581–629 [Google Scholar]
  54. Hahn EJ, Rayens MK, Butler KM, Zhang M, Durbin E, Steinke D. 54.  2008. Smoke-free laws and adult smoking prevalence. Prev. Med. 47:206–9 [Google Scholar]
  55. Hall L, Eccles M, Barton R, Steen N, Campbell M. 55.  2001. Is untargeted outreach visiting in primary care effective? A pragmatic randomized controlled trial. J. Public Health Med. 23:109–13 [Google Scholar]
  56. Hawkins JD, Catalano RF. 56.  2002. Investing in Your Community's Youth: An Introduction to the Communities that Care System South Deerfield, MA: Channing Bete
  57. Hawkins JD, Oesterle S, Brown EC, Abbott RD, Catalano RF. 57.  2014. Youth problem behaviors 8 years after implementing the Communities that Care prevention system: a community-randomized trial. JAMA Pediatrics 168:122–29 [Google Scholar]
  58. Hill ABS. 58.  1961. Principles of Medical Statistics London: Lancet
  59. Jabbour M, Curran J, Scott SD, Guttman A, Rotter T. 59.  et al. 2013. Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial. Implement. Sci. 8:55 [Google Scholar]
  60. Jo B, Asparouhov T, Muthen BO, Ialongo NS, Brown CH. 60.  2008. Cluster randomized trials with treatment noncompliance. Psychol. Methods 13:1–18 [Google Scholar]
  61. Katz D, Vander Weg M, Fu S, Prochazka A, Grant K. 61.  et al. 2009. A before-after implementation trial of smoking cessation guidelines in hospitalized veterans. Implement. Sci. 4:58 [Google Scholar]
  62. Kegeles SM, Hays RB, Pollack LM, Coates TJ. 62.  1999. Mobilizing young gay and bisexual men for HIV prevention: a two-community study. AIDS 13:1753–62 [Google Scholar]
  63. Kessler R, Glasgow RE. 63.  2011. A proposal to speed translation of healthcare research into practice: Dramatic change is needed. Am. J. Prev. Med. 40:637–44 [Google Scholar]
  64. Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE. 64.  et al. 2014. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement. Sci. 9:132 [Google Scholar]
  65. Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R. 65.  2007. Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement. Sci. 2:42 [Google Scholar]
  66. Landsverk J, Brown CH, Chamberlain P, Palinkas L, Ogihara M. 66.  et al. 2012. Design and analysis in dissemination and implementation research. See Ref. 20 225–60
  67. Lei H, Nahum-Shani I, Lynch K, Oslin D, Murphy SA. 67.  2012. A “SMART” design for building individualized treatment sequences. Annu. Rev. Clin. Psychol. 8:21–48 [Google Scholar]
  68. Levy RI. 68.  1982. The National Heart, Lung, and Blood Institute: overview 1980: the Director's report to the NHLBI advisory council. Circulation 65:217–25 [Google Scholar]
  69. McClure JB, Derry H, Riggs KR, Westbrook EW, St John J. 69.  et al. 2012. Questions About Quitting (Q2): design and methods of a multiphase optimization strategy (MOST) randomized screening experiment for an online, motivational smoking cessation intervention. Contemp. Clin. Trials 33:1094–102 [Google Scholar]
  70. 70. Med. Res. Counc. (MRC) Health Serv. Public Health Res. Board 2000. A Framework for the Development and Evaluation of RCTs for Complex Interventions to Improve Health London: MRC https://www.mrc.ac.uk/documents/pdf/rcts-for-complex-interventions-to-improve-health/
  71. Mercer SL, DeVinney BJ, Fine LJ, Green LW, Dougherty D. 71.  2007. Study designs for effectiveness and translation research: identifying trade-offs. Am. J. Prev. Med. 33:139–54 [Google Scholar]
  72. Mohr DC, Schueller SM, Riley WT, Brown CH, Cuijpers P. 72.  et al. 2015. Trials of intervention principles: evaluation methods for evolving behavioral intervention technologies. J. Med. Internet Res. 17:e166 [Google Scholar]
  73. Monahan KC, Oesterle S, Rhew I, Hawkins JD. 73.  2014. The relation between risk and protective factors for problem behaviors and depressive symptoms, antisocial behavior, and alcohol use in adolescents. J. Commun. Psychol. 42:621–38 [Google Scholar]
  74. Murphy SA, Lynch KG, Oslin D, McKay JR, TenHave T. 74.  2007. Developing adaptive treatment strategies in substance abuse research. Drug Alcohol Depend 88:S24–30 [Google Scholar]
  75. Murray DM. 75.  1998. Design and Analysis of Group-Randomized Trials Oxford, UK: Oxford Univ. Press
  76. Murray DM, Lee Van Horn M, Hawkins JD, Arthur MW. 76.  2006. Analysis strategies for a community trial to reduce adolescent ATOD use: a comparison of random coefficient and ANOVA/ANCOVA models. Contemp. Clin. Trials 27:188–206 [Google Scholar]
  77. Murray DM, Varnell SP, Blitstein JL. 77.  2004. Design and analysis of group-randomized trials: a review of recent methodological developments. Am. J. Public Health 94:423–32 [Google Scholar]
  78. Nahum-Shani I, Qian M, Almirall D, Pelham WE, Gnagy B. 78.  et al. 2012. Experimental design and primary data analysis methods for comparing adaptive interventions. Psychol. Methods 17:457–77 [Google Scholar]
  79. 79. Natl. Res. Counc., Inst. Med. 2009. Preventing Mental, Emotional, and Behavioral Disorders Among Young People: Progress and Possibilities Washington, DC: Natl. Acad. Press
  80. Neumann MS, Sogolow ED. 80.  2000. Replicating effective programs: HIV/AIDS prevention technology transfer. AIDS Educ. Prev.: Off. Publ. Int. Soc. AIDS Educ. 12:35–48 [Google Scholar]
  81. Nilsen P. 81.  2015. Making sense of implementation theories, models, and frameworks. Implement. Sci. 10:53 [Google Scholar]
  82. Oesterle S, Hawkins JD, Fagan A, Abbott R, Catalano R. 82.  2014. Variation in the sustained effects of the Communities that Care prevention system on adolescent smoking, delinquency, and violence. Prev. Sci. 15:138–45 [Google Scholar]
  83. Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. 83.  2011. Mixed method designs in implementation research. Adm. Policy Ment. Health Ment. Health Serv. Res. 38:44–53 [Google Scholar]
  84. Patterson GR. 84.  1974. Interventions for boys with conduct problems: multiple settings, treatments, and criteria. J. Consult. Clin. Psychol. 42:471–81 [Google Scholar]
  85. Pellegrini CA, Hoffman SA, Collins LM, Spring B. 85.  2014. Optimization of remotely delivered intensive lifestyle treatment for obesity using the Multiphase Optimization Strategy: opt-IN study protocol. Contemp. Clin. Trials 38:251–59 [Google Scholar]
  86. Perl HI. 86.  2011. Addicted to discovery: Does the quest for new knowledge hinder practice improvement?. Addict. Behav. 11:590–96 [Google Scholar]
  87. Piantadosi S. 87.  1997. Clinical Trials: A Methodologic Perspective New York: Wiley
  88. Poduska J, Kellam SG, Brown CH, Ford C, Windham A. 88.  et al. 2009. Study protocol for a group randomized controlled trial of a classroom-based intervention aimed at preventing early risk factors for drug abuse: integrating effectiveness and implementation research. Implement. Sci. 4:56 [Google Scholar]
  89. Poduska JM, Kellam SG, Wang W, Brown CH, Ialongo NS, Toyinbo P. 89.  2008. Impact of the Good Behavior Game, a universal classroom-based behavior intervention, on young adult service use for problems with emotions, behavior, or drugs or alcohol. Drug Alcohol Depend 95:S29–44 [Google Scholar]
  90. Powell BJ, McMillen JC, Proctor EK, Carpenter CR, Griffey RT. 90.  et al. 2012. A compilation of strategies for implementing clinical innovations in health and mental health. Med. Care Res. Rev. 69:123–57 [Google Scholar]
  91. Prior M, Elouafkaoui P, Elders A, Young L, Duncan EM. 91.  et al. 2014. Evaluating an audit and feedback intervention for reducing antibiotic prescribing behaviour in general dental practice (the RAPiD trial): a partial factorial cluster randomised trial protocol. Implement. Sci. 9:50 [Google Scholar]
  92. Proctor E, Powell BJ, McMillen JC. 92.  2013. Implementation strategies: recommendations for specifying and reporting. Implement. Sci. 8:139–50 [Google Scholar]
  93. Purtle J, Peters R, Brownson RC. 93.  2016. A review of policy dissemination and implementation research funded by the National Institutes of Health, 2007–2014. Implement. Sci. 11:1 [Google Scholar]
  94. Rabin BA, Brownson EC. 94.  2012. Developing the terminology for dissemination and implementation research. See Ref. 20 23–51
  95. Raudenbush SW. 95.  1997. Statistical analysis and optimal design for cluster randomized trials. Psychol. Methods 2:173–85 [Google Scholar]
  96. Reid JB, Taplin PS, Lorber R. 96.  1981. A social interactional approach to the treatment of abusive families. Violent Behavior: Social Learning Approaches to Prediction, Management, and Treatment RB Stuart 83–101 New York: Brunner/Mazel [Google Scholar]
  97. Rogers EM. 97.  1995. Diffusion of Innovations New York: Free Press
  98. Rosenbaum PR, Rubin DB. 98.  1983. The central role of the propensity score in observational studies for causal effects. Biometrika 70:41–55 [Google Scholar]
  99. Rubin DB. 99.  1974. Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educ. Psychol. 66:688–701 [Google Scholar]
  100. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. 100.  1996. Evidence based medicine: what it is and what it isn't. BMJ 312:71–72 [Google Scholar]
  101. Saldana L. 101.  2014. The stages of implementation completion for evidence-based practice: protocol for a mixed methods study. Implement. Sci. 9:43 [Google Scholar]
  102. Shojania KG, Grimshaw JM. 102.  2005. Evidence-based quality improvement: the state of the science. Health Aff. 24:138–50 [Google Scholar]
  103. Spoth R, Guyll M, Redmond C, Greenberg M, Feinberg M. 103.  2011. Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: the PROSPER study. Am. J. Commun. Psychol. 48:412–25 [Google Scholar]
  104. Stuart EA, Cole SR, Bradshaw CP, Leaf PJ. 104.  2010. The use of propensity scores to assess the generalizability of results from randomized trials. J. R. Stat. Soc. 174:2369–86 [Google Scholar]
  105. Szapocznik J, Duff JH, Schwartz SJ, Muir JA, Brown CH. 105.  2015. Brief strategic family therapy treatment for behavior problem youth: theory, intervention, research, and implementation. Handbook of Family Therapy: The Science and Practice of Working with Families and Couples T Sexton, J Lebow 286–304 Abingdon, UK: Routledge [Google Scholar]
  106. Thistlethwaite DL, Campbell DT. 106.  1960. Regression-discontinuity analysis: an alternative to the ex post facto experiment. J. Educ. Psychol. 51:309–17 [Google Scholar]
  107. Twardella D, Brenner H. 107.  2007. Effects of practitioner education, practitioner payment and reimbursement of patients’ drug costs on smoking cessation in primary care: a cluster randomised trial. Tob. Control 16:15–21 [Google Scholar]
  108. Valente TW, Palinkas LA, Czaja S, Chu KH, Brown CH. 108.  2015. Social network analysis for program implementation. PLOS ONE 10:e0131712 [Google Scholar]
  109. Van Achterberg T, Schoonhoven L, Grol R. 109.  2008. Nursing implementation science: how evidence-based nursing requires evidence-based implementation. J. Nurs. Scholarsh. 40:302–10 [Google Scholar]
  110. Weiss CH, Poncela-Casasnovas J, Glaser JI, Pah AR, Persell SD. 110.  et al. 2014. Adoption of a high-impact innovation in a homogeneous population. Phys. Rev. X 4:041008 [Google Scholar]
  111. Wyman PA, Henry D, Knoblauch S, Brown CH. 111.  2015. Designs for testing group-based interventions with limited numbers of social units: the dynamic wait-listed and regression point displacement designs. Prev. Sci. 16:956–66 [Google Scholar]
  112. Wyrick DL, Rulison KL, Fearnow-Kenney M, Milroy JJ, Collins LM. 112.  2014. Moving beyond the treatment package approach to developing behavioral interventions: addressing questions that arose during an application of the Multiphase Optimization Strategy (MOST). Transl. Behav. Med. 4:252–59 [Google Scholar]
/content/journals/10.1146/annurev-publhealth-031816-044215
Loading
/content/journals/10.1146/annurev-publhealth-031816-044215
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error