Implementation Science: An Essential Tool for Advancing DrPH Practice

By Aubrey Villalobos, DrPH, MPH, MEd; Robin C. Vanderpool, DrPH, MPH; Robert E. Vollinger, Jr., DrPH, MSPH; Antoinette Percy-Laurry, DrPH, MSPH

Facebook
Twitter
LinkedIn

Citation

Villalobos A, Vanderpool R, Vollinger R, Percy-Laurry A. Implementation science: An essential tool for advancing DrPH practice. HPHR. 2021;35.  

DOI:10.54111/0001/II2

Implementation Science: An Essential Tool for Advancing DrPH Practice

Public Health Practice Implications

This commentary describes how implementation science (IS) complements and adds value to public health decision making, applied research, and practice. The commentary then presents opportunities for integrating IS into public health, with a specific focus on engagement of Doctors of Public Health (DrPHs) in IS research and a call for advanced training in IS for DrPHs.

 

IS can advance public health by improving the translation of research into practice and policy and by addressing health inequities. IS has an increasing focus on incorporating health equity into its frameworks, enhancing community and stakeholder engagement in IS, studying the implementation of multilevel interventions, as well as policy implementation science.

 

IS examines and influences how we move evidence into practice; therefore, it is essential to have practitioners engaged in the field. There is an obvious role for IS to augment foundational DrPH training. Specifically for DrPHs, expertise in IS would elevate leadership and applied research competencies, facilitating evidence-based decision making in policy and practice. In order to achieve this goal, greater awareness of opportunities to build IS capacity and engage in IS research is needed.

Implementation Science and Public Health Practice

Doctors of Public Health (DrPH) are leaders in public health research and practice. We are trained to develop and evaluate policies, programs, and interventions to benefit population health. However, the field often emphasizes best practices and program outcomes, and to a lesser extent, implementation outcomes (Proctor et al., 2011) and the factors that influence them. These are all critical areas of public health practice and are extensively addressed in the field of Implementation Science (IS). DrPH leaders, including practitioners making decisions and implementing interventions in real world settings, would benefit significantly from greater awareness and application of IS.

 

IS facilitates evidence-based, efficient, and equitable public health practice. IS, also referred to as dissemination and implementation research, is the study of methods to promote the adoption and integration of evidence-based practices, interventions, and policies into routine health care and public health settings to improve impact on population health. The National Institutes of Health (NIH) (2019) defines dissemination research as the scientific study of targeted distribution of information and intervention materials to a specific public health or clinical practice audience. The intent is to understand how best to communicate and integrate knowledge and the associated evidence-based interventions. Often, there is a delay in getting research-tested, evidence-based interventions and strategies commonly developed through academic research into the hands of practitioners in the real world. NIH (2019) defines implementation research as the scientific study of the use of strategies to adopt and integrate evidence-based health interventions into clinical and community settings to improve individual outcomes and benefit population health. Efficacious interventions are typically designed and tested under controlled conditions, often without input from practitioners. Even when successful interventions are disseminated to practitioners, there may be challenges with implementing them in a more real-world context and in achieving improved health outcomes. IS enables us to examine the processes and determinants of successful implementation in order to improve practice (Proctor et al., 2009).

Background and Significance

IS can advance public health by improving the translation of research into practice and policy. A 1998 review reported that it takes about 17 years for 14% of original basic science research to be incorporated into practice and benefit patients (Balas, 1998). A follow-up paper from Khan et al. (2021) documented a small improvement of 15 years average to move cancer control research into practice. Translation of evidence into programs in communities for health promotion and disease prevention also suffers from delays and inefficiencies (MacLean, 1996; Nutbeam, 1996). Similarly, there is limited practice-based production of research (Ammerman, Smith, & Calancie, 2014; Green, 2008). Through the dual foci of dissemination and implementation research, IS can help bridge this gap between research to practice and practice to research.

           

Despite the field’s responsibility to advance population health, inequities persist in communities around the globe (Pérez-Stable & Collins, 2019). The recently pronounced inequities in COVID-19 deaths and vaccine access (Ndugga et al., 2021a & 2021b) and civil unrest for racial injustices (Chavez, 2020) have elevated conversations about social and structural determinants of health (SDOH) and systemic racism. We now have broader understanding that multilevel, multi-sectoral interventions are needed to meet the challenges and achieve health equity. Envisioning the future of health disparities research, Pérez-Stable and Collins (2019) noted that “of critical importance, it is not enough to identify factors that contribute to health disparities: intervention science must be applied in full force to seek solutions.” IS adds value to public health in this regard with an increasing focus on leveraging IS models, methods, and strategies to advance health equity (Brownson et al., 2021; Shelton, Adsul, & Oh, 2021), enhancing community/stakeholder engagement in IS (Pinto et al. 2021; Ramanadhan et al., 2018), and studying the implementation of multilevel interventions. Specifically, IS methods can help shift the focus from the inner levels of the social ecological model (individuals and their behavior) to outer levels (SDOH, communities, systems, and policies), and increase the rigor and speed with which we understand and intervene to eliminate health inequities (Chinman et al., 2017). The field is also poised to help us think about how research evidence can be translated into policies, and how those policies can be implemented, enforced, and evaluated, with a particular focus on accounting for and addressing SDOH to advance health equity (Emmons & Chambers, 2021).

 

IS complements public health decision making, applied research, and practice (Bauer et al., 2015). Many of the theories, models, and frameworks used in IS will be familiar to public health trainees, while others should certainly be better integrated in teaching and practice (Tabak et al. 2012; Nilsen, 2015). IS tests implementation strategies (Leeman et al., 2017) and provides guidance for adapting interventions to different contexts (Chambers & Norton, 2016). For example, IS can inform how we document and implement lessons learned about controlling transmission and optimizing treatments across waves of the COVID-19 pandemic (Chambers, 2020) and inform approaches to rolling out and scaling up vaccinations (Galaviz et al., 2020). IS researchers are developing pragmatic measures and methods for implementation and effectiveness (i.e., process and outcome) evaluation (e.g., Proctor et al., 2011). Often, we struggle to sustain and scale effective interventions; importantly, IS generates evidence to aid in this regard as well (Walugembe et al., 2019; Shelton, Cooper, & Stirman, 2018). Human papillomavirus vaccination and colorectal cancer screening are two examples of interventions that have been brought to scale with the help of IS. Some IS focuses on mis-implementation, which includes ending effective or continuing ineffective programs (Allen et al. 2020). Further, the field is increasingly investigating de-implementation of practices that are found to be ineffective, harmful, or inferior to newer evidence-based practices (Norton & Chambers, 2020). Finally, IS encourages attention to cost-effectiveness analyses, which helps leaders make more informed decisions about allocation of scarce public health resources. This is particularly relevant to global health and implementation of programs in low and middle-income countries (Ridde, 2016; Yapa & Bärnighausen, 2018) whose resources are more limited and whose implementation contexts require greater attention to maximize the value of investments and have the greatest impact on population health.

 

IS intersects with several disciplines that are more commonly included in public health training programs. In particular, health communication can be thought of as both part of dissemination science and considered an implementation strategy to improve intervention and policy implementation (Manojlovich et al., 2015). IS and community-based participatory research (CBPR) are also related and mutually enhancing, as described by two DrPHs, Wallerstein & Duran (2010). However, IS adds value by incorporating theories and methods that may be less familiar to those trained in public health. These include organizational theories (Birken et al., 2017), political science (Nilsen et al., 2013), economic theories (Vicki et al., 2020), human centered design (Chen & Neta, 2020), and clinical quality improvement science (Mitchell & Chambers, 2017), among others. As an example, Purtle, another DrPH, is leading policy implementation research related to urban health disparities and mental health (e.g., Purtle et al., 2021; Purtle et al., 2020).

 

If IS is dedicated to studying how we get evidence into practice, it is essential to have practitioners engaged in the field. Yet, opportunities for enhancing practitioner engagement remain (Hursting & Chambers, 2021; Lobb & Colditz, 2013). IS has clear relevance to public health competencies (Council on Linkages Between Academia and Public Health Practice, 2014) and accreditation criteria for educational institutions (Council on Education for Public Health [CEPH], 2016), yet is not explicitly mentioned. CEPH’s accreditation criteria were amended in 2016 in part due to calls from the field for schools of public health to better prepare graduates for the challenges of contemporary practice (Foster, King, & Bender, 2018). There is an obvious role for IS to augment three foundational DrPH competency domains of: data and analysis; leadership, management, and governance; and policy and programs (CEPH, 2016). Specifically, expertise in IS would elevate leadership and applied research competence, facilitating evidence-based decision making in policy and practice. To achieve this, however, greater awareness is needed of opportunities to engage in IS.

Opportunities in Integrating Implementation Science and Public Health

The IS field has expanded significantly over the past two decades, thanks in large part to the national leadership of the NIH, and the National Cancer Institute (NCI) in particular, who recognized the benefit of not only communicating research findings, but of studying how to better facilitate translation of research to practice (Glasgow et al., 2012). We, the four authors, are DrPH leaders working to advance the IS field in the Division of Cancer Control and Population Sciences at NCI. We bring DrPH and public health practitioner perspectives to both research and translation efforts at the federal level. From this vantage point, we see opportunities to increase practitioner engagement in IS and expand IS training in public health curricula to enhance the impact of the 10 essential public health services, which now center on equity (Krisberg, 2020).

 

DrPHs are national leaders in public health research and practice “who use advanced research expertise to perform and evaluate evidence-based public health practice using advocacy, communication, community-cultural orientation, critical analysis, leadership, and management skills as well as professionalism and ethics” (Calhoun et al., 2012, p. 25). Practitioner engagement in dissemination and implementation research would improve the relevance of findings and facilitate their adoption in practice. IS researchers should engage practitioners in refinement of the many models, theories, frameworks, strategies, and measures being used. Practitioners, given their engagement with communities, have a unique perspective on implementation context, feasibility, adaptation, and inequities. As public health leaders and decision makers, DrPHs can also make important contributions to the science of implementation related to cost analyses and perspectives on return on investment. Further, practitioners play an integral role in studying policy implementation, as they are often in the position of determining how to implement and enforce policies. Practitioner awareness of and engagement in IS will facilitate application of findings in practice by answering common questions about what to implement, how, when, where, or with whom.

 

To increase practitioner engagement in IS, adequate training in IS concepts is needed to build capacity. Utilizing IS approaches will equip future practitioners to integrate interventions well, focusing on cost-effectiveness, efficiency, and equity. Over 30 years ago, the former Institute of Medicine (1988) recommended that “research in schools of public health should range from basic research in fields related to public health, through applied research and development, to program evaluation and implementation research.” Brownson et al. (2006) called for schools of public health to increase commitments to translation and dissemination by offering curricula and training to students and faculty including teaching methods to design interventions for dissemination, develop new communication methods for dissemination, and lead in conducting research in translation and dissemination. Green (2008) reiterated that students should receive training in practice-based and participatory research methods, and in the application and adaptation of evidence in practice in order to bridge the research-practice chasm. Albers, Metz, and Burke (2020) began to articulate a more formal role that could be filled by public health trainees—implementation support practitioners, whose primary function is to help facilitate translation of evidence into practice. Yet, most practitioners report that their only IS training is not received during their schooling, but rather once they are already practicing in the field (Schultes et al., 2021).

 

Estabrooks, Brownson, and Pronk (2018) articulated the synergies between IS and public health. They encouraged practitioners to develop their capacity in nine key overlapping competencies (Figure 1) previously identified by Tabak et al. (2017).

Figure 1. Nine overlapping competencies between public health practice and implementation science (Tabak et al., 2017)

  1. Communicate Research Findings
  2. Improve Practice Partnerships
  3. Make Research More Relevant
  4. Strengthen Communication Skills
  5. Consider and Enhance Fit
  6. Develop Research Methods and Measures
  7. Build Capacity for Research
  8. Ensure Research is Meaningful
  9. Understand Multilevel Context

Ramaswamy et al. (2019) called for the incorporation of IS into Master of Public Health (MPH) curricula and we argue that IS education is even more important for DrPH trainees given their trajectory toward applied research and leadership in developing and implementing programs and policies. Boyce et al. (2019) highlighted the inadequate dissemination and implementation research workforce to address the many complex challenges we face in public health, namely health inequities. Advanced IS training in DrPH programs could directly respond to this need. Davis and D’Lima (2020) identified 41 dissemination and implementation capacity-building initiatives in the peer-reviewed literature but concluded that more training is needed to reach a broader audience, including practitioners. Table 1 lists a selective sampling of capacity-building resources led or funded by the NIH or partner agencies, but opportunities remain for universities to develop and offer more IS training through new or existing DrPH courses.

Table 1. Select Capacity-Building Resources in Implementation Science

Training and resources for researchers

National Cancer Institute’s Implementation Science website includes funding opportunities, sample grants, and other resources. For example:

The Consortium for Cancer Implementation Science (CCIS) is an annual working meeting that focuses on cancer control priorities, cross collaboration, and innovative solutions in IS.

Washington University in St. Louis’ Implementation Research Institute provides two years of training in mental health IS for 10 new fellows each year.

Washington University in St. Louis’ Institute for Implementation Science Scholars is an innovative two-year program that places a strong emphasis on mentoring, applying competencies and curriculum specifically focused on chronic disease disparities, and working with a diverse set of partners.

The University of North Carolina’s Implementation Science Exchange is a free, online source for those interested in resources to help design, acquire funding for, execute and disseminate IS research projects. They find (or create) resources, tools, websites, guides, toolkits, and sample grant applications to help support researchers in the field of IS, particularly those new to research or new to the field itself.

The D&I Models Webtool is an interactive, online resource designed to help researchers and practitioners navigate dissemination and implementation models through planning, selecting, combining, adapting, using, and linking to measures.

Additional electronic tools are described here: Ford, B., Rabin, B., Morrato, E. H., & Glasgow, R. E. (2018). Online Resources for Dissemination and Implementation Science: Meeting Demand and Lessons Learned. J Clin Transl Sci. 2(5), 259–266. https://doi.org/10.1017/cts.2018.337

Training and resources for practitioners

NCI’s Implementation Science at a Glance provides a succinct overview of the rapidly evolving field. This workbook was written by members of the NCI IS team and reviewed by public health practitioners and implementation researchers. Through summaries of key theories, methods, and models, the guide shows how the use of IS can support the effective adoption of evidence-based interventions. Case studies illustrate how practitioners are successfully applying IS in their cancer control programs.

NCI’s Evidence-Based Cancer Control Programs website is a searchable database of evidence-based cancer control programs and is designed to efficiently disseminate program materials to program planners and public health practitioners.

NCI-funded Implementation Science Centers in Cancer Control (ISC3) Program supports the rapid development, testing, and refinement of innovative approaches to implement a range of evidence-based cancer control interventions. Centers all feature “implementation laboratories” involving clinical and community practice sites that will engage in implementation research across the cancer control continuum to advance methods in studying implementation and develop and validate reliable measures of key IS constructs.

The Consortium for Cancer Implementation Science (CCIS) is an annual working meeting that focuses on cancer control priorities, cross collaboration, and innovative solutions in IS. Practitioner engagement in this consortium is encouraged.

Putting Public Health Evidence in Action Training, created by the Cancer Prevention and Control Research Network (CPCRN), supports community program planners and health educators in developing skills in using evidence-based approaches and learning about new tools for planning and evaluating community health interventions. It is a self-paced curriculum with activities and tools.

The CPCRN Scholars program (launched in 2021) is an educational and training program that strives to educate students, postdoctoral fellows, junior faculty, practitioners, and other health professionals in dissemination and implementation science focused on cancer prevention and control and health equity. Enrollees are provided with a curriculum related to IS, webinar and group interactions, and opportunities to engage in mentored projects.

The D&I Models Webtool is an interactive, online resource designed to help researchers and practitioners navigate dissemination and implementation models through planning, selecting, combining, adapting, using, and linking to measures.

 

Conclusion

IS is essential for advancing the impact of public health by reducing research translation time, improving equity through multilevel, multi-sector interventions, and integrating strengths from multiple disciplines. Practitioner engagement is vital to accomplish this. Therefore, we need more engagement in the science and its application, and we must build greater capacity among DrPH students and alumni to prepare them to address the complex contemporary challenges facing them in practice.

Disclaimer

The opinions expressed by the authors are their own and the research presented in this paper should not be interpreted as representing the official viewpoint of the U.S. Department of Health and Human Services, the National Institutes of Health, or the National Cancer Institute.

How DrPH Training Informed This Work

 The authors have a combined 25 years since completing their DrPHs and decades-long careers in public health research and practice. Our professional backgrounds and career trajectories mirror the rich diversity and multi-disciplinary nature of the field. Our collective expertise is broad, as expected of DrPHs, covering implementation science, social and behavioral science, cancer prevention and control, tobacco prevention and control, breastfeeding, policy, community engagement, clinical quality improvement, and health equity. Throughout our careers, we have served in community organizations, clinical practices and hospitals, academia, and federal agencies. The DrPH-related skills in leadership and practice exercised and enhanced through these professional experiences informed the perspective presented on the gaps and opportunities for a melding of implementation science and public health practice.

References

  1. Albers, B., Metz, A., & Burke, K. (2020). Implementation support practitioners – a proposal for consolidating a diverse evidence base. BMC health services research20(1), 368. https://doi.org/10.1186/s12913-020-05145-1
  2. Allen, P., Jacob, R. R., Parks, R. G., Mazzucca, S., Hu, H., Robinson, M., Dobbins, M., Dekker, D., Padek, M., & Brownson, R. C. (2020). Perspectives on program mis-implementation among U.S. local public health departments. BMC health services research, 20(1), 258. https://doi.org/10.1186/s12913-020-05141-5
  3. Ammerman, A., Smith, T. W., & Calancie, L. (2014). Practice-based evidence in public health: improving reach, relevance, and results. Annual review of public health35, 47–63. https://doi.org/10.1146/annurev-publhealth-032013-182458
  4. Balas E. A. (1998). From appropriate care to evidence-based medicine. Pediatric annals, 27(9), 581–584. https://doi.org/10.3928/0090-4481-19980901-11
  5. Bauer, M. S., Damschroder, L., Hagedorn, H., Smith, J., & Kilbourne, A. M. (2015). An introduction to implementation science for the non-specialist. BMC psychology, 3(1), 32. https://doi.org/10.1186/s40359-015-0089-9
  6. Birken, S. A., Bunger, A. C., Powell, B. J., Turner, K., Clary, A. S., Klaman, S. L., Yu, Y., Whitaker, D. J., Self, S. R., Rostad, W. L., Chatham, J., Kirk, M. A., Shea, C. M., Haines, E., & Weiner, B. J. (2017). Organizational theory for dissemination and implementation research. Implementation science: IS, 12(1), 62. https://doi.org/10.1186/s13012-017-0592-x
  7. Boyce, C. A., Barfield, W., Curry, J., Shero, S., Green Parker, M., Cox, H., Bustillo, J., & Price, L. N. (2019). Building the Next Generation of Implementation Science Careers to Advance Health Equity. Ethnicity & disease, 29(Suppl 1), 77–82. https://doi.org/10.18865/ed.29.S1.77
  8. Brownson, R. C., Kumanyika, S. K., Kreuter, M. W., & Haire-Joshu, D. (2021). Implementation science should give higher priority to health equity. Implementation science16(1), 28. https://doi.org/10.1186/s13012-021-01097-0
  9. Brownson, R. C., Kreuter, M. W., Arrington, B. A., & True, W. R. (2006). From the Schools of Public Health. Public Health Reports, 121(1), 97–103. https://doi.org/10.1177/003335490612100118
  10. Calhoun, J. G., McElligott, J. E., Weist, E. M., & Raczynski, J. M. (2012). Core competencies for doctoral education in public health. American journal of public health, 102(1), 22–29. https://doi.org/10.2105/AJPH.2011.300469
  11. Chambers, D. A. (2020). Considering the intersection between implementation science and COVID-19. Implementation Research and Practice. https://doi.org/10.1177/0020764020925994
  12. Chambers, D. A., & Norton, W. E. (2016). The Adaptome: Advancing the Science of Intervention Adaptation. American journal of preventive medicine, 51(4 Suppl 2), S124–S131. https://doi.org/10.1016/j.amepre.2016.05.011
  13. Chavez, N. (2020). 2020: The year America confronted racism. CNN. https://www.cnn.com/interactive/2020/12/us/america-racism-2020/
  14. Chen, E., Neta, G., & Roberts, M. C. (2020). Complementary approaches to problem solving in healthcare and public health: implementation science and human-centered design. Translational behavioral medicine, ibaa079. Advance online publication. https://doi.org/10.1093/tbm/ibaa079
  15. Chinman, M., Woodward, E. N., Curran, G. M., & Hausmann, L. (2017). Harnessing Implementation Science to Increase the Impact of Health Equity Research. Medical care, 55 Suppl 9 Suppl 2(Suppl 9 2), S16–S23. https://doi.org/10.1097/MLR.0000000000000769
  16. Council on Linkages Between Academia and Public Health Practice (2014). Core competencies for public health professionals. http://www.phf.org/resourcestools/Documents/Core_Competencies_for_Public_Health_Professionals_2014June.pdf Accessed March 4, 2021.
  17. Council on Education for Public Health (2016). Accreditation criteria schools of public health & public health programs. https://media.ceph.org/documents/2016.Criteria.pdf Accessed March 4, 2021.
  18. Davis, R., & D’Lima, D. (2020). Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives. Implementation science: IS, 15(1), 97. https://doi.org/10.1186/s13012-020-01051-6
  19. Emmons, K. M., & Chambers, D. A. (2021). Policy Implementation Science – An Unexplored Strategy to Address Social Determinants of Health. Ethnicity & disease, 31(1), 133–138. https://doi.org/10.18865/ed.31.1.133
  20. Estabrooks, P. A., Brownson, R. C., & Pronk, N. P. (2018). Dissemination and Implementation Science for Public Health Professionals: An Overview and Call to Action. Preventing chronic disease, 15, E162. https://doi.org/10.5888/pcd15.180525
  21. Foster, A., King, L. R., & Bender, K. (2018). Are Public Health Academia, Professional Certification, and Public Health Practice on the Same Page? Journal of public health management and practice: JPHMP, 24 Suppl 3, S47–S50. https://doi.org/10.1097/PHH.0000000000000746
  22. Galaviz, K. I., Breland, J. Y., Sanders, M., Breathett, K., Cerezo, A., Gil, O., Hollier, J. M., Marshall, C., Wilson, J. D., & Essien, U. R. (2020). Implementation Science to Address Health Disparities During the Coronavirus Pandemic. Health equity, 4(1), 463–467. https://doi.org/10.1089/heq.2020.0044
  23. Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: current and future directions. American journal of public health, 102(7), 1274–1281. https://doi.org/10.2105/AJPH.2012.300755
  24. Green L. W. (2008). Making research relevant: if it is an evidence-based practice, where’s the practice-based evidence? Family practice, 25 Suppl 1, i20–i24. https://doi.org/10.1093/fampra/cmn055
  25. Hursting, L. M., & Chambers, D. A. (2021). Practitioner Engagement in Implementation Science: Initiatives and Opportunities. Journal of public health management and practice: JPHMP, 27(2), 102–104. https://doi.org/10.1097/PHH.0000000000001222
  26. Khan, S., Chambers, D., & Neta, G. (2021). Revisiting time to translation: implementation of evidence-based practices (EBPs) in cancer control. Cancer causes & control: CCC, 32(3), 221–230. https://doi.org/10.1007/s10552-020-01376-z
  27. Krisberg, K. (2020, Nov/Dec). Equity at the center of revised 10 Essential Public Health Services. The Nation’s Health, 50(9), 1-10. https://www.thenationshealth.org/content/50/9/1.5
  28. Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017). Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. Implementation science: IS, 12(1), 125. https://doi.org/10.1186/s13012-017-0657-x
  29. Lobb, R., & Colditz, G. A. (2013). Implementation science and its application to population health. Annual review of public health, 34, 235–251. https://doi.org/10.1146/annurev-publhealth-031912-114444
  30. MacLean DR. Positioning dissemination in public health policy. Can J Public Health. 1996;87(Suppl 2):S40–3.
  31. Manojlovich, M., Squires, J.E., Davies, B. et al. Hiding in plain sight: communication theory in implementation science. Implementation Sci 10, 58 (2015). https://doi.org/10.1186/s13012-015-0244-y
  32. Mitchell, S. A., & Chambers, D. A. (2017). Leveraging Implementation Science to Improve Cancer Care Delivery and Patient Outcomes. Journal of oncology practice, 13(8), 523–529. https://doi.org/10.1200/JOP.2017.024729
  33. National Institutes of Health. (2019). Dissemination and Implementation Research in Health (R01 Clinical Trial Optional). https://grants.nih.gov/grants/guide/pa-files/PAR-19-274.html Accessed March 4, 2021.
  34. Ndugga, N., Pham, O., Hill, L., & Artiga, S. (2021a, Jan 21). Early state vaccination data raise warning flags for racial equity. Kaiser Family Foundation. https://www.kff.org/policy-watch/early-state-vaccination-data-raise-warning-flags-racial-equity/
  35. Ndugga, N., Pham, O., Hill, L., & Artiga, S. (2021b, Mar 3). Latest data on COVID-19 vaccinations race/ethnicity. Kaiser Family Foundation. https://www.kff.org/coronavirus-covid-19/issue-brief/latest-data-on-covid-19-vaccinations-race-ethnicity/
  36. Nilsen, P. Making sense of implementation theories, models and frameworks. Implementation science: IS, 10, 53 (2015). https://doi.org/10.1186/s13012-015-0242-0
  37. Nilsen, P., Ståhl, C., Roback, K. and Cairney, P., 2013. Never the twain shall meet?-a comparison of implementation science and policy implementation research. Implementation science: IS, 8(1), p.63.
  38. Norton, W. E., & Chambers, D. A. (2020). Unpacking the complexities of de-implementing inappropriate health interventions. Implementation science: IS, 15(1), 2. https://doi.org/10.1186/s13012-019-0960-9
  39. Nutbeam D. Achieving ‘best practice’ in health promotion: improving the fit between research and practice. Health Educ Res. 1996;11:317–26. 
  40. Institute of Medicine. 1988. The Future of Public Health. Washington, DC: The National Academies Press. https://doi.org/10.17226/1091
  41. Pérez-Stable, E. J., & Collins, F. S. (2019). Science Visioning in Minority Health and Health Disparities. American journal of public health, 109(S1), S5. https://doi.org/10.2105/AJPH.2019.304962
  42. Pinto, R. M., Park, S. (Ethan), Miles, R., & Ong, P. N. (2021). Community engagement in dissemination and implementation models: A narrative review. Implementation Research and Practice. https://doi.org/10.1177/2633489520985305
  43. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Administration and policy in mental health, 36(1), 24–34. https://doi.org/10.1007/s10488-008-0197-4
  44. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and policy in mental health, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7
  45. Purtle, J., Joshi, R., LÊ-Scherban, F., Henson, R. M., & Diez Roux, A. V. (2021). Linking Data on Constituent Health with Elected Officials’ Opinions: Associations Between Urban Health Disparities and Mayoral Officials’ Beliefs About Health Disparities in Their Cities. The Milbank quarterly, 10.1111/1468-0009.12501. Advance online publication. https://doi.org/10.1111/1468-0009.12501
  46. Purtle, J., Nelson, K. L., Bruns, E. J., & Hoagwood, K. E. (2020). Dissemination Strategies to Accelerate the Policy Impact of Children’s Mental Health Services Research. Psychiatric services (Washington, D.C.), 71(11), 1170–1178. https://doi.org/10.1176/appi.ps.201900527
  47. Ramanadhan, S., Davis, M. M., Armstrong, R., Baquero, B., Ko, L. K., Leng, J. C., Salloum, R. G., Vaughn, N. A., & Brownson, R. C. (2018). Participatory implementation science to increase the impact of evidence-based cancer prevention and control. Cancer causes & control: CCC, 29(3), 363–369. https://doi.org/10.1007/s10552-018-1008-1
  48. Ramaswamy, R., Mosnier, J., Reed, K., Powell, B. J., & Schenck, A. P. (2019). Building capacity for Public Health 3.0: Introducing implementation science into an MPH curriculum. Implementation science: IS14(1), 18. https://doi.org/10.1186/s13012-019-0866-6
  49. Ridde V. (2016). Need for more and better implementation science in global health. BMJ global health1(2), e000115. https://doi.org/10.1136/bmjgh-2016-000115  
  50. Schultes, M. T., Aijaz, M., Klug, J., & Fixsen, D. L. (2021). Competences for implementation science: what trainees need to learn and where they learn it. Advances in health sciences education: theory and practice26(1), 19–35. https://doi.org/10.1007/s10459-020-09969-8
  51. Shelton, R. C., Adsul, P., & Oh, A. (2021). Recommendations for Addressing Structural Racism in Implementation Science: A Call to the Field. Ethnicity & disease31(Suppl 1), 357–364. https://doi.org/10.18865/ed.31.S1.357
  52. Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018). The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care. Annual review of public health, 39, 55–76. https://doi.org/10.1146/annurev-publhealth-040617-014731
  53. Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: models for dissemination and implementation research. American journal of preventive medicine, 43(3), 337–350. https://doi.org/10.1016/j.amepre.2012.05.024
  54. Tabak, R. G., Padek, M. M., Kerner, J. F., Stange, K. C., Proctor, E. K., Dobbins, M. J., Colditz, G. A., Chambers, D. A., & Brownson, R. C. (2017). Dissemination and Implementation Science Training Needs: Insights From Practitioners and Researchers. American journal of preventive medicine52(3 Suppl 3), S322–S329. https://doi.org/10.1016/j.amepre.2016.10.005
  55. Vicki, B., Huong, T., Miranda, B., Rachel, L., & Marj, M. (2020). A narrative review of economic constructs in commonly used implementation and scale-up theories, frameworks and models. Health research policy and systems, 18(1), 115. https://doi.org/10.1186/s12961-020-00633-6
  56. Walugembe, D. R., Sibbald, S., Le Ber, M. J., & Kothari, A. (2019). Sustainability of public health interventions: where are the gaps? Health research policy and systems, 17(1), 8. https://doi.org/10.1186/s12961-018-0405-y
  57. Yapa, H. M., & Bärnighausen, T. (2018). Implementation science in resource-poor countries and communities. Implementation science: IS, 13(1), 154. https://doi.org/10.1186/s13012-018-0847-1

About the Authors

Aubrey Van Kirk Villalobos, DrPH, MPH, MEd

Aubrey Van Kirk Villalobos is a Health Scientist with the Implementation Science (IS) Team in the Office of the Director in the Division of Cancer Control and Population Sciences (DCCPS) at the National Cancer Institute (NCI). She leads a number of efforts to advance the involvement of practitioners in IS to enhance the integration of evidence-based guidelines, programs, and policies for cancer control in public health and clinical practice. Prior to joining the NCI, Dr. Villalobos served as director of cancer control and health equity at the George Washington University (GW) Cancer Center.

Robin C. Vanderpool, DrPH, MPH

Robin C. Vanderpool is Chief of the Health Communication and Informatics Research Branch at the NCI in Rockville, MD. She graduated with her DrPH, concentrating in Health Behavior, in 2006 from the University of Kentucky College of Public Health. She has published and presented extensively in cancer prevention and control, rural health, and health communication.

Robert E. Vollinger, Jr., DrPH, MSPH

Robert E. Vollinger, Jr. is a Program Director in the Tobacco Control Research Branch at the NCI. He leads an extensive portfolio of tobacco prevention and control policy research with a current emphasis on tobacco control policies to promote health equity. He has led numerous large research initiatives to inform state and community tobacco control policies and programs. His research has focused on policies to reduce exposure to secondhand smoke, particularly in multi-unit housing. He is committed to engaging a diverse array of community partners in the research, with a focus on community-based participatory research, and to working collaboratively to ensure that research findings are proactively disseminated and implemented as broadly as possible.

Antoinette Percy-Laurry, DrPH, MSPH

Antoinette Percy-Laurry is a Health Scientist Administrator at the National Institute on Minority Health and Health Disparities within the National Institutes of Health. She leads projects related to the planning, development, implementation, and evaluation of intervention and social-behavioral research to improve minority health and reduce health disparities. She previously worked at the NCI as Lead Public Health Advisor in IS in the DCCPS.