1. A Comprehensive Review of Dissemination and Implementation Science Instruments
Cara C. Lewis, Cameo Borntrager, Ruben Martinez, Phil Fizur, & Kate Comtois

2. Agenda Background Goals Framework & Scope of Review
Overview of Review Process & Findings
Evidence-Based Assessment Criteria
SIRC Instrument Review Task Force
Shared Product

3. Background Impetus for the project: Measurement redundancy
Constructs with no measures
Prioritize both measure quality and usability

4. Goals Instrument Repository Comprehensive Review Consensus Battery
Evidence Based Assessment
Step 1
Step 2
Step 3

5. Damschroder, Aron, Keith, Kirsh, Alexander, & Lowery, 2009
Framework & Scope
Consolidated Framework for Implementation Research
39 Constructs
Damschroder, Aron, Keith, Kirsh, Alexander, & Lowery, 2009

6. Proctor, Silmere, Raghavan, Hobmand, Aarons, Bunger, et al. 2011
Framework & Scope
Outcomes for Implementation Research
17 Constructs
Proctor, Silmere, Raghavan, Hobmand, Aarons, Bunger, et al. 2011

7. Comprehensive Review 1 Literature Review 2 Construct Specific 3
Measure Specific 4
Individual and Listserv Requests 5
Comprehensive Measure List
215 measures

8. Comprehensive Measures List

9. SIRC Website: Main Page

10. SIRC Website: Main Page

11. SIRC Website: Construct Page

12. SIRC Website: Measure Page

13. Goals Instrument Repository Comprehensive Review Consensus Battery
Evidence Based Assessment Criteria
Step 1
Step 2
Step 3

14. Evidence Based Assessment Criteria
First Draft
Hunsley & Mash, 2008
SPG Feedback (N = 58)
Test Developer Input
IRT Pilot

15. Evidence-Based Assessment Criteria
0 = None
1 = Minimal
2 = Adequate
3 = Good
4 = Excellent
Psychometric Properties
Norms
Reliability Information
Validity Information: Criterion, Content, Construct
Validity Generalization versus Test Bias
Validity Information: Predictive, Discriminant, Concurrent

16. Seattle Implementation Research Conference: Instrument Review Task Force
Universities of Washington, Montana, & Indiana U
VA Center for Implementation Practice and Research Support
IRT
40 Implementation Science Experts from SIRC SPG
International Evidence Informed Practice Consortium

17. SIRC Instrument Review Task Force
Gregory Aarons
Cassidy Arnold
Melanie Barwick
Rinad Beidas
Helen Best
Elisa Borah
Cameo Borntrager
Craig Bryan
Adam Carmel
Mark Chaffin
Kate Comtois
Laura Damschroder
Dennis Donovan
Michelle Duda
Dean Fixsen
Howard Goldman
Carmen Hall
Amanda Jensen-Doss
Sarah Kaye
Sara Landes
Cara Lewis
Marsha Linehan
Aaron Lyon
Michael McDonell
Kate McHugh
Maria Mancebo
Shari Manning
Christopher Martell
Brian Mittman
Sandra Naoom
Raphael Rose
Lisa Ruble
Joe Ruzek
Anju Sahay
Sonja Schoenwald
Jeremy Smith
Bradley Steinfeld
Phil Ullrich
Shannon Wiltsey Stirman
Jennifer Villatte

18. Comprehensive Review 1 Literature Review 2 Construct Specific 3
Measure Specific 4
Individual and Listserv Requests 5
Comprehensive Measure List
215 measures

19. Specific Measure Review: Product for IRT

20. Specific Measure Review: Product for IRT

21. Specific Measure Review: Product for IRT

22. Summary of Review to Date
Constructs with several measures (i.e., more than 5):
Acceptability
Adoption
Relative Advantage
Organizational Culture and Climate
Readiness for Implementation
Knowledge & Beliefs about Intervention
Planning
Reflecting & Evaluating
Constructs with zero measures:
Institute of Medicine’s Service Outcomes: Efficiency, Equity, Timeliness
Intervention Adaptability, Complexity, Design Quality and Packaging, Source
Outer Setting: Cosmopolitanism, Policy & Incentives, Peer Pressure
Implementation Climate: Relative Priority, Goals & Feedback
Engaging & Executing

23. Q&A