Needs Assessment Methodologies in Determining Treatment Capacity for Substance Use Disorders: Environmental Scan Final Report. APPENDIX D: QUALITY RATING TABLES

09/16/2019

Quality Assessment Areas Number of Reports
Questions (purposes) specified
   Yes 29
   Partial 2
   No 2
Questions clearly addressed
   Yes 24
   Partial 5
   No 0
Methods for defining the population described
   Yes 26
   Partial 5
   No 2
Selection criteria for workers specified
   Yes 9
   Partial 1
   No 6
   Not applicable 6
Setting well defined
   Yes 28
   Partial 4
   No 0
Levels of care identified
   Yes 16
   Partial 6
   No 9
Survey: Random sampling
   Yes 6
   No 11
   Unknown/unclear 7
Survey: Instrument reliability and validity reported
   Yes 3
   No 18
Survey: Pilot testing of the instrument reported
   Yes 3
   No 17
Statistical methods described
   Yes 15
   No 12
   Unknown/unclear 4
Stratification used in the analysis
   Yes 3
   No 7
   Unknown/unclear 5
Limitations due to data unavailability or quality reported
   Yes 22
   No 9
Validation of the methodology reported
   Yes 3
   No 27
Model system for gap comparison presented
   Yes 15
   No 15
Recommendations offered
   Yes 29
   No 5
Recommendation feasibility, priorities or strategies
   Yes 20
   No 10
   Not Applicable (no recommendations offered) 4
Ethical issues addressed
   Yes 5
   No 27
IRB approved
   Yes 5
   No 7
   Unknown/unclear 19
How capacity was measured
   Inventory (number of providers, beds, slots, etc.) 8
   Utilization data 4
   Consumer self-report (access, availability) 3
   Key informants 6
   Surveys 4
   Unknown/unclear 1
Operational definition of "need" provided
   Yes prevalence-unmet need gap 3
   Yes-other describe: 8
   No 5
   Partial 0