Feasibility Study for the Evaluation of DHHS Programs Operated under Tribal Self-Governance. Appendix: Matrix of Issues and Concerns Raised at Discussion Groups At NIHB and DHHS/DOS Self-Governance Conferences


Discussion Guide Matrix
Do the Draft Findings and Conclusions Ring True in Your Experience?

Financial Issues

Political Issues



Systematic Problems

Opposition to looking at “total tribal revenues”, look at program expenditures.

Comparing SG with non-SG programs may trigger other issues, ie direct services vs. Title I contract tribes.

What does ‘turn-over’ measure? Why the focus?

Possible measures include: tribal codes and levels of community participation.

Many tribes are members of consortia and data/finances are mixed.

Look at program revenues not tribe total

Evaluation should provide forum for showing SG works

See if tribal employment increased.

Look at ‘new services’ added to programs since SG.

Many tribes lack infrastructure prior to take-over

Gaming tribes will resist gov’t examination of total revenues

Fear that pressure on data will move tribes toward regionalization.

Look at ‘institutional history’ through interviews, not turnover

Pre/Post not fair, as tribes not receiving same level of funds as states (TANF, Child Support) upon contract

Draft Findings document assumes there will be a standard for uniform reporting across sites. This is not realistic.


Tribal priorities drive SG, and can prioritize ‘quality’ over ‘quantity’.

Draft Findings document suggests tribes do not have salary data by position, but most tribes do have this in budgets.

Draft Findings document suggests a standard of an “integrated system” which tribes lack.  Note that neither states nor feds have this either.


The responsibility to secure baseline data from states/feds prior to SG must rest with Feds.


Discussion Matrix
What Omissions Do You See?


Purpose for Evaluation

Assumption of Trust

Cost Implications


We want to see success stories

Better description of evaluation processes applied in this study

You need to convey trust is there.  Trust of tribes will reduce skepticism.

The cost of moving toward an “integrated MIS” must be born by the feds, if it will be used as a standard for evaluation.  It is a tribal decision to move toward integrated MIS.


Address issues of evaluating small populations, numbers.

Tribal Self-Governance already assumes a level of competence.

No across the board measures. The cost of doing these measures must be covered.


Important to communicate that this study looks at feasibility of evaluating federal PROGRAMS operated under SG and not the concept of SG itself.

Tribes have to determine and define their own outcomes.

Tribes should have same access to resources as states to do this work.


Discussion Matrix
What Are Best Outcomes of This Feasibility Study?

Success Stories/Lessons


Tribal Base

Better Focus

Know Limits

Document tribal innovations, collaborations and creativity

Move away from terms like “failure” and use terms like “challenges”

Tribes starting from level of inadequate funding and lack of infrastructure

You cannot evaluate Self Governance, but you can evaluate federal programs operated under SG mechanism.

You cannot do an across the board evaluation design with SG, because SG allows for tribal innovation and priorities.

Communicate the service ‘values’ from the community perspective, ie increased control, increased participation, cultural appropriateness

Find another word for “evaluation”, it has negative connotation

Tribes already have program specific reporting requirements with 11 DHHS programs.

If tribes perform poorly in an evaluation will the feds take-away funding? Tribes want to know.

Self Governance was intended to allow tribes flexibility to do the most with limited resources.


Program evaluations under SG, not evaluation of SG.

Statistical data is already available and should be used.

Begin with minimum standards not maximum standards as base.

Understand challenges to measuring small populations, small data.


Look at services provided not money spent

More complex than counting users, also look at intangibles like ‘ownership’ building a base, hiring tribal members..



View full report


"draftreport.pdf" (pdf, 169Kb)

Note: Documents in PDF format require the Adobe Acrobat Reader®. If you experience problems with PDF documents, please download the latest version of the Reader®