Thursday, August 26, 2010

2010 MISRGO Annual Evaluation Report

2010 Annual Evaluation Report.  Individual grantees are making significant progress concerning the implementation of their programs.

The annual report was presented to the MISRGO Advisory Board on August 24, 2010. (See the report for detailed findings and a list of accomplishments.)  Officials in attendance from the Arkansas Department of Health included:
  • Dr. Paul Halverson, Director and State Health Officer
  • Dr. Nathaniel Smith, Deputy Director for Public Health Programs and State Epidemiologist
  • Dr. Carolyn Dresler, Program Director of the Tobacco Prevention and Cessation Program
  • Ms. Sherry Johnson, Section Chief, Surveillance and Evaluation
University of Arkansas at Pine Bluff officials included:
  • Dr. Mary Benjamin, Vice Chancellor for Academic Affairs
  • Dr. Calvin Johnson, Dean, School of Education
  • Dr. Marian Evans, Coordinator, MISRGO (and staff)
Advantage Communications personnel were also present, including:

Ms. E'van Steele, Executive Vice President and Whitney Albert, Account Executive

Dr. David Fetterman, President and CEO of Fetterman & Associates, presented the evaluation findings.  The highlights of the evaluation are presented below.

Highlights

All of the grantees are operating within 6 major MISRGO intervention areas, including:
  • Promoting Quitting Among Youth and Adults
  • Identifying and Eliminating Tobacco-Related Disparities Among Population Groups
  • Eliminating Exposure  to Second Hand Smoke
  • Preventing Initiation Among Youth and Adults
  • Creating Tobacco Free Environments
  • Reducing Youth Access to Tobacco
The number of grantees working in each area are displayed below:


There were 5 themes that were identified across the intervention areas, including:


One of the themes, tobacco-free policy, provides an insight into the number of grantee accomplishments documented this year:

Recommendations

The evaluation recommendations are presented below:

Evaluation Dashboard
The MISRGO empowerment evaluation dashboard was introduced to the Advisory Board during this session.  The key elements of the dashboard include: goals, benchmarks, actual performance, and baseline.
Metaphor

A weight lifting metaphor was used in an initial training session with grantees.  It resonated with grantees, Advisory Board Members, and many of the Arkansas Department of Health officials.


Measurement and Monitoring

The report also described the plan for the future, concerning the use of evaluation to help grantees accomplish their objectives and to help MISRGO monitor grantee progress.  The bar chart below illustrates the user-friendly format adopted for the future, e.g. baseline, benchmarks compared with actual performance, and the goal.  This format helps to keep the process transparent.  It enables anyone to see where individual grantees are at any time.  




The evaluation report was well received and will be used to guide the next MISRGO grantee evaluation training session in October 2010.  (The presentation slides are also available.)