Friday, November 29, 2013

MISRGO Tobacco Prevention - 1st Quarter Report 2013-2014

MISRGO Evaluation
Prepared for:            MISRGO, Grantees & Legislative Offices
Prepared by:             Dr. Fetterman, Ms. Delaney, and Dr. Tremain
Date:                          November 11, 2013
                       












Introduction

Tobacco use is the single most preventable cause of disease, disability, and death in the United States” (Center for Disease Control and Prevention, 2011).  The annual health care costs in Arkansas directly caused by smoking is $812 million, according to the Arkansas Department of Health (2009) and the Campaign for Tobacco Free Kids (2013).  Arkansas’ Master Tobacco Settlement revenue is being used in part to address this serious health issue.
 The University of Arkansas at Pine Bluff’s Minority Initiative Sub-Recipient Grant Office (MISRGO) has received Settlement funds through the Arkansas Department of Health to focus on tobacco use in minority communities. MISRGO’s mission is specifically to prevent and reduce tobacco use in minority communities.

MISRGO has awarded more than 50 Arkansas organizations with funding for tobacco prevention and cessation programs.  MISRGO currently sponsors and provides technical assistance for 20 grantees across the State of Arkansas.

MISRGO grantees have broad-based support across the State for their tobacco prevention and cessation work.  (See MISRGO Empowerment Evaluation: June 2011 Annual Report, Fetterman, Tremain, and Delaney, 2011.)
 
MISRGO grantees also have a strong track record of success based on past performance.  For example, last year, the majority of MISRGO grantees met or exceeded their annual performance goals (see MISRGO Evaluation Annual Report 2011-12 Fetterman, Tremain, and Delaney, July 12, 2012 and MISRGO Evaluation Annual Report 2012-2013 Fetterman, Delaney, Tremain, July 18, 2013a).  See also Fetterman, Delaney, and Tremain 2013b and 2013c for interim reports on progress.

Purpose

The purpose of this report is to present MISRGO tobacco prevention grantee progress at the end of the 1st Quarter 2013-2014.  The fiscal and programmatic end of the year is June 30, 2014.  (See Appendix A for a glossary of grantee names.)

MISRGO Grantee Intervention Areas

MISRGO grantees use the Centers for Disease Control and Prevention’s (CDC) approved and recommended intervention areas.  They include:

Area 1:  Eliminate Exposure to Secondhand Smoke
Area 2:  Preventing Initiation Among Youth and Young Adults
Area 3:  Promoting Quitting Among Youth and Adults
Area 4:  Addressing Disparities

Grantee progress and activities are reported on both a quarterly and annual basis, according to these CDC intervention areas. 
 
Quarterly Progress

During the first quarter (the focus of this report), MISRGO grantees established their goals, benchmarks, and baselines.   Goals are the planned outcomes or results at the end of the year, e.g. number of smoke-free parks.  Benchmarks are intermediate objectives or approximations of outcomes.  Baselines represent, for example, the number of smoke-free environments that existed before the grantee activity or intervention. 

During the second quarter, grantees report on their mid-year progress toward annual goals.  This provides grantees with an opportunity to reflect on their performance.  Based on these data, grantees continue as planned, make mid-course changes, and request assistance as needed.

The third quarter focuses on any gaps between benchmarks and annual goals.  Grantees share techniques with each other, MISRGO staff provide additional recommendations, and Fetterman & Associates notify grantees about gaps and make specific recommendations to close the gap. 

The fourth quarter is the annual comparison of their goals with their actual performance throughout the year.

1st Quarter Findings

99% of MISRGO grantees have established their goals, benchmarks, and baselines for the year.   Approximately half of the grantees have met or exceeded their 1st Quarter evaluation benchmarks:

Area 1:  Eliminate Exposure to Secondhand Smoke  (63% met or exceeded 1st Qtr benchmarks)
Area 2:  Preventing Initiation Among Youth and Young Adults (63% met or exceeded 1st Qtr benchmarks)
Area 3:  Promoting Quitting Among Youth and Adults (47% met or exceeded 1st Qtr benchmarks)
Area 4:  Addressing Disparities (52% met or exceeded 1st Qtr benchmarks)


  
CDC Area 1:  Eliminate Exposure to Secondhand Smoke

Over half of grantees have met or exceeded their 1st Quarter evaluation benchmarks concerning Area 1:  Eliminate Exposure to Secondhand Smoke (63% met or exceeded their 1st Quarter evaluation benchmarks).

Grantee activities focused on:

·      Encouraging voluntary smoke-free perimeter policies
·      Educating parents and law enforcement officers about the benefits of smoke free environments in the car (Act 811)
·      Promoting Act 811
·      Gathering petition signatures for smoke free environments
·      Increase public support for smoke-free air policies
·      Promoting extracurricular activities designed to increase knowledge about smoking and how it affects nonsmoking individuals
·      Encouraging the adoption of tobacco-free policies
·      Planning to implement tobacco prevention training, such as Project Alert or Banner’s in the Schools
·      Planning to implement a plan to produce smoke free family cars
·      Establishing smoke-free parks
·      Increasing the number of community organizations that support smoking bans/policies
·      Increasing youth awareness about the dangers of tobacco products (surveys and outreach)


CDC Area 2:  Preventing Initiation Among Youth and Young Adults

The majority of grantees have also met or exceeded their annual goals concerning Area 2: Preventing Initiation Among Youth and Young Adults (63% met or exceeded their 1st Quarter evaluation benchmarks). 

Grantee activities focused on:


  • ·      Conducting store-front surveys
  • ·      Providing training in prevention strategies through media outreach, gorilla marketing campaigns, and youth ralliesEncouraging youth and young adults to pledge not to initiate tobacco use
  • ·      Educating African American and Latino youth on the effects of smoking
  • ·      Conducting compliance checks on retailer sales to minors

  • ·      Increasing the use of the Quitline
  • ·      Increasing the number of youth oriented tobacco prevention events
  • ·      Educating youth and young adults about the dangers of tobacco

CDC Area 3:  Promoting Quitting Among Youth and Adults

The overwhelming majority of grantees have met or exceeded their annual goals concerning Area 3:  Promoting Quitting (47% met or exceeded their 1st Quarter evaluation benchmarks). 

Grantee activities focused on:


  • ·      Increasing use of the Arkansas Quitline
  • ·      Encouraging African Americans and Latinos to participate in cessation programs
  • ·      Encouraging African-American males to use the Arkansas Quitline
  • ·      Helping to start a tobacco youth program where students learn about smoking
  • ·      Helping to increase community partners
  • ·      Increasing Hispanic calls to SOS Quitline
  • ·      Decreasing chewing tobacco use
  • ·      Increasing number participating in 40 Days to Freedom programs

CDC Area 4:  Addressing Disparities

The majority of grantees have also met or exceeded their annual goals concerning Area 4:  Addressing Disparities (52% met or exceeded their 1st Quarter evaluation benchmarks). 

Grantee activities focused on:

·      Sharing information about current tobacco laws
·      Improving access to existing cessation resources for Hispanic males
·      Developing smoke free policies or point of purchase policy to reduce advertising
·      Creating diverse partnerships to address tobacco-related disparities
·      Increasing African-American and Latino post-test scores in awareness
·      Educating African American and Latino residents concerning tobacco related health disparities
·      Increasing the number of minorities pledging to keep themselves or their homes and vehicles tobacco free
·      Referring people to the SOS Quitline and/or other local cessation resources
·      Planning to organize Youth Extinguishing Smoking teams (Y.E.S. Teams)
·      Increasing the number of churches implementing the 40 Days to Freedom program
·      Increasing minorities’ awareness of tobacco related disparities

An evaluation dashboard for each grantee’s annual performance is provided to facilitate communication and collaboration among grantees, enhance MISRGO accountability, and build knowledge.  It is organized by CDC intervention area (see Appendix B). The MISRGO Grantee Activity Log provides an additional insight into the list of grantee activities across sites and intervention areas (see Appendix C).  

Technical Assistance

MISRGO grantees receive programmatic and evaluation technical assistance throughout the year, including assistance monitoring and evaluating their progress.  

Primarily new grantees participated in an evaluation workshop on October 3, 2013, highlighting the use of the: 3 steps of empowerment evaluation and evaluation dashboard, including recording baseline, goals, benchmarks, and actual performance. 


The evaluation dashboard is used to help grantees monitor their own progress throughout the year. MISRGO and evaluation team members also use it to enhance accountability, signaling precisely when assistance is required to increase the probability of grantees accomplishing their end-of-year goals. 
Grantees openly discussed obstacles and generously shared advice and best practices, based on their own experience.


The evaluation dashboards are designed to build capacity and produce outcomes.  They are in accordance with an empowerment evaluation approach.  (Fetterman, 2013; Fetterman and Wandersman, 2005.)
Grantees are provided with additional tobacco prevention tools and updates to facilitate their programmatic and evaluative efforts  (See Appendix D for an example of a periodic technical assistance communication.) 

Details concerning evaluation technical assistance are provided on the MISRGO tobacco prevention blog at: http://tobaccoprevention.blogspot.com

Conclusion

The majority of MISRGO grantees have established their goals, benchmarks, and baselines.  In addition, they have documented their actual performance.  The majority are meeting or exceeding their 1st Quarter tobacco prevention evaluation benchmarks in each of the CDC intervention areas.  The evaluation dashboards help grantees monitor their own performance.   They are being used to confirm effective performance and alert MISRGO and grantees concerning the need for corrections throughout the year.

The evaluation findings reported in this 1st Quarter evaluation report provide evidence of MISRGO grantee dedication and commitment, concerning tobacco prevention.  They also document progress toward annual programmatic and evaluation goals.





References

Arkansas Department of Health (2009). Tobacco Prevention and Cessation Program
ARKANSAS STRATEGIC PLAN TO PREVENT AND REDUCE TOBACCO USE 2009 – 2014.  Little Rock, Arkansas:  Arkansas Department of Health, p. 3. http://www.healthy.arkansas.gov/programsServices/tobaccoprevent/Documents/TPCPStrategicPlan.pdf

Centers for Disease Control and Prevention National Center for Chronic Disease Prevention and Health Promotion (2011). Tobacco Use.  Targeting the Nation’s Leading Killer
- At A Glance 2011.  Atlanta, Georgia:  Centers for Disease Control and Prevention.

Campaign for Tobacco Free Kids (2013). Annual health care costs in Arkansas directly caused by smoking. http://www.tobaccofreekids.org/facts_issues/toll_us/arkansas

Fetterman, D.M. (2013).  Empowerment Evaluation in the Digital Villages:  Hewlett-Packard’s $15 Million Race Toward Social Justice.  Stanford:  Stanford University Press.

Fetterman,  D., Delaney, L., Tremain, B. (2013a).  MISRGO Evaluation Annual Report 2012-2013.  San Jose:  Fetterman & Associates (July 18, 2013).

Fetterman, D.M., Delaney, L., and Tremain, B. (2013b).  MISRGO Evaluation 2nd Quarter Progress Report 2013.  San Jose:  Fetterman & Associates.

Fetterman, D.M., Delaney, L., and Tremain, B. (2013c).  MISRGO Evaluation 3rd  Quarter Progress Report 2013.  San Jose:  Fetterman & Associates

Fetterman, D.M., Tremain, B., and Delaney, L. (2012).  MISRGO Evaluation Annual Report 2011-2-12.  July 12, 2012. San Jose: Fetterman & Associates.

Fetterman, D.M., Tremain, B., and Delaney, L. (2011).  MISRGO Empowerment Evaluation:  June 2011 Annual Report.  San Jose: Fetterman & Associates.

Fetterman, D.M. and Wandersman, A. (2005). Empowerment Evaluation Principles in Practice.  New York: Guilford Publication.




Appendix A

Glossary of Grantee Names




  


Appendix B  - Individual Grantee Annual
Evaluation Dashboards


Area 1:  Eliminate Exposure to Secondhand Smoke

Area 2:  Preventing Initiation Among Youth and Young Adults

Area 3:  Promoting Quitting Among Youth & Adults

Area 4:  Addressing Disparities






Appendix C

1st Quarter MISRGO Grantee Activity Log

A Quarterly Activity Log is an additional monitoring tool.  It is used to supplement the evaluation dashboards.  It enables grantees to record activities used to implement their programs and accomplish their objectives.  It also enables MISRGO and the empowerment evaluators to determine if grantees are on track and provide assistance as needed.

Minority Initiative Sub-Recipient Grant Office 2013-14

Quarterly
(Please supply total number for each)
QTR 1
July 1 - September 30
QTR II
October 1 - December 31
QTR III
January 1 - March 31
QTR IV
April 1 - June 30
Coalition members
2,861



Coalition meetings
46



Adult pledges
798



Youth pledges
1,439



Smoke-free home/car pledges
1,500



Promotional items distributed
2,250



Educational materials distributed
5,412



Newsletters distributed
512



Radio spot(s)
1



Reach of radio spot(s)
undetermined



Newspaper ad(s)
3



Reach of newspaper ad(s)
10,000



Television ad(s)
0



Reach of television ad(s)
0



Fax Back referrals
95



Individuals telephoned the Quitline
61 (undetermined)



Billboard(s)
0



Reach of billboard(s)
0



Website Hits
2,442



Facebook Impressions
9,105



Twitter Followers
697



TV Spots-Press Conference
5



Reach of TV Spots-Press Conference
156,649



TV Interviews
0



Letter(s) to the Editor
1







Appendix D

Sample of Email Technical Assistance

Below are four articles sent to grantees, concerning tobacco findings, tools, and news:

New findings from South Africa lead researchers to call for worldwide recording of smoking in death registries
http://www.medicalnewstoday.com/releases/265091.php

Smoking Cost Calculator for Android
http://www.appszoom.com/android_applications/health/smoking-cost-calculator_hnpzq.html

Government Panel Urges Doctors To Take A Bigger Role In Discouraging Teen Smoking
http://thinkprogress.org/health/2013/08/26/2525651/government-panel-primary-care-docs-smoking/

Big Tobacco Goes High-Tech To Convince You That Smoking Is Cool Again


http://thinkprogress.org/health/2013/06/13/2137481/big-tobacco-high-tech-smoking-cool/