Evidence based tool shows that EAPs can and DO achieve positive workplace outcomes (June 7, 2016)

The first Workplace Outcome Suite (WOS) Annual Report 2016 has been released. WOS, an EAPA-endorsed Tool, is demonstrating the effectiveness of EAPs in quantifiable business terms. Currently, more than 500 EAP firms utilize the WOS. A recent evaluation that included roughly 8,100 EAP users from 20 different EAP providers revealed gains in workplace effectiveness after using EAP services measured by the Workplace Outcome Suite. Read the report.


EAPA ENDORSES WORKPLACE OUTCOME SUITE (WOS) AS AN EAP BEST PRACTICE
EAPA has announced its official support and endorsement of the Workplace Outcome Suite (WOS) as an EAP best practice for measuring and evaluating work-related outcomes of EA services.  The WOS is a free, psychometrically valid and reliable, and easy to administer tool developed by Chestnut Global Partners (CGP) Division of Commercial Science.  Under the terms of an agreement between EAPA and CGP, an annual industry-wide aggregate report, including pre and post WOS data across EAP settings, will be available on a yearly basis.  

For more information about the EAPA/CGP agreement and how your EAP can use the WOS at no charge, please see the FAQs below. Questions? Best approach is to email Dave Sharar PhD at dsharar@chestnut.org asking to set up a time to talk. You can also call Dr. Sharar at (309) 820 3570.

FAQs 

What is the WOS-5?
A tool specifically designed for EAPs to measure the workplace outcomes of EAP services. The WOS-5 is:
  • scientifically validated and tested
  • focused on “workplace” (not clinical) outcomes
  • free with the signing of a license agreement
  • currently being used by over 400 EAP organizations
  • short (5 items) and able to detect sensitive change – was derived from the original 25-item version
  • easy to administer as a before/after EAP use measure
Why have EAPA and CGP developed this agreement?
Companies, government agencies, and other organizations in today’s world are looking for objective data to validate and justify all expenditures.  To continue to thrive, the EAP field needs to be able to measure and demonstrate its effectiveness in business terms.

EAPA believes that the value proposition of the EAP field will be significantly strengthened when a critical mass of organizations measure workplace outcomes of EA services using the same “yardstick.”  Sufficient data would allow us, as a profession, to document and demonstrate the effectiveness of EA services across types of industry, sizes of organizations, and geography, as well as organization by organization.

The WOS is currently the only publicly available, free instrument that has been psychometrically validated and tested for use in EAP settings.  That makes it the best available industry-wide yardstick.  Under the agreement between EAPA and CGP, EAPA will promote and encourage the adoption of the WOS as a standard EAP practice and, in turn, CGP will produce for EAPA members (as an exclusive EAPA member benefit) an annual aggregate report pooling all the pre/post WOS data collected  industry-wide.  This will be a significant step forward for the EAP field.

What five areas get measured in the WOS-5?
  1. Absenteeism – number of hours in the last 30 days the employee missed work due to their EAP concern
  2. Presenteeism  - evaluates how distracted the employee is at work due to their EAP concern
  3. Work Engagement  - focuses on how involved or stimulated the employee is by his or her job
  4. Work Distress – concentrates on the employee’s sense of “dread” about going to work
  5. Life Satisfaction – a general measure of personal well-being or quality of life
Why should my EAP measure outcomes?
Our historic focus for measuring EAP success has relied on utilization rates and client satisfaction surveys – neither of which are actual workplace outcomes. Many EAPs don’t know the extent to which their particular program or interventions improve the work performance of employees who use the service, resulting in employers, purchasers or stakeholders focusing on two metrics that are well known: COST and UTILIZATION. Without quantitative measures of value, many business leaders remain skeptical of the basic value proposition of services like EAP, Work-Life, and Wellness. 
 
Has the WOS been used in any scientific studies?
The most rigorous, empirical study to date on EA services and workplace outcomes used the WOS to offer causal evidence of EAP impact. The study site was Colorado State Government employees (sample frame of 27,000) and the method included an intervention group of EAP clients (N = 156) and a well-matched comparison group of non-EAP users (N = 188). The study concluded that employees receiving EAP services improved work functioning more than similar employees who did not receive services.
 
How is the WOS-5 administered?
The WOS was validated using two separate modes of delivery: (1) counselor administered to subjects over the phone or in-person; (2) subject self-administered over the internet or by paper and pen. Both modes work equally well.  
 
How is a WOS evaluation typically designed?
EAP employee clients are given the WOS BEFORE introducing the EAP intervention and then AFTER the intervention (usually about 90 days after the intake to see if EAP had a sustained impact).The post-test should not be administered immediately after the final EAP visit. This design, known as “Correlational” or “Before/After” can identify IF employees are improving at work. EA providers who implement the WOS use a variety of methods to collect this data. Some use Survey Monkey, others commercially available EAP software where the WOS-5 is embedded in the software. Some continue to use “paper & pen” and then record responses in a spreadsheet.
 
How is data typically collected?
Most EAPs conduct the pre-test over the phone at the end of an intake – this usually adds about 2-3 minutes to an average intake. Some EA providers have the client complete the intake in a waiting area before meeting with an EA counselor or clinician. The post-test is usually sent out about 90 days after the pre-test as an e-mail link, or the client (subject) is contacted by phone to complete the post-test. All of this requires getting good locator information at the point of intake. We recommend a protocol of at least three follow-up attempts such as e-mail-phone-e-mail or phone-email-phone before considering the subject non-responsive.
 
How is data analyzed?
If you submit your de-identified data to CGP using the EAPA WOS-5 item spreadsheet, CGP will run a complimentary analysis using IBM SPSS version 22. 
 
What is the biggest challenge?
Getting subjects to respond to the follow-up post-test is a major factor in the success of the evaluation. 
 
How does my EAP benefit by using the WOS-5?
Your stakeholders or client organizations are most interested in the workplace impact of their particular EAP. By participating, you will be able to produce workplace outcome reports that are specific to your service or enterprise. You are also eligible to receive complimentary data analytics when you submit your de-identified and accurately populated spreadsheets to CGP for analysis.
 
Where can I get more information?
More information is available on the WOS website at http://www.eapresearch.com/workplace-outcome-suite-overview.html or send your questions or a request for a complimentary consultation to dsharar@chestnut.org
 
How do I get started?
  1. Sign and return the License Agreement
  2. View the WOS tutorial at www.eapresearch.com
  3. Define your population or sample of subjects (for example, all EAP employee clients or just select client organizations)
  4. Gauge your sample size (this may require a statistical technique known as a “power analysis”)
  5. Set up a data collection process that fits within your EAP delivery system
  6. Train all staff or parties involved in data collection
  7. Monitor your post-test or follow-up response rates
  8. Populate the attached spreadsheet with data (as error-free and complete as possible)
  9. Questions? Best approach is to email Dave Sharar PhD at dsharar@chestnut.org asking to set up a time to talk. You can also call Dr. Sharar at (309) 820 3570.