Michael Quinn May-Lorie Saint Laurent

Slides:



Advertisements
Similar presentations
The Use of Business Intelligence Dashboards in Vocational Rehabilitation An Illustration of the Approach Taken by the Alabama Department of Rehabilitation.
Advertisements

Research Plan: Using Data to Create Impactful Pride Campaigns
Student Data Reporting Tools Michele J. Hansen, Ph.D. Executive Director Student Data, Analysis, and Evaluation Enrollment Management Advisory Council.
Local Evaluation Overview and Preliminary Findings Diane Schilder, EdD.
The Use of Business Intelligence Dashboards in Vocational Rehabilitation Milton Moats VR Program Specialist ADRS Homewood Field Office Birmingham, Alabama.
Ensuring a Quality Workforce Via Skill Standards and Certifications Presented by the Palm Beach County Workforce Development Board.
Career Exploration & Plan Development Workshop Day Three Questions? 9/17/20151Maine Vocational Rehabilitation.
Commonwealth of Massachusetts Statewide Strategic IT Consolidation (ITC) Initiative ANF IT Consolidation Website Publishing / IA Working Group Kickoff.
0 Emerging Findings from the Employment Retention and Advancement (ERA) Evaluation Gayle Hamilton, MDRC Workforce Innovations 2005 Conference.
Your Dream Career To be the next Lassie Work on a fire truck.
Keeping Up With Demand: Measuring Labor Market Alignment in TAACCCT Programs Michelle Van Noy and Jennifer Cleary TCI Research Symposium: Evidence of What.
Brian Alpert July 14, 2010 Leveraging Web Analytics and Search Engine Optimization (SEO) Project Workshop.
STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES Integrated / Calendar (IE&C) Discovery Project Overview & Update April 18, 2007.
HCS 465 Week 2 Individual Applying the Background and Methodology of the Research Process to Problems in Health Care To purchase this material click below.
Elizabeth Evans Getzel Virginia Commonwealth University
Use PowerPoint deck to share with your staff details about:
JMFIP Financial Management Conference
Christine Quinn Regional Administrator U.S. Department of Labor
Using LMI as a Counseling Tool
Using LMI as a Counseling Tool
The Marketing Research Industry and Research Ethics
Texas Process: UI Claimant Work Search
Solving the Mystery of BI
Linking information for better lives in Connecticut
Evaluation Plan Akm Alamgir, PhD June 30, 2017.
Lisa Hinson-Hatz, VR State Director Tracey Frye, Program Specialist
CPIC at the General Services Administration (GSA)
Oklahoma’s Workforce Information Programs Education Job Seekers Employees Employers Oklahoma’s Workforce.
Michael Quinn May-Lorie Saint Laurent
VR and Business Relations: State of the Research
Lisa Dawson – Head of Student Systems Operations
The Ohio System: Research and Practice for Integrating Data and Policy
Department of Post-Secondary Education, Training and Labour
MTM Tools key to running
MHA 626Competitive Success/tutorialrank.com
CMGT 445 MASTER Lessons in Excellence--cmgt445master.com.
MHA 626 Education for Service-- tutorialrank.com.
Job-Driven Technical Assistance Center (JD-VRTAC): Colorado DVR
Promising Practices for Increasing Certificate and Credentialing Outcomes H-1B Ready to Work.
Nick Kremer, Facilitator
Penn State Educational Programming Record (EPR) Guide
Cluster, Multi-Site, and Multi-Level Evaluation Systems and Frameworks
Job-Driven Technical Assistance Center (JD-VRTAC): Connecticut Bureau of Education and Services for the Blind Using LMI to Improve Client Employment Outcomes:
Career Outcomes for Higher Education Graduates
CHAPTER three The Marketing Research Industry and Research Ethics
Colorado DVR Systematic Use of Labor Market Information to Increase Client Outcomes Jennifer Scilacci, Partner Engagement and Communication Manager.
Ranking of Pavement Preservation Methods and Practices
Demand-Driven Workforce Information: Getting What You Need from Your LMI Shop Cynthia Forland, Labor Market and Performance Analysis.
Moving Forward Building and Leading a Business Relations Unit
Georgia Frontline Decision Support System Pilot
Job-Driven Vocational Rehabilitation Technical Assistance Center (JD-VRTAC) Project Support to PA OVR Integrating Labor Market Information (LMI) into.
Curriculum Review and Design
Office of Planning, Research and Evaluation
National Center for Mobility Management Webinar May 10, 2018
Big Data ESSNet WP 1: Web scraping / Job Vacancies Pilot
Integrated Delivery Model
Kuali Research Organizational Change Management
EDUCAUSE MARC 2004 E-Portfolios: Two Approaches for Transforming Curriculum & Promoting Student Learning Glenn Johnson Instructional Designer Penn State.
DIGITAL IDENTITY FOR COMPANIES
CHANGE IS INEVITABLE, PROGRESS IS A CHOICE
Trade Adjustment Assistance Program Overview
Technical Assistance Webinar
Communication Plan Template and Example
Bob Flewelling Amy Livingston
Bob Flewelling Amy Livingston
IISD’s SDG Knowledge Hub
Michael Quinn May-Lorie Saint Laurent
CareerOneStop Find Your Pathway to Career Success
Are We Doing It the Right Way
Alabama’s 2020 Combined Workforce Plan
Presentation transcript:

Michael Quinn May-Lorie Saint Laurent The Creation, Implementation, and Challenges of Rolling Out an LMI Dashboard in Alabama and Preliminary Perspectives of Users Michael Quinn May-Lorie Saint Laurent

Presentation Objectives The objectives of this presentation are two fold: To give a brief overview of the results from the pre and post dashboard expansion surveys, & To discuss lessons learned from the development of the dashboard, and share some of the features.

Project Background The ICI is working with the ADRS to implement a set of research activities to examine important features of strategic planning and data integration into a business intelligence (BI) effort. This effort is subdivided into multiple studies: Study a) Intends to examine ADRS’s VR outcomes in correlation with labor market trends using secondary data analysis methods. Study b) Documents the process of incorporating LMI into strategic planning efforts through qualitative case studies. Study c) Investigates the changes in job placement strategies resulting from specific BI efforts using a mixed-methods approach.

Research Methods/Project Implementation The ICI and ADRS have conducted a series of pre-test and post-test surveys to measure the impact of the dashboard expansion on agency staff. Respondents were selected from three organizational levels (agency, field services, and counselors), and from geographically diverse offices across the state of Alabama. Using the surveys, we assessed the level of understanding, use, and access of LMI and BR before and after the dashboard expansion.

Survey Responses Pre-test and post- test surveys were conducted at two different time periods using different methodologies. The pre-implementation survey was conducted onsite in 2016 and yielded 105 surveys. The post-implementation survey was conducted online in 2017 and yielded 86 surveys. For the purposes of this presentation, in addition to looking at data from all respondents, we will also be presenting data from individuals that completed both surveys. To date, 30 surveys have been matched.

Project Accomplishments/Results The top 5 ways in which ADRS staff are accessing labor market information after the implementation of the dashboard are as follows: 69.4% Work with the ADRS BRC 67.1% Google (or other search engine) 52.9% Look for LMI on Department of Labor websites 37.6% Talk to another VRC 34.1% Use the ADRS LMI Dashboard The top 5 best ways 31.0% Work with the ADRS BRC 25.0% Look for LMI on Department of Labor websites 15.5% Use of the ADRS LMI Dashboard 13.1% Google (or other search engine) 9.5% Other

Project Accomplishments/Results Of the 64.0% that had accessed the dashboard at the time of the survey, 44.6% thought that it was very easy or easy to use, 40.0% that it was ok to use, and 15.4% that it was difficult or very difficult to use. They found the following features to be helpful: Local labor market data (59.2%) BRC job leads (52.1%) Information about Occupations (i.e., Outlook, Wage data, ADRS placements) (52.1%) Links to One-Stop job leads (42.3%)

Project Accomplishments/Results Matched pairs (N=30) Prior to the implementation of the dashboard, 62.1% had heard of traditional LMI, and 60.7% had heard of agency-generated LMI. Post-implementation, 93.3% have heard of traditional LMI and 83.3% have heard of agency-generated LMI.

Project Accomplishments/Results Traditional LMI Agency-generated LMI PRE POST Several times a week 6.9% 3.3% Weekly 20% Monthly 34.5% 43.3% Quarterly 13.8% 23.3% Other 37.9% PRE POST Several times a week 24% 3.3% Weekly 16% 10% Monthly 8% 36.7% Quarterly 13.3% Other 20 16.7%

Lessons Learned in Dashboard Design & Implementation Build on What You Have Align Internal and External Data Divide and Conquer Agency Generated Traditional Real Time

Brief Illustration & Examples

ADRS LMI Dashboard

ADRS LMI Dashboard

ADRS LMI Dashboard

Questions?

Contact Information www.explorevr.org Michael Quinn: michael.quinn@rehab.alabama.gov May-Lorie Saint Laurent: maylorie.stlaurent@umb.edu