 ASSESSING ENTREPRENEURSHIP PROGRAMS: A CONTINUED DIALOG ON HOW TO PUSH THE ENVELOPE Alex F. DeNoble, Ph.D. and Gangaram Singh, Ph.D. San Diego State University A PRE-CONFERENCE WORKSHOP: USASBE ANNUAL CONFERENCE HILTON HEAD SOUTH CAROLINA JANUARY 13, 2011

Workshop Objectives  Create a dialog on assessment of Entrepreneurship programs.  Formulate a set of best practices and tools that can be shared  Transform assessment beliefs and attitudes to a culture aspiring towards continuous improvement We all need to learn from each other !

Workshop Agenda 1:00 – 1:45:Overview of assessment process – what is expected of us? – Alex DeNoble 1:45 – 2:15 Assessment challenges – Facilitated discussion 2:15 – 2:30 Break 2:30 – 3:45Competencies, metrics and best practices – Mike Morris 3:45 – 4:00Break 4:00 – 4:45Simulation as an assessment tool – Ernie Cadotte 4:45 – 5:00 Wrap-up – Where do we go from here?

Outcomes Assessment Process The systematic collection, review, and use of information about educational programs undertaken for the purpose of improving student learning and development (Palomba and Banta, 1999).

Course level versus Program level assessment? What is the difference?

Course vs. Program Assessment Course Level Assessment  Each faculty member’s responsibility  Should be tied to the goals of the program  Not the focus of AACSB’s assurance of learning standards! Program Level Assessment  A holistic approach  Reflects broad expectations for each program  Competencies, knowledge and behaviors that program graduates should acquire  Is the focus of AACSB’s assurance of learning standards!

Outcomes Assessment  Significant flexibility in assessment processes  Reliance on indirect assessment measures:  Surveys of alumni  Graduating students  employers  Need for improved accountability measures  Emphasized direct assessments of student learning  Requires formulation of learning goals  Focus on improving curricula  1991 Expectations  2003 Expectations Source: AACSB Assurance of Learning Standards: White Paper – November 20, 2007

Outcome Assessment Process  Definition of student learning objectives (SLOs)  Alignment of curricula with the adopted SLOs  Identification of tools and measures to assess learning  Collection, analyzing, and dissemination of assessment information  Using assessment for continuous improvement “Closing the Loop” Source: AACSB Assurance of Learning Standards: White Paper – November 20, 2007

Learning Goals & Objectives Communication Problem solving Ethical reasoning Financial principles Marketing principles Managerial principles Opportunity recognition Opportunity analysis Concept development Opportunity recognition Opportunity analysis Concept development Competencies Knowledge General Entrepreneur - specific

Tools to Assess Learning  Test questions (M/C, T/F, short answer) – basic knowledge  Case analysis – knowledge, problem solving, reasoning & decision making competencies  Opportunity identification assignment – some entrepreneurial competencies  Simulation – analytical and decision making skills  360 Assessments – designed around competencies  Kuratko’s “spine sweat” business plan presentations – comprehensive assessment!  Other?

Kirkpatrick’s Four Levels of Assessment (Evaluation)

Developing an Assessment Framework Levels 1 and 2Reaction and Learning  Reac tion: Did they like it?  Necessary because can affect higher levels  Learning: Take measure of competencies (as before the program)  Compare before/after scores  Compare before/after with comparison (or control) group

Developing an Assessment Framework Levels 3 and 4Transfer and Results  Transfer: Did they transfer learning to practice?  Results: Did it result in organizational success NOTE: For these levels, you need a tracking system  Webportals with automatic trigger to complete

Closing the Loop  Use data to:  Inform faculty about effectiveness of programs.  Take corrective action  Focus on continuous improvement of curricula Our goal is to “make a difference”

Closing the Loop Activities  Requiring course pre-requisites  Better sequencing of courses in a program  Developing remedial modules  Changing course content  Incorporating extra-curricula activities  Instituting a mentor program  Other?

Update from 2010  Program Goal: “Display knowledge of the key elements of the entrepreneurial process including opportunity recognition and evaluation, concept development, resource procurement, and implementation leading to the creation and capture of value.”  SLO #5.1: Identify possible sources and characteristics of viable business opportunities. SLO #5.2: Develop alternative business concepts for pursuing viable opportunities. SLO #5.3: Identify the types of human, information, and financial resources required for launching and managing a new venture. SLO #5.4: Identify alternative strategies for capturing the accumulated value of a business venture.