SITE REVIEWER TRAINING WORKSHOP October 26, 2012

Philosophy of the COSMA Accreditation Model Outcomes based/Mission driven Outcomes based/Mission driven Accreditation principles based on best practices in SM education Accreditation principles based on best practices in SM education Developmental – annual reporting focused on continuous improvement Developmental – annual reporting focused on continuous improvement Flexible – accommodates various institutional models and innovative approaches Flexible – accommodates various institutional models and innovative approaches

Benefits of Accreditation Dedicated staff Dedicated staff Free training, assistance Free training, assistance Best practices - templates, rubrics Best practices - templates, rubrics External accountability External accountability Enhanced reputation Enhanced reputation External assurance of quality External assurance of quality Effective mechanism for continuous improvement Effective mechanism for continuous improvement Mechanism for program advocacy Mechanism for program advocacy

Scope of Accreditation Includes both undergrad and graduate programs Academic unit should be an identifiable entity and led by a doctorally- or professionally-qualified educator Includes off-campus locations All programs included even if through cooperative or interdisciplinary arrangements All modes of delivery should be included (online, distance learning, adult degree, accelerated) In Annual Report, programs notify COSMA if a new program is being added

Scope of Accreditation, con’t Definition of “Program” – track, minor, concentration Within sport management degree, include all tracks “Tracks” outside sport management degree (e.g., physical education), include sport management track Program must provide rationale for what is included and what is not included in accreditation process If a program “appears” to be accredited by COSMA, it must be included in the accreditation process or the program must provide rationale for why it’s not included

Steps to Accreditation 1) Membership application & fee 2) Attain Candidacy Status (CS) 3) Collect data and begin writing Self Study 4) Establish timeline for site visit 5) Complete Self Study (at least 90 days prior to site visit) 6) Site visit (2 days) 7) Decision by Board of Commissioners (November/May-June of each year)

Quiz #1 Experience with Other Accrediting Bodies?

COSMA individual/institutional membership COSMA individual/institutional membership Submit an electronic CV Submit an electronic CV Attend a training workshop Attend a training workshop Be familiar with COSMA principles, policies & procedures Be familiar with COSMA principles, policies & procedures Time commitment: 2 days, preparation and follow-up Time commitment: 2 days, preparation and follow-up Becoming a Site Reviewer

Site Visit Assignments Schedule visits 3-6 months in advance Schedule visits 3-6 months in advance COSMA staff, BOC assigns two person team as early as possible COSMA staff, BOC assigns two person team as early as possible Conditions Conditions  Avoid conflicts of interest  Balance and representation  Costs

Honoraria and Travel Reimbursement Institution responsible for paying all costs: Institution responsible for paying all costs: Honoraria - $300/day for team chair; $200/day for team member Honoraria - $300/day for team chair; $200/day for team member Travel Travel Hotel Hotel Meals Meals Miscellaneous costs (e.g. travel to and from home airport) Miscellaneous costs (e.g. travel to and from home airport)

Prior to visit: 1) Review self study at least twice 2) Discuss preliminary impressions by phone 3) Request additional materials, as needed 4) Modify site visit agenda, as needed Prior to visit: 1) Review self study at least twice 2) Discuss preliminary impressions by phone 3) Request additional materials, as needed 4) Modify site visit agenda, as needed On-site: 1) Meet night before 2) Stick to agenda and remain on time 3) Validate self-study materials 4) Write detailed report On-site: 1) Meet night before 2) Stick to agenda and remain on time 3) Validate self-study materials 4) Write detailed report Post-visit: 1) Write summary report Post-visit: 1) Write summary report Site Team Responsibilities

Designated by COSMA staff, BOC Designated by COSMA staff, BOC Served on at least two other site teams Served on at least two other site teams Or, is a past member of the COSMA BOC Or, is a past member of the COSMA BOC Coordinates visit details with the institution Coordinates visit details with the institution Review and modify site visit agenda Review and modify site visit agenda Responsible for completing a thorough and objective site visit Responsible for completing a thorough and objective site visit Submits the completed site team report Submits the completed site team report Team Chair Role & Responsibilities

Campus Coordinator Role Person responsible for accreditation process (not necessarily the department chair) Person responsible for accreditation process (not necessarily the department chair) Helps team make travel plans, including transport to and from their hotel to your campus Helps team make travel plans, including transport to and from their hotel to your campus Develops site visit schedule Develops site visit schedule Makes sure site visit stays on schedule Makes sure site visit stays on schedule Organizes on campus meeting room for team Organizes on campus meeting room for team

Review all self-study materials and note questions, concerns Review all self-study materials and note questions, concerns Communicate with the other team member about initial findings, concerns Communicate with the other team member about initial findings, concerns Make necessary travel arrangements Make necessary travel arrangements Phone training with COSMA Executive Director Phone training with COSMA Executive Director Develop questions to ask on site Develop questions to ask on site Site Visit Preparation/Reviewing the Self Study

Arrive the evening before the visit Arrive the evening before the visit Site Team Meeting Site Team Meeting  Re-familiarize yourself with self-study materials  Discuss the schedule for the visit – who leads which interviews  Plan opening session and exit interview with Department Chair, On-site Coordinator, etc.  Discuss report writing process  Determine if any additional materials are needed Pre-Visit Meeting

Sample Site Visit Schedule: Day 1 Schedule 8:00 amMeet with dept. head to discuss two day visit 9:00 amMeet with President and/or Chief Academic Officer 9:30 am Meet with Outcomes Assessment Coordinator to review institutional plan 10:30 amReview Sport Management O/A plan with dept. head NoonLunch with faculty (no administrators present) 1:30 pm Work time for site team & dept. head to validate self- study and ask questions (3 - 4 hours) 6pmDinner

Sample Site Visit Schedule: Day 2 Schedule 8:00 amMeet with students majoring in sport management 9:00 am Tour facilities (library, classrooms, computer labs, etc.) 10:30 amExit interview with dept. head (and others, if desired) NoonLunch meeting with Advisory Board (or other parties) 1:30 pm Site team works on draft report/time for unexpected issues 3:00 pmSite team departs from campus

Self Study Organization Volume 1  Title Page  Table of Contents  Background information  Documentation of Accreditation Principles Volume 2 - Appendices  Catalog (online URL okay)  Abbreviated Syllabi  Faculty CVs (full- and part-time)  Outcomes Assessment Plan, Results, and Actions  Strategic Plan  Faculty Handbook (can be separate document)

Eight Principles of Accreditation Outcomes Assessment Outcomes Assessment Strategic Planning Strategic Planning Curriculum Curriculum Faculty Faculty Scholarly & Professional Activities Scholarly & Professional Activities Resources Resources Internal & External Relationships Internal & External Relationships Educational Innovation Educational Innovation

Assess Key Content Areas: Assess Key Content Areas: Program assessment Program assessment Clear and measurable student learning outcomes Clear and measurable student learning outcomes Direct and indirect measures of student learning Direct and indirect measures of student learning Basic Skills - undergraduate and graduate Basic Skills - undergraduate and graduate Personal development of students Personal development of students Operational effectiveness (and measurements) Operational effectiveness (and measurements) Integration into future budgeting and planning Integration into future budgeting and planning Review measurement instruments and rubrics Review measurement instruments and rubrics Review reported results Review reported results Note changes and improvements – Action Plan Note changes and improvements – Action Plan Principle 1: Outcomes Assessment

Quiz #2 Which of the following are direct measures of student learning? 1.Capstone course project 2.E-portfolio 3.Comprehensive exam 4.Internship supervisor evaluation

Direct Measures of Student Learning Demonstrate direct evidence of student learning: Comprehensive exams Standardized national exams Pretest and posttest assessments Required structured internship Portfolios (electronic or traditional) Capstone project assessment Thesis/Dissertation External certification program (e.g., NSSE)

Indirect Measures of Student Learning Ask students (or others) about their learning: Graduate survey Alumni survey Employer/internship supervisor survey Exit interview Advisory Boards Student focus groups Anecdotal evidence

“Closing the Loop” Institutional Goals Student Learning Outcomes BenchmarkMeasurement Tool ResultsAction Plan Communicate effectively both orally and written. Comprehension and application of professional written and oral communication business skills. 80% of the students meet proficiency standards in writing - measured using writing rubric Written assignments in BU210 and BU % of the student in BU210 & BU404 met the standard Continue to record scores for writing evaluation the these two courses. Discuss the possibility of a standardized test in the core courses to meet this competency

Principle 2: Strategic Planning 1.Profile of sport management program 2.Description, assessment of resources 3.External analysis – beyond COSMA site visit 4.SWOT analysis 5.Student learning objectives, strategies, actions plans, and O/A processes 6.Operational objectives, strategies, action plans, and O/A processes

Principle 3: Curriculum 3.1 Program Design 3.2 Common Professional Component 3.3 General Education 3.4 Breadth and Depth of Curriculum 3.5 Curriculum Review and Improvement 3.6 Master’s Degree Curriculum 3.7 Doctoral Curriculum

3.2: Common Professional Component (CPC) A) Social, psychological and international foundations of sport B) Management 1. Sport mgmt principles 2. Sport leadership 3. Operations mgmt/event & venue mgmt 4. Sport governance C) Ethics D) Sport marketing & communications E) Finance/Accounting/ Economics 1. Sport finance 1. Sport finance 2. Accounting 2. Accounting 3. Economics of sport 3. Economics of sport F) Legal aspects of sport G) Integrative experience: 1. Strategic mgmt/policy 1. Strategic mgmt/policy 2. Internship 2. Internship 3. Capstone experience 3. Capstone experience

CPC Table

Quiz #3 Common Professional Component

Principle 4: Faculty 4.1 Faculty Qualifications 4.2 Faculty Load 4.3 Program Coverage 4.4 Faculty Evaluation 4.5 Faculty Development 4.6 Faculty Policies

4.1: Faculty Qualifications Doctorally qualified: 1. Holds Ph.D. in SM or related field 2. Holds J.D. and teaches in legal environment of SM 3. Holds out-of-field doctorate, with sufficient combination of graduate work, professional experience, scholarly achievements, and successful teaching experience Professionally qualified: 1. Be A.B.D. 2. Hold Master’s degree in SM field and five years teaching experience 3. Hold Master’s degree in SM-related field with post-graduate training in areas of teaching responsibility Minimally qualified: 1. Master’s degree in field appropriate to teaching responsibilities

4.1: Faculty Qualifications, con’t 1)Identify the credentials of all full- and part-time faculty members 2)Review current vitae for all SM faculty (in Appendix) 3)Review and validate all tables related to Faculty Coverage and Load

Quiz#4 What are the minimum number of faculty needed for a program?

Principle 5: Scholarly and Professional Activities  Scholarship of: Teaching Discovery Integration Application  Professional activities include: consulting, seminars, workshops, professional organizations

Principle 6: Resources 6.1 Financial Resources 6.2 Facilities 6.3 Learning Resources 6.4 Educational Technology and Support 6.5 Off-Campus Locations

Principle 7: Internal and External Relationships 7.1 Internal Relationships 7.2 Admissions Processes 7.3 External Oversight 7.4 Business/Industry Linkages 7.5 External Cooperative Relationships 7.6 International Cooperation 7.7 Diversity in Sport 7.8 External Accountability

Quiz #5 Are internships required by COSMA? a) Yes b) No c) Only for big institutions d) Only if you have enough faculty

Principle 8: Educational Innovation  Evaluate the institution's support for innovation  Evaluate the process in the program for encouraging educational innovation  Review recent examples, including improvements

Course syllabi Course syllabi Institutional catalog Institutional catalog Copy of last regional accreditation self-study report and findings Copy of last regional accreditation self-study report and findings Faculty member vitae Faculty member vitae Faculty handbook Faculty handbook O/A Plan O/A Plan Summary of realized outcomes Summary of realized outcomes On-site Materials

Who? Up to the department to determine – usually the campus coordinator, chair, and faculty Who? Up to the department to determine – usually the campus coordinator, chair, and faculty Review program strengths Review program strengths Review areas that partially meet the principles Review areas that partially meet the principles Review areas that do not meet the principles Review areas that do not meet the principles Answer questions, but do not comment on accreditation status Answer questions, but do not comment on accreditation status Make suggestions for how the program can remedy deficient areas Make suggestions for how the program can remedy deficient areas Encourage the campus coordinator to talk to COSMA Encourage the campus coordinator to talk to COSMA Exit Interview

History of institution, program, degrees, special considerations, thank yous. History of institution, program, degrees, special considerations, thank yous. Use checklist to help you write and the report template Use checklist to help you write and the report template Summary statement: what is your overall impression of the program in this area/principle? Summary statement: what is your overall impression of the program in this area/principle? Strengths: What does the program do well? Strengths: What does the program do well? Areas of partial compliance: In what ways does the program not meet the principle? Areas of partial compliance: In what ways does the program not meet the principle? Link principles together, as they are related Link principles together, as they are related Site Visit Report: Putting Your Findings in Writing

Do’s and Don’t’s DoDon’t Validate the self studyExpress opinions Provide examples to illustrate your point “Champion” an issue Call Heather when in doubt “Guess” at answers Use tact and diplomacy in exit interview Indicate whether the institution will be accredited or not

Team chair submits final report within TWO WEEKS Team chair submits final report within TWO WEEKS Submit expenses not directly covered by program to COSMA Submit expenses not directly covered by program to COSMA Keep all notes and materials until BOC meets and makes an accreditation decision – may be questions Keep all notes and materials until BOC meets and makes an accreditation decision – may be questions Maintain confidentiality: Do not share your findings, materials, or opinions about the program or the site visit process with anyone Maintain confidentiality: Do not share your findings, materials, or opinions about the program or the site visit process with anyone Submit evaluation of the site visit process and of your team member Submit evaluation of the site visit process and of your team member Your Role After the Site Visit

Evaluation of the Site Team’s Visit Fill out and submit evaluation of your experience Fill out and submit evaluation of your experience Site team members evaluate each other Site team members evaluate each other All comments kept confidential All comments kept confidential Questions include: Questions include: Professional behavior of the team Professional behavior of the team Anything overlooked by the team Anything overlooked by the team Strengths and/or limitations of any team member Strengths and/or limitations of any team member

What COSMA Does After the Site Visit Institution receives letter summarizing visit Institution receives letter summarizing visit  May include request for additional information All materials sent to one member of Board of Commissioners – self-study, site visit team report, any additional information All materials sent to one member of Board of Commissioners – self-study, site visit team report, any additional information Commissioner reviews materials and prepares detailed report to present at next Board meeting Commissioner reviews materials and prepares detailed report to present at next Board meeting

Accreditation Decision Accredited with Notes Accredited with Notes Accredited with Observations Accredited with Observations Accreditation Deferred Accreditation Deferred Accreditation Denied Accreditation Denied

Conclusions In today’s training you learned about: The COSMA accreditation process The COSMA accreditation process How site visit teams are chosen and how site visits are coordinated How site visit teams are chosen and how site visits are coordinated The expectations, responsibilities, and roles of the two members of the site visit team The expectations, responsibilities, and roles of the two members of the site visit team How to interpret each Principle of accreditation How to interpret each Principle of accreditation How to conduct the exit interview How to conduct the exit interview What to write in your final report What to write in your final report The final steps in the accreditation process The final steps in the accreditation process The role of the Executive Director and the Board of Commissioners The role of the Executive Director and the Board of Commissioners

Upcoming Training/Events Accreditation Process National Convention – date TBD Accreditation Process National Convention – date TBD Management Day (4/24) Management Day (4/24) Site Reviewer Training by Webinar – date TBD Site Reviewer Training by Webinar – date TBD Fourth Annual Member Meeting Austin, TX (5/29 – lunchtime) Fourth Annual Member Meeting Austin, TX (5/29 – lunchtime)

Questions & Comments