Assessment Surveys July 22, 2004 Chancellor’s Meeting

Culture of Assessment Survey - Spring Culture of Assessment Survey - Spring –Professional staff and administration –Divisional ACT Faces of the Future Survey -Spring ACT Faces of the Future Survey -Spring –PCCUA college students PCCUA Graduate Survey – Spring PCCUA Graduate Survey – Spring –Graduating students High School Survey – Fall High School Survey – Fall –High school students in Phillips and Arkansas County’s Surveys 2003

Community Survey – Spring –P–P–P–Phillips and Arkansas County’s Advising Survey – Spring –P–P–P–PCCUA Advisors ACT Survey of Academic Advising - Spring –P–P–P–PCCUA College Students PCCUA Graduate Survey (revised) - Spring –G–G–G–Graduating Students Culture of Assessment Survey – Spring –P–P–P–Professional Staff and Administration Surveys 2004

Culture of Assessment Survey Spring 2003 & Spring 2004

Survey to determine perceptions regarding progress by College toward Assessment Survey to determine perceptions regarding progress by College toward Assessment Faculty, administrators, and professional staff completed survey Faculty, administrators, and professional staff completed survey –Institutional survey –spring 2003 & 2004 –Divisional survey – spring 2003

Used Dr. Cecelia Lopez’s characteristics of assessment as model Used Dr. Cecelia Lopez’s characteristics of assessment as model –Collective Values –Mission –Shared Faculty Responsibility –Shared Administrative Responsibility –Shared Student Responsibility –Institutional Support Resources –Efficacy Model included: planning, emerging and maturing levels Model included: planning, emerging and maturing levels Culture of Assessment Survey Spring 2003 & Spring 2004

Established a point of reference to measure progress of assessment implementation at PCCUA Established a point of reference to measure progress of assessment implementation at PCCUA Long range goal is to improve culture of assessment at the College Long range goal is to improve culture of assessment at the College Survey confirmed that students have not been involved with the assessment process Survey confirmed that students have not been involved with the assessment process Division survey demonstrated more progress initially within academic divisions than at institutional level Division survey demonstrated more progress initially within academic divisions than at institutional level

–Collective Values & Mission Commitment to students Commitment to students Commitment to excellence in education Commitment to excellence in education Contribution to community Contribution to community Commitment to Access Commitment to Access Commitment to faculty and staff Commitment to faculty and staff Quality campus life Quality campus life –Shared Faculty Responsibility Assessment has been faculty led Assessment has been faculty led –Shared Administrative Responsibility Deans and administrators have contributed to assessment efforts Deans and administrators have contributed to assessment efforts Culture of Assessment Survey Spring 2003 & Spring 2004

–Shared Student Responsibility Underutilize students in divisional and institutional assessment Underutilize students in divisional and institutional assessment –Institutional Support Resources Webpage Webpage Plan of assessment Plan of assessment –Efficacy Assess student learning evidenced by course design and improvements in teaching Assess student learning evidenced by course design and improvements in teaching Culture of Assessment Survey Spring 2003 & Spring 2004

How to use this data Continue assessment activities, professional development, and divisional and institutional planning Continue assessment activities, professional development, and divisional and institutional planning Increased mean score for each characteristic on survey indicates a measure of improvement of the culture of assessment Increased mean score for each characteristic on survey indicates a measure of improvement of the culture of assessment Assessment will continue to expand as it becomes an effective and integrated process used to improve student learning Assessment will continue to expand as it becomes an effective and integrated process used to improve student learning Based on outcome of survey it was decided to add students to the Assessment Committee Based on outcome of survey it was decided to add students to the Assessment Committee

ACT Faces of the Future

Annual, nationwide survey of community colleges (ACT/AACC) Annual, nationwide survey of community colleges (ACT/AACC) Identifies characteristics of students Identifies characteristics of students Assesses student’s attitudes of school programs, services, and environment Assesses student’s attitudes of school programs, services, and environment Identifies educational and career intentions of students Identifies educational and career intentions of students Compares PCCUA students to national user group Compares PCCUA students to national user group

ACT Faces of the Future Survey categories included questions related to: Survey categories included questions related to: –General background of student –Employment background of student –Educational background of student –Current college experience of student

ACT Faces of the Future Deans selected classes to survey Deans selected classes to survey Administered to 244 students across all campuses Administered to 244 students across all campuses Mean scores based on 5-1 Likert scale Mean scores based on 5-1 Likert scale ACT compiled data reports ACT compiled data reports Reports will be linked to Assessment web page with Survey Reports will be linked to Assessment web page with Survey

ACT Faces of the Future Student perceptions demonstrate PCCUA is committed and respect them Student perceptions demonstrate PCCUA is committed and respect them Students feel PCCUA provides quality service Students feel PCCUA provides quality service Students believe that PCCUA has commitment to access and availability Students believe that PCCUA has commitment to access and availability Students believe PCCUA reflects commitment to positive campus life Students believe PCCUA reflects commitment to positive campus life

How to use this data Provided student input for College’s self-study Provided student input for College’s self-study Opportunity to participate in this national survey annually each fall to assess student perceptions of College Opportunity to participate in this national survey annually each fall to assess student perceptions of College

Graduate Survey

–Administered each spring at graduation –Assessment Committee revised –Revisions correlate with college core competencies –Results are now maintained in Assessment Office

How to use this data Graduate data will be documented in the Assessment of Student Learning report annually Graduate data will be documented in the Assessment of Student Learning report annually Graduate Follow-Up Graduate Follow-Up Graduates perception of education received Graduates perception of education received Alumni Surveys created Alumni Surveys created

High School Survey

 Determine students plans for enrollment in higher education  Gain enrollment information for PCCUA  10 th and 11 th grades target group  Administered to 1,078 students  Five Schools- Phillips County (443)  Seven Schools – Arkansas County (635)

High School Survey Survey questions related to:  Enrollment  Technology  Availability of services offered  Areas of study  Future plans of students

High School Survey Availability of services was most significant area of response Availability of services was most significant area of response Students interested in enrolling at PCCUA if classes offered at their school during the day Students interested in enrolling at PCCUA if classes offered at their school during the day Would enroll in ACT/SAT test preparation if offered Would enroll in ACT/SAT test preparation if offered Areas of Study indicated by student based on interest (students chose more than one area) Areas of Study indicated by student based on interest (students chose more than one area) –Overall area of study responses = 2,062

Top Five Areas of Interest Nursing Nursing Business Management Business Management Medical Technology Medical Technology Cosmetology Cosmetology Welding Welding

High School Survey Students indicated they were interested in AA Transfer degree programs by taking courses at PCCUA through another college or university –Teachers, lawyers, pharmacy, business- any professional study requiring a baccalaureate degree

Recruitment Recruitment College preparation College preparation Secondary Center (to be created) Secondary Center (to be created) Course paths for new Charter School Course paths for new Charter School How to use this data

Information shared with marketing department Information shared with marketing department –Packets of material have been prepared for each student who completed survey –Packets include: fall schedule, brochures for area of interest, academic advisor list, application for enrollment, letter from college relations office, cost comparison list and college catalog (catalog-if requested). Information shared with each division Example: Graphic Communications – across both counties 68 students expressed an interest in this program.

Future Use of High School Survey Survey will continue to be utilized because of the wealth of information it provides Survey will continue to be utilized because of the wealth of information it provides Survey will rotate on a two-year cycle and will be administered again in Fall 2006 Survey will rotate on a two-year cycle and will be administered again in Fall 2006 Survey tool has now been developed into a web-based format and students will be able to access on-line (Anthony Cunningham developed web access) Survey tool has now been developed into a web-based format and students will be able to access on-line (Anthony Cunningham developed web access)

Community Survey

Survey to determine Arkansas and Phillips County communities’ perception of PCCUA Survey categories included: Marketing Marketing College Mission College Mission Community Perceptions Community Perceptions Institutional Services Institutional Services

Community Survey Type of Survey Type of Survey Conducted convenience sample at various locations in Phillips and Arkansas County’s Conducted convenience sample at various locations in Phillips and Arkansas County’s Used frequencies and percentages for reporting data – easier for people to understand Used frequencies and percentages for reporting data – easier for people to understand Surveyed 327 individuals Surveyed 327 individuals Overall report, the community has a positive perception of the college Overall report, the community has a positive perception of the college

How to use this data Needed feedback from constituents in the communities about perception of the college and last community survey was 15 years ago which only included Phillips County Needed feedback from constituents in the communities about perception of the college and last community survey was 15 years ago which only included Phillips County Contributes to future institutional planning Contributes to future institutional planning Survey provided data for the College’s self- study Survey provided data for the College’s self- study

Advising Survey

Survey completed by PCCUA advisors to evaluate current advising process Survey completed by PCCUA advisors to evaluate current advising process Initiative that began with Carl Perkins Project Initiative that began with Carl Perkins Project Surveyed advisors perceptions of current academic advising process and the effectiveness of the procedures Surveyed advisors perceptions of current academic advising process and the effectiveness of the procedures Survey ed to all 35 advisors –all campuses Survey ed to all 35 advisors –all campuses

Advising Survey Anonymous response from advisors Anonymous response from advisors Advisor response rate 57% Advisor response rate 57% 100% of advisors who responded stated willing to participate in advisor training 100% of advisors who responded stated willing to participate in advisor training 80% are willing to serve on an advisor task force to evaluate current advising system 80% are willing to serve on an advisor task force to evaluate current advising system

Advising Survey Advisors also responded to open-ended questions and provided suggestions Advisors also responded to open-ended questions and provided suggestions Consensus of group seems to indicate need for more effective training, more information, and better communication Consensus of group seems to indicate need for more effective training, more information, and better communication Need effective training for new advisors Need effective training for new advisors Advising system is effective to a degree but improvements can be made Advising system is effective to a degree but improvements can be made

How to use this data Develop advisor training beginning in the fall – conduct annually and as needed to update with new information/technology Develop advisor training beginning in the fall – conduct annually and as needed to update with new information/technology Create a task force – advisors indicated they want to participate Create a task force – advisors indicated they want to participate Develop annual evaluation process for advisors Develop annual evaluation process for advisors Advising and Retention Resources purchased and placed in Library and Professional Advisor’s offices at all campuses Advising and Retention Resources purchased and placed in Library and Professional Advisor’s offices at all campuses

How to use this data Utilize advising resources which include useful tips and training sessions that can be adapted Utilize advising resources which include useful tips and training sessions that can be adapted Survey comments indicated Advisor Training in spring 2004 at NACADA Advising Conference was useful and informative (15 individuals attended) Survey comments indicated Advisor Training in spring 2004 at NACADA Advising Conference was useful and informative (15 individuals attended) Continue to provide opportunities for advisors to attend Advising Conferences Continue to provide opportunities for advisors to attend Advising Conferences

ACT Survey of Academic Advising

Surveyed upper level students Surveyed upper level students Deans selected classes to administer survey Deans selected classes to administer survey Survey provides information of students’ impressions of institution’s academic advising services Survey provides information of students’ impressions of institution’s academic advising services

ACT Survey of Academic Advising Survey questions related to: Survey questions related to: –Advising information –Academic advising needs –Impression of advisor –Time spend with advisor

ACT Survey of Academic Advising Provided students opportunity to evaluate current advisor at PCCUA Provided students opportunity to evaluate current advisor at PCCUA ACT scores and returns report to PCCUA ACT scores and returns report to PCCUA 172 students responded to survey 172 students responded to survey

How to use this data Feedback from students regarding academic advising Feedback from students regarding academic advising Indicates student perceptions of strengths and weaknesses in advising Indicates student perceptions of strengths and weaknesses in advising Evaluation tool to assess academic advising Evaluation tool to assess academic advising Individual advisor reports provided to advisors Individual advisor reports provided to advisors Plan to continue the process of students evaluating advisors Plan to continue the process of students evaluating advisors

Assessment of Student Learning

AKA - “The Assessment Plan” AKA - “The Assessment Plan” Evolved into Assessment of Student Learning Process Evolved into Assessment of Student Learning Process Goals and Expected Outcomes of Student Learning Goals and Expected Outcomes of Student Learning

Assessment Web Page