FALL 2015 QLP TA Training Workshop

AGENDA (Morning) 9:00 – 9:10Introduction to QLPTeam 9:10 – 9:20Student Learning Outcomes (SLOs)Kim Massaro 9:20 – 9:30 Data Collection Overview & Parscore Tutorial Kimberly Ward 9:30 – 9:40 Data Entry and Submission (QLCDS-upper division only) Kim Massaro 9:40 – 9:50Tips for TA/Graders and ResourcesKimberly Ward 9:50 – 10:00Tips for Grading WritingGail Pizzola

AGENDA (Afternoon) 1:00 – 1:10Introduction to QLPTeam 1:10 – 1:20Student Learning Outcomes (SLOs)Kim Massaro 1:20 – 1:30 Data Collection Overview & Parscore Tutorial Kimberly Ward 1:30 – 1:40 Data Entry and Submission (QLCDS-upper division only) Kim Massaro 1:40 – 1:50Tips for TA/Graders and ResourcesKimberly Ward 1:50 – 2:00Tips for Grading WritingGail Pizzola

What is the QLP? The Quantitative Literacy Program is part of UTSA’s Quality Enhancement Plan to address the critical need for quantitative skills in students by enhancing core curriculum of select courses. The goal is to teach students to think critically when solving problems that involve observing and interpreting data.

Quantitative Literacy Program (QLP) Program Goals Develop quantitative skills in undergraduate students Implement effective teaching pedagogies and assessments to support the development of an exemplary quantitative scholarship program at the undergraduate level Provide the organizational framework and resources for an institutional transformation to graduate a quantitatively informed citizenry

Q-Course Current Course QLP Q-Course Learn Quantitative Skills Think critically Interpret and use data that naturally exist in the subject area Make informed decisions Makes the course more engaging Data + Q. Methods + Redesign

In regular (non-Q) courses, information and data are presented to students in a lecture format and discussed. In a Q-course, students generate and analyze real-world data sets appropriate for the subject. Example: Physical Anthropology students visited the San Antonio Zoo to collect data on primate activities and created charts and graphs for study How are Q-courses different from regular courses?

Why is it important? Get More Out of Courses QLP courses help students 1. Acquire basic quantitative literacy and numeracy skills 2. Effectively communicate the results of their quantitative analysis 3. Acquire discipline-specific advanced quantitative skills By incorporating data analysis into existing classes, students will see how informed decisions can be made in the context of their discipline. These skills are useful in everyday life.

QLP Growth Year One ( ) Year Four ( ) 20 faculty100 faculty 10 Q-Courses27 Q-Courses 113 Sections556 Sections 6,845 enrollments26,599 enrollments

Q-course List ANT 2033 ANT 2043 ARC 4183 ARC 4283 BIO 1233 BIO 1404 COM 3073 CRJ 3013 ECO 2003 ECO 2013 ECO 2023 ENG 2413 ES 2013 HIS 2123 HIS 2133 KIN 3323 MAT 1043 MDS 4983 PHI 1043 POL 1013 POL 1113 SOC 1013 SOC 3323 SPE 3603 STA 1053 WRC 1013 WRC Q-courses 19 core, 8 upper division

LEARNING TO EVALUATE QLP Student Learning Outcomes

EXPLORE Students will demonstrate the ability to explore data to define problems and identify solutions in a variety of real-world contexts.

VISUALIZE Students will demonstrate the ability to visualize data through converting information into different graphical and tabular forms.

ASSIMILATE & ASSESS Students will demonstrate the ability to assimilate and assess information from different sources, multiple representations of data, different methodologies, and different studies.

LOGIC Students will demonstrate the ability to use logic in computing and interpreting probabilities, evaluating risks, and understanding the idea of uncertainty.

UNDERSTAND Students will demonstrate the ability to understand units of measurement and scale, and the limitations of the quantitative analysis of data.

ANALYZE Students will demonstrate the ability to analyze data using different quantitative methods and draw appropriate conclusions.

TRANSLATE Students will demonstrate the ability to translate quantitative language into verbal assumptions and vice versa.

EXPRESS Students will demonstrate the ability to express quantitative evidence effectively in oral or written communication.

Taxonomies

PRE-TEST ASSIGNMENT(S) POST-TEST Data Collection Overview

Different Courses—Different Processes Depending on the course, the data collected will differ. Core courses still give and grade Q-assignments, but no longer need to upload data to QLCDS website Core Courses (1000 or 2000 level)Upper-Division (3000 or 4000 level) Pre/post-test including one short written question (SLO: Express) Pre/post-test including one short written question (SLO: Express). Q-Assignment data not collected/submitted to the QLP One common Q-assignment that covers four or more SLOs, including Translate and Express

PRE/POST-TEST How to grade Parscore

Parscore Process 1. Faculty register for Parscore for their Q-course sections at the beginning of every new semester. 2. The students fill out the Parscore forms for pre/post-test. 3. The faculty/grader grades the Express piece for student. 4. The grader puts the Express score on student’s Parscore form 5. Faculty/Grader create a Parscore “key” and drop off forms to Parscore office, indicating it is a Q-course and give permission for Testing Services to send student results to the QLP.

Parscore Types Parscore Form #F PAR-L (small one) ParScore Form #F-1712-ERI (large one) Or

How to Grade Express Piece (large form) Write the score that the student received in the far right column of the SUBJ SCORE box. Bubble in the score that the student received for the Express piece in the same column. 5

How to Grade Express Piece (small form) Write the score that the student received in the far right column of the EXAM # box. Bubble in the score that the student received for the Express piece in the same column.

How to create a ParScore Key Bubble in the correct answers into the multiple choice questions Write and bubble in the maximum number of points student could receive on the Express question in Express box Write Instructor’s Name, Course ID, Section #, “Pre-test” (or “Post-test”), and “KEY.” Or George Washington HIS Pre-test KEY 08/28/2015 MWF 8-8:50 George Washington HIS Pre-test KEY 08/28/2015 MWF 8-8:50 5 5

COLLECTING ASSESSMENT DATA

BEST PRACTICES

TA/Grader Resources Resources Available: Your faculty should be your first resource for questions related to the Q-course.  Blackboard Learn Gradebook permissions  Parscore  Rubrics/grading materials You and the faculty member can contact the QLP Team for questions related  QLCDS Data entry/submission For those using Blackboard Learn, there are helpful tutorials available online for use (

TIPS FOR GRADING WRITING

Any Questions?