Presentation is loading. Please wait.

Presentation is loading. Please wait.

Teaching Basic Skills Mathematics: Outcome Assessment Jenny Kimm, Associate Professor, City College Presented at the: 2009 Strengthening Student Success.

Published byAshley Shields Modified over 9 years ago

Similar presentations

Presentation on theme: "Teaching Basic Skills Mathematics: Outcome Assessment Jenny Kimm, Associate Professor, City College Presented at the: 2009 Strengthening Student Success."— Presentation transcript:

1 Teaching Basic Skills Mathematics: Outcome Assessment Jenny Kimm, Associate Professor, City College Presented at the: 2009 Strengthening Student Success Conference San Francisco, CA: October 7, 2008 Xi Zhang, Campus Based Researcher, City College San Diego Community College District

2 I NTRODUCTION OF THE D ISTRICT San Diego Community College District 2 nd largest district in the state Three 2-year colleges and eleven Continuing Education campuses Serves approx. 100,000 students each semester

3 I NTRODUCTION OF THE S AN D IEGO C ITY C OLLEGE San Diego City College is the first established community college in San Diego. San Diego City College is a public, two-year community college administered by the San Diego Community College District. Serving as the educational cornerstone of downtown San Diego, the college offers more than 100 majors, 100 certificate programs and 1,500 classes each semester to 16,000 students.

4 P URPOSE OF THE P RESENTATION The primary purpose of this presentation is to share the research methodology and innovative techniques for data analysis and instrument refinement for SLO assessment rather than to disseminate results of the study. A second purpose is to support the teaching of Basic Skills Math in community colleges.

5 P URPOSE OF THE S TUDY Demonstrate SLO assessment cycle in the Math Department at San Diego City College Draw attention to measurement issues in assessing SLOs. Demonstrate methods of item analysis that has multiple advantages.

6 R ESEARCH D ESIGN SLO assessment cycle A repeated measure design: pre and post design

7 SLO A SSESSMENT IN THE M ATH D EPARTMENT City College Student Learning Outcomes Assessment Cycle 6 Column Form For Developmental Math Program- Math 35, 95, 96 Year: 2008/2009

8 R ESEARCH M ETHODOLOGY Rasch Model Estimate both item difficulty and person ability Map both parameters on the same scale Inform instrument refinement Paired Sample t-test Statistically significant improvement from pretest to posttest

9 T ARGET P OPULATION AND S AMPLE S IZE Developmental math courses: Pre-Algebra, Beginning Algebra, and Intermediate Algebra. This totals to over 1000 students taking the developmental math courses In Fall 2008, we collected pre/post paired data from about 250 students

10 D ATA C OLLECTION : I NSTRUMENT Developed one pre test and a similar post test TestGen testbank software 8 multiple choice questions Topics of the questions A Sample Instrument

11 D ATA C OLLECTION : T EST A DMINISTRATION Pre-test administration Pre-test grading Post-test administration Post-test grading

12 D ATA M ANAGEMENT For each student, itemized response per question and a total score were entered and paired in Excel Data then were exported to Winsteps for model fitting Estimates of item difficulty and student ability were analyzed in SPSS to compare pre test results to the post.

13 D ATA A NALYSIS Fit itemized responses rather than the total scores with the Rasch Model to obtain estimates of item difficulty and student ability.

14 D ATA A NALYSIS Map both item difficulties and person abilities on the same scale to produce the Item-Person Map. Compare Pre test and Post test Paired sample t-test Anchoring item difficulties

15 M EASURES Item difficulty Student ability

16 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Pre-test Item difficulty Student ability

17 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Pre-test Person-item map

18 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Post-test Item difficulty Student ability

19 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Post-test Person-item map

20 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Pre and post comparison Anchoring item difficulties to produce a new set of student ability estimates

21 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Pre and post comparison Anchoring item difficulties to produce a new set of student ability estimates

22 R ESULTS (P RE - ALGEBRA FALL 2008 DATA) Pre and post comparison Paired sample t test

23 F INDINGS Results revealed that students scored statistically significantly higher in the post test compared to their performance in the pretest. Content areas that the instructors need to emphasize for teaching. Information for instrument refinement.

24 INSTRUMENT REFINEMENT

25 U SE OF R ESULTS FOR P ROGRAMMATIC I MPROVEMENT Imbed the post test into the final exam to increase sample size. Also provide online version of pre test to collect data from online developmental classes. Rewrite or revise test questions based on results of item analysis. Identify difficult topics and disseminate the information to developmental math instructors for future teaching. Also disseminate the information to instructors of higher level math course for their preparation and planning.

26 D ISCUSSION Advantages of item analysis Solve measurement issues Conduct meaningful comparisons Bank good test items for constructing future tests Diagnostic function provides insight of the strength and weakness of student content knowledge.

27 L IMITATIONS OF THE R ESEARCH Small sample size Small number of test items Item stability Generalizability of the results

28 Q UESTIONS ?

Download ppt "Teaching Basic Skills Mathematics: Outcome Assessment Jenny Kimm, Associate Professor, City College Presented at the: 2009 Strengthening Student Success."

Similar presentations

Outcomes Assessment- Full Implementation Meeting Fall 2009.

Outcomes Assessment- Full Implementation Meeting Fall 2009.
Pre and Post Assessments A quick and easy way to assess your Student Learning Outcomes.

Pre and Post Assessments A quick and easy way to assess your Student Learning Outcomes.
And Integrating and Assessing Student Learning Outcomes AMATYC Anaheim, California October/November 2013 Dr. Kim Tsai Granger St. Louis CC.

And Integrating and Assessing Student Learning Outcomes AMATYC Anaheim, California October/November 2013 Dr. Kim Tsai Granger St. Louis CC.
Schreyer Institute for Teaching Excellence.  Nursing students are showing difficulty passing a 20 question test encompassing basic math skills.  In.

Schreyer Institute for Teaching Excellence.  Nursing students are showing difficulty passing a 20 question test encompassing basic math skills.  In.
Benchmark Assessment Item Bank Test Chairpersons Orientation Meeting October 8, 2007 Miami-Dade County Public Schools Best Practices When Constructing.

Benchmark Assessment Item Bank Test Chairpersons Orientation Meeting October 8, 2007 Miami-Dade County Public Schools Best Practices When Constructing.
MSP Program Evaluation

MSP Program Evaluation
Greenville Technical College Assessing and Developing Student Computing Technology Skills September 19, 2012 Dr. Lenna Young, Mark Krawczyk, and Mary Locke.

Greenville Technical College Assessing and Developing Student Computing Technology Skills September 19, 2012 Dr. Lenna Young, Mark Krawczyk, and Mary Locke.
ESTEEMS (ESTablishing Excellence in Education of Mathematics and Science) Project Overview and Evaluation Dr. Deborah H. Cook, Director, NJ SSI MSP Regional.

ESTEEMS (ESTablishing Excellence in Education of Mathematics and Science) Project Overview and Evaluation Dr. Deborah H. Cook, Director, NJ SSI MSP Regional.
Making Your Assessments More Meaningful Flex Day 2015.

Making Your Assessments More Meaningful Flex Day 2015.
Washington State E VALUATION D ATA C OLLECTION 1.

Washington State E VALUATION D ATA C OLLECTION 1.
Analysis of Institutional Data of the Assessment of SLOs October 27, 2009.

Analysis of Institutional Data of the Assessment of SLOs October 27, 2009.
Preparing Elementary Teacher Candidates for the edTPA Prior to Student Teaching: Documenting Experiences in a Math Methods Course Dr. Erica Kwiatkowski-Egizio.

Preparing Elementary Teacher Candidates for the edTPA Prior to Student Teaching: Documenting Experiences in a Math Methods Course Dr. Erica Kwiatkowski-Egizio.
DYNAMIC PROFESSIONAL DEVELOPMENT: Strategies to Guide and Assess Teacher Growth Jane Gawronski, Nadine Bezuk, and Steve Klass National Council of Teachers.

DYNAMIC PROFESSIONAL DEVELOPMENT: Strategies to Guide and Assess Teacher Growth Jane Gawronski, Nadine Bezuk, and Steve Klass National Council of Teachers.
Ada Emmett and Judith Emde University of Kansas Libraries Assessing Chemical Information Literacy Skills using the ACRL Standards ALA 2006 Annual Meeting,

Ada Emmett and Judith Emde University of Kansas Libraries Assessing Chemical Information Literacy Skills using the ACRL Standards ALA 2006 Annual Meeting,
The State of the State TOTOM Conference September 10, 2010 Jim Leigh Office of Assessment and Information Services Oregon Department of Education.

The State of the State TOTOM Conference September 10, 2010 Jim Leigh Office of Assessment and Information Services Oregon Department of Education.
V v Adaptive Quizzing Associated with an Increase in Overall Learning Keiko Bostwick, Kathryn Becker-Blease, PhD Oregon State University School of Psychological.

V v Adaptive Quizzing Associated with an Increase in Overall Learning Keiko Bostwick, Kathryn Becker-Blease, PhD Oregon State University School of Psychological.
Techniques for Improving Student Learning Outcomes Lynn M. Forsythe Ida M. Jones Deborah J. Kemp Craig School of Business California State University,

Techniques for Improving Student Learning Outcomes Lynn M. Forsythe Ida M. Jones Deborah J. Kemp Craig School of Business California State University,
Mission... to provide state of the art educational opportunities for all students in a safe, healthy and effective learning environment through a collaborative.

Mission... to provide state of the art educational opportunities for all students in a safe, healthy and effective learning environment through a collaborative.
Understanding our First Years Two studies and a comparison.

Understanding our First Years Two studies and a comparison.
 8 years teaching English at SMSU  7 ½ years mentoring high school CEP teachers  Professional awareness of disconnect in high school and college standards.

 8 years teaching English at SMSU  7 ½ years mentoring high school CEP teachers  Professional awareness of disconnect in high school and college standards.

Similar presentations

Ads by Google