Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials? Alex Edgcomb, Joshua Yuen, and Frank Vahid University of.

Slides:



Advertisements
Similar presentations
1 Fast Configurable-Cache Tuning with a Unified Second-Level Cache Ann Gordon-Ross and Frank Vahid* Department of Computer Science and Engineering University.
Advertisements

Digitally-Bypassed Transducers: Interfacing Digital Mockups to Real-Time Medical Equipment Scott Sirowy*, Tony Givargis and Frank Vahid* This work was.
Feature Extractors for Integration of Cameras and Sensors during End-User Programming of Assistive Monitoring Systems Alex Edgcomb Frank Vahid University.
CSE 490/590, Spring 2011 CSE 490/590 Computer Architecture Snoopy Caches I Steve Ko Computer Sciences and Engineering University at Buffalo.
1 A Self-Tuning Cache Architecture for Embedded Systems Chuanjun Zhang*, Frank Vahid**, and Roman Lysecky *Dept. of Electrical Engineering Dept. of Computer.
Automated Fall Detection on Privacy-Enhanced Video Alex Edgcomb Frank Vahid University of California, Riverside Department of Computer Science Copyright.
Welcome to CPCS 214 Computer Organization & Architecture Fall 2011 Muhammad Al-Hashimi Media clips are from the MS Office clip art collection copyright.
CMPT 300: Operating Systems I Dr. Mohamed Hefeeda
Chuanjun Zhang, UC Riverside 1 Low Static-Power Frequent-Value Data Caches Chuanjun Zhang*, Jun Yang, and Frank Vahid** *Dept. of Electrical Engineering.
Instruction-based System-level Power Evaluation of System-on-a-chip Peripheral Cores Tony Givargis, Frank Vahid* Dept. of Computer Science & Engineering.
Dynamic Loop Caching Meets Preloaded Loop Caching – A Hybrid Approach Ann Gordon-Ross and Frank Vahid* Department of Computer Science and Engineering University.
Introduction to C++ Programming CS 117 Section 2 and KNET Sections Spring 2001 MWF 1:40-2:30.
A One-Shot Configurable- Cache Tuner for Improved Energy and Performance Ann Gordon-Ross 1, Pablo Viana 2, Frank Vahid 1, Walid Najjar 1, and Edna Barros.
A “Java Fun For Everyone” Interactive Quiz
Introduction to Computing By Engr. Bilal Ahmad. Aim of the Lecture  In this Lecture the focus will be on Technology, we will be discussing some specifications.
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 3: Operating Systems Computer Science: An Overview Tenth Edition.
Lecture # 1 M.Sc / BS(CS)/ BS(I.T) DPT www. Shahid Rasul.com.
Welcome to CPCS 214 Computer Organization & Architecture Spring 2008 Muhammad Al-Hashimi Media clips are from the MS Office clip art collection copyright.
1 Web Database Processing. Web Database Applications Static Report Publishing a report is prepared from a database application and exported to HTML DB.
Zyante’s zyBooks: Animated Interactive Learning
Effectiveness of Interactive Web-Native Content vs. Online Textbooks Alex Edgcomb and Frank Vahid Dept. of Computer Science and Engineering University.
5 Chapter Five Web Servers. 5 Chapter Objectives Learn about the Microsoft Personal Web Server Software Learn how to improve Web site performance Learn.
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 3: Operating Systems Computer Science: An Overview Tenth Edition.
Student Performance Improvement using Interactive Textbooks: A Three-University Cross-Semester Analysis Alex Edgcomb*, Frank Vahid*, Roman Lysecky°, Andre.
Computers Operating System Essentials. Operating Systems PROGRAM HARDWARE OPERATING SYSTEM.
CS211 - Fernandez - 1 CS211 Graduate Computer Architecture Network 3: Clusters, Examples.
Students Learn More with Less Text that Covers the Same Core Topics Frank Vahid 1,3, Alex Edgcomb 1,3, and Roman Lysecky 2,3 1 Dept. of Computer Science.
Simplify! 1 Frank Vahid Prof. of CS&E, Univ. of California, Riverside Alex Edgcomb Research Specialist, Univ. of California, Riverside Both also with zyBooks.com.
Internet Applications (Cont’d) Basic Internet Applications – World Wide Web (WWW) Browser Architecture Static Documents Dynamic Documents Active Documents.
CS 2200 Presentation 18b MUTEX. Questions? Our Road Map Processor Networking Parallel Systems I/O Subsystem Memory Hierarchy.
Logical & Physical Address Nihal Güngör. Logical Address In simplest terms, an address generated by the CPU is known as a logical address. Logical addresses.
A computer contains two major sets of tools, software and hardware. Software is generally divided into Systems software and Applications software. Systems.
Scott Sirowy, Chen Huang, and Frank Vahid † Department of Computer Science and Engineering University of California, Riverside {ssirowy,chuang,
Harnessing P2P Power in the Classroom Julita Vassileva Department of Computer Science University of Saskatchewan, Canada.
1Jun. 20, 2016 © 2016 Alex Edgcomb / Frank Vahid – UCR / zyBooks Simplifying a Course to Reduce Student Stress so Students Can Focus Again on Learning.
Computer Organization & Design 计算机组成与设计
Table General Guidelines for Better System Performance
WWW and HTTP King Fahd University of Petroleum & Minerals
OCR GCSE Computer Science Teaching and Learning Resources
CS6401- OPERATING SYSTEMS L T P C
Ramya Kandasamy CS 147 Section 3
UNIT I OVERVIEW & INSTRUCTIONS
Techniques for Reducing Read Latency of Core Bus Wrappers
COSC 3406: Computer Organization
Computer Architecture 2
Data Representation – Instructions
Lecture # 1 M.Sc / BS(CS)/ BS(I.T) DPT.
Introduction CMSC 104 Problem Solving and Computer Programming
FLIPPED CLASSROOM ACTIVITY CONSTRUCTOR – USING EXISTING CONTENT
Foundations of Computer Science
­­­Python Versus C++: An Analysis of Student Struggle on Small Coding Exercises in Introductory Programming Courses Nabeel Alzahrani1, Frank Vahid1,3,
فصل نهم از کتاب طراحی آموزشی تألیف :آر.ام گانیه
C Programming APP3o.
Discovering Computers 2014: Chapter6
CS 456 Interactive Software.
Table General Guidelines for Better System Performance
ECEN “Internet Protocols and Modeling”
An Analysis of Using Many Small Programs in CS1
by Joe Michael Allen, Frank Vahid, Kelly Downey, and Alex Edgcomb
Problem Solving and Computer Programming
Copyright © 2013 Elsevier Inc. All rights reserved.
CS122B: Projects in Databases and Web Applications Spring 2018
An Analysis of Using Many Small Programs in CS1
by Joe Michael Allen, Frank Vahid, Kelly Downey, and Alex Edgcomb
CS122B: Projects in Databases and Web Applications Winter 2018
Introduction CMSC 104 Problem Solving and Computer Programming
Introduction CMSC 104 Problem Solving and Computer Programming
Nabeel Alzahrani1, Frank Vahid1,2, Alex Edgcomb1,2
Coral: An Ultra Simple Language for Learning to Program
Virtual Memory Hakim Weatherspoon CS 3410 Computer Science
Presentation transcript:

Does Student Crowdsourcing of Practice Questions and Animations Lead to Good Quality Materials? Alex Edgcomb, Joshua Yuen, and Frank Vahid University of California, Riverside Dept. of Engineering and Computer Science Also with zybooks.com Copyright © 2015 Alex Edgcomb, UC Riverside. 1 of 13

Crowdsourcing interactive material 2 of 13 Web: Enables - But static + Interactive more powerful Wikipedia.org Copyright © 2015 Alex Edgcomb, UC Riverside.

Memory architecture: Text A disk can store many programs. Memory can store fewer programs than a disk. Cache (located on the processor) can store even fewer. A disk connects to memory, and memory connects to the cache on a processor. For example, if the user runs a program ProgA, then ProgA is copied from the disk to memory, from memory to cache, then ProgA is executed. If the user then runs ProgB, then ProgB is copied from the disk to memory, from memory to cache, then executed. If the user then runs ProgA again, then ProgA is copied from memory to cache, then executed. 3 of 13 Not ideal Copyright © 2015 Alex Edgcomb, UC Riverside.

Memory architecture: Figure (a) (b)(c) (a)User runs ProgA. ProgA is copied from Disk to Memory to Cache, then executed. (b)User runs ProgB. ProgB is copied from Disk to Memory to Cache, then executed. (c)User runs ProgA again. ProgA is copied from Memory to Cache, then executed. 4 of 13 Better, but not ideal Copyright © 2015 Alex Edgcomb, UC Riverside.

Memory architecture: Animation 5 of 13 Copyright © 2015 Alex Edgcomb, UC Riverside.

Crowdsource animations? Can students: – Create? Rate? Study – 587 CS0 students, 3 groups: 1.Creators 2.Raters 3.Raters of top-19 + professional 6 of 13 Copyright © 2015 Alex Edgcomb, UC Riverside.

Some create good animations 7 of 13 Copyright © 2015 Alex Edgcomb, UC Riverside.

Some students can reliably rate animations 8 of 13 r-value = 0.74 p-value = Copyright © 2015 Alex Edgcomb, UC Riverside. Student ratings Professor rating

Learning questions 9 of 13 Copyright © 2015 Alex Edgcomb, UC Riverside.

Crowdsource learning questions? Can students: – Create? Rate? Study – 25 upper-div students in embedded systems course. Each: Created 6 questions Rated 7 professor & 7 student questions 10 of 13 Copyright © 2015 Alex Edgcomb, UC Riverside.

Students did not create good questions Prof-rated 1 out of 5. Conceptually confused Wording not precise Explanation wrong 11 of 13 Prof-rated 1 out of 5 Conceptually confused Usage of “must” leads to wrong meaning Answers not mutually exclusive Copyright © 2015 Alex Edgcomb, UC Riverside.

Some students can reliably rate learning questions r-value = 0.46 p-value = of 13 Copyright © 2015 Alex Edgcomb, UC Riverside. Student ratings Professor rating

Conclusion Web: New publishing – Enables crowdsourcing – Real power – Interactivity Students could – Reliably rate animations / questions – Create good animations – Not create good questions Crowdsourcing interactive content promising – Future: Instructors 13 of 13 Gratefully acknowledge NSF: SBIR / Copyright © 2015 Alex Edgcomb, UC Riverside.