1. ASAP Automated System for the Assessment of Programming

2. Project Motivation address the issues of teaching a technically demanding subject with discipline-specific requirements including –Increasing class sizes –Widening participation –Evolving content

3. ASAP objectives Publish appropriate standards for unit tests in educational sector Publish tools for authoring and using unit tests Looking at working closely with JPlag (Plagiarism Detection) and RoboProf (Question Generation) from project partners

4. Design Service based architecture – the JISC e- learning framework Standards – XML, WSDL, XML, SOAP Technologies and Tools – J2EE, Apache Axis, CVS User Agents – Blackboard, WebCT

5. Automated Assessment Service Instructor creates (or edits) test documents in the unit test repository (1,2) Student accesses document and attempts assignment (formative or summative) Solution is submitted (4) and evaluated using the assessment service [private unit tests] (5) The result communicated to the student (6) and the database of student marks (7) Instructors view details of assessments (8)

6. Use Case

7. Associated Services Partners providing complimentary services JPlag –Provides Plagiarism testing on submitted code Roboprof (Dublin) –Provides Objective Assessment

8. User Agents Generic Web Portal –Initial interface to ASAP –Evolving from a test environment Blackboard v6 (Kingston / de Montfort) Web-CT v2 (City University)

9. TAPAS First stage of project Prototype system Currently being tested for Java Programming Assessment at Kingston University 1st Gen. Self-serve 2nd Gen. Asses. Server 3rd Gen - WSDL 4th Gen - eLF?

10. TAPAS Precursor to ASAP Internally funded Assessment Server –Provides unit testing to assess Java program code Blackboard Building Block –VLE ‘User Agent’ –Communicates with assessment server –Instructor: uploads testing code and assignment –Learner: Downloads assignment –Uploads source code –Assessment server compiles and tests –Gives feedback and uploads results to Blackboard gradebook

11. Blackboard Interface

12. Automated Java Marker Server

13. Feedback from service