Faculty of Technology Computing and Information Systems Automated System for the Assessment of Programming Kingston University Dublin City University Karlsruhe University De Montfort University City University, London
Computing and Information Systems ASAP: Three Web Services Automated Java Marker Web Service – Core Service Automated Java Marker Web Service – Core Service RoboProf Question Generation Web Service RoboProf Question Generation Web Service JPlag Plagiarism Testing Web Service JPlag Plagiarism Testing Web Service
Computing and Information Systems Automated Java Marker Web Service Testing Components published in Jar file Testing Components published in Jar file Model Answer Model Answer JAnswerClass JAnswerClass Student Answer Student Answer AnswerClass AnswerClass Answers Compared by Test Harness Answers Compared by Test Harness TestAnswerClass TestAnswerClass Test Harness Test Harness extends TestAssessment extends TestAssessment
Computing and Information Systems RoboProf Question Generation Web Service Requires a Question Type, Seed, Output Format Requires a Question Type, Seed, Output Format Generates: Generates: Question Source Code Question Source Code Response Headings Response Headings Response Answers Response Answers Output Output QTIv2 or QTIv1 or HTML QTIv2 or QTIv1 or HTML
Computing and Information Systems JPlag Plagiarism Testing Service Requires: Requires: a zipped Submission (standardised directory structure) a zipped Submission (standardised directory structure) set of options and parameters set of options and parameters Generates: Generates: A zipped HTML pairwise-similarity comparison (plagiarism analysis) A zipped HTML pairwise-similarity comparison (plagiarism analysis) JPlag Web Start Client JPlag Web Start Client Currently a stand-alone client for accessing the web-service (hosted in Karlsruhe) Currently a stand-alone client for accessing the web-service (hosted in Karlsruhe)
Computing and Information Systems User Agents and Client Tools uPortal User Agent uPortal User Agent Open Source Open Source Developed for HE Community Developed for HE Community Supports Portlets (JSR-168) Supports Portlets (JSR-168) Portlet Client Tools Portlet Client Tools AJM Assessment Selector AJM Assessment Selector AJM Assessment Submitter AJM Assessment Submitter RoboProf Question Viewer + Requestor RoboProf Question Viewer + Requestor
Computing and Information Systems User Agents and Client Tools Blackboard User Agent VLE at Kingston and de Montfort VLE at Kingston and de Montfort AJM Server is separate AJM Server is separate Client Tools implemented as Blackboard Building Blocks Client Tools implemented as Blackboard Building Blocks Building Blocks developed as JSP pages Building Blocks developed as JSP pages Utilisation of Blackboard Facilities Utilisation of Blackboard Facilities Gradebook, Content Management etc. Gradebook, Content Management etc.
Computing and Information Systems Future Developments Improved Client Tools Improved Client Tools Assessment Management Assessment Management Content Management Content Management Automated Test Harness Generation Automated Test Harness Generation Improved Pedagogy Improved Pedagogy Structured and Adaptive Content Structured and Adaptive Content Testing for more sophisticated programming questions Testing for more sophisticated programming questions GUI, complex class design, error handling GUI, complex class design, error handling Integration with other services Integration with other services Authentication / Authorisation Services Authentication / Authorisation Services QTI Rendering and Authoring QTI Rendering and Authoring Gradebook and Marking Gradebook and Marking Learning Design / Simple Sequencing Learning Design / Simple Sequencing
Computing and Information Systems Demonstrator Project - JELFAD Kingston University Kingston University Strathclyde University (Niall Barr) Strathclyde University (Niall Barr) Relevant JISC Projects/Initiatives: Relevant JISC Projects/Initiatives: ASAP ASAP APIS / ASSIS APIS / ASSIS RQP RQP TOIA TOIA
Computing and Information Systems Demonstrator Project - JELFAD Integration of Assessment and Question Generating Engines (using QTI v2 Custom Operations and/or RQP) Integration of Assessment and Question Generating Engines (using QTI v2 Custom Operations and/or RQP) Integration of learning content using IMS-LD or IMS-SS APIs Integration of learning content using IMS-LD or IMS-SS APIs Development of portlets and web- content to integrate into the uPortal system (and Blackboard) Development of portlets and web- content to integrate into the uPortal system (and Blackboard)
Computing and Information Systems Demonstrator Project - JELFAD
Computing and Information Systems Demonstrator Project - JELFAD