1. CodeWrite : an Automated programming assessment tool
Presented By:-
Group:7
Soumya Rath, Karthik Sriram, Teophillus Suryahimsa, Qin Run

2. Motivation Learning to program is difficult?
novice programmers face a lot of problems.
Importance of immediate feedback and an interactive user interface for students.

3. issues we are working on:
The two main aspects of CodeWrite: Authoring and answering programming questions.
Focus on enhancement of the intuitiveness and the ease to use the above 2 aspects.

4. “How does the visual design of a website affect the user engagement?”
Research Question
“How does the visual design of a website affect the user engagement?”

5. Related work What makes a good user Interface:
Placement of various components and how easily they can be identified by all people alike.
Provide enriched user experience along with the process of interacting in terms of usability.
The efficiency and ease to achieve a given task through User Interaction.
What makes a good user Interface:

6. Related work.. Contd..
What did we take away from the various tools already present :
CourseMarker, enhancement of Ceilidh(1988).
eGrader(A grading system for java based course).
Static and dynamic analysis of code.
Output comparison vs script based.
Various feedback methods:

7. Technologies used

8. Design

9. User study plan Factors:
Efficiency – 2 tasks per user and measuring completion time
System Usability Scale (SUS) questionnaire
Factors:

10. Tasks to be performed
Home page > Log in > … > Authoring a question > Log out
Home page > Log in > … > Answering a question > Log out

11. SUS questionnaire Examples: 10 questions
I think that I would like to use this system frequently
I found the system unnecessarily complex.
I thought the system was easy to use.
Examples:

12. Scoring SUS questionnaire
1, 3, 5, 7 and 9 the score contribution is the scale position minus 1.
For items 2,4,6,8 and 10, the contribution is 5 minus the scale position.
Multiply the sum of the scores by 2.5 to obtain the overall value of the study. SUS scores have a score range from 0 to 100.

13. USER study
SUS – System usability scale questionnaire, 5 point scale, from strongly disagree to strongly agree
Why?
Observational study with 20 participants which consists of 10 from tech. background and 10 from other faculty
- Measure efficiency by timing
Questionnaire hosted on

14. Threat to validity Misunderstandings – using script to perform study
Order bias - Use randomisation of order solve
Confounding variable – going to test using the same screen size

15. Script

16. Evaluation
Performing a statistical analysis based on the tasks completed and time taken.
Analysis based on the responses from the questionnaire.

17. Reference
[1] Fatima AlShamsi and Ashraf Elnagar. [n. d.]. An automated assessment and reporting tool for introductory Java programs. nnovations in Information Technology(IIT), 2011 International Conference ([n. d.]).
[2] D. RadoÅąeviÄĞ* Bernik* and G. BubaÅą* Introducing Gamification into e-Learning University Courses. Digital Libraries 12, 3, Article 5 (May 2017). To appear.
[3] PAVLOS SYMEONIDIS ATHANASIOS TSINTSIFAS COLIN A. HIGGINS, GEOFFREYGRAY Automated Assessment and Experiences of Teaching Programming. Journal on Educational Resources in Computing (JERIC): Volume 5 Issue 3, September (2005).
[4] Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4-7.

18. Thank You