1. Composing Lifelong Learning Opportunity Pathways through Standards-based Services
Raquel M. Crespo García

2. Contents Introduction and motivation Learning pathways Design process
COMPASS outcomes
Information model
Online services
MOOCs
Pilot testing
Discussion, feedback and comments

3. Pilot testing

4. Activities Three activities related to testing
Activity O3A1 “Development of Pilot Testing methodology and evaluation plan”
Concluded and deliverable issued
Activity O3A3 “Internal evaluation of the online services”
Activity O3A4 “Public evaluation of the online services”
Undergoing

5. Validation methodology
Usability testing
Security testing
Compatibility testing
Responsiveness testing
Accessibility testing
Upgradability testing …

6. Validation methodology
The only one of interest for COMPASS
Other methodologies will be covered in future related projects
Usability testing
Security testing
Compatibility testing
Responsiveness testing
Accessibility testing
Upgradability testing …

7. Validation – Usability testing
The core of usability is clarity
A clear and usable design can be achieved through: learnability, simplicity, familiarity, consistency, guidance of users, direct feedback, good information architecture

8. Validation – Usability testing
If we distract or confuse users, they will either need more time to find what they came for, or they might forget their initial goal
They will not experience our services as user- friendly and chances are that they leave dissatisfied and with no intention of coming back

9. Validation – Usability testing
Our services and their interfaces should not require instructions, or even a long process of trial and error to figure them out
They should be easy and intuitive since their first usage
Key to intuitive design is to make use of what users already know, and to keep things simple

10. Usability testing in COMPASS
Tools: Questionnaires
Three sessions targeting
Partners
HEIs
The general public
Between one session and the following developers have time to take feedback into account

11. O3A1 Testing among partners
Partners had been required to manually upload 10 LOs each in the areas of:
Digital systems and Digital design
Embedded systems
Programming and Algorithms
Computer architecture
VLSI testing
Distributed programming
Mobile communication

12. O3A1 Testing among partners
Tool: Dedicated online questionnaire
It consisted of six Sections:
Landing page and introduction
Information about the user
Evaluation of the functionalities to browse and insert Learning Opportunities
Evaluation of the functionalities to interact with the COMPASS Online Repository
Evaluation of additional functionalities
General feedback on the COMPASS Online Repository

13. O3A1 Testing among partners
Outcomes:
No difficulties reported in globally interacting (e.g., registering or logging in) with the COMPASS Online Repository and browsing LOs
Fast and pleasant interaction
Difficulties and concerns on inserting new LOs
Broken links or misleading questions were reported
Feedback already taken into account

14. O3A3 Testing among colleagues
Partners had been required to organize training sessions on COMPASS with
Teachers
Students
Policy makers
Responsible for HEIs …
Supervised exploration of the COMPASS Online Repository and evaluation

15. O3A3 Testing among colleagues
Tool: Dedicated online questionnaire
It consisted of six Sections:
Landing page and introduction
Information about the user
Evaluation of the functionalities to browse and insert Learning Opportunities
Evaluation of the functionalities to interact with the COMPASS Online Repository
Evaluation of additional functionalities
General feedback on the COMPASS Online Repository

16. O3A3 Testing among colleagues
Outcomes:
Still additional concerns on inserting new LOs
Again improved and corrected
Additional features suggested for browsing LOs
New filters added (e.g., for countries)
Adapt the content on the user’s profile (e.g., student or teacher)

17. O3A4 Testing with general public
Partners are organizing Multiplier Events for public dissemination all over Europe
Like the one you are attending now
Supervised exploration of the COMPASS Online Repository
Work group
Unsupervised evaluation

18. O3A4 Testing with general public
Tool: Dedicated online questionnaire
It consists of seven Sections:
Landing page and introduction
Information about you
General feedback on the COMPASS project
Evaluation of the functionalities to browse and insert Learning Opportunities
Evaluation of the functionalities to interact with the COMPASS Online Repository
Evaluation of additional functionalities
General feedback on the COMPASS Online Repository

19. O3A4 Testing with general public
Tool: Dedicated online questionnaire

20. O3A4 Testing with general public
Tool: Dedicated online questionnaire

21. O3A4 Testing with general public
Tool: Dedicated online questionnaire
Link:

22. O3A4 Testing with general public
Outcomes:
To be defined
A deliverable will be issued after all the Multiplier Events for public dissemination
Any feedback you will give us is valuable to improve COMPASS and the services it offers
Thank you!

23. Thank you!

24. Composing Lifelong Learning Opportunity Pathways through Standards-based Services
Raquel M. Crespo García

25. Feedback Online Services: Questionnaire (about the tool): or
Questionnaire (about the tool):
Questionnaire (about this event):