1. User modelling for adapted accessible interaction Julio Abascal #, Olatz Arbelaitz *, Myriam Arrue #, Javier Muguerza * # EGOKITUZ: Laboratory of HCI for Special Needs * Algorithms, Data mining and Parallelism Research Team University of the Basque Country/Euskal Herriko Unibertsitatea

2. Rationale This paper briefly describes the diverse approaches to user adapted accessible interaction that we have developed in the last years Purpose: To discuss the possibility of advancing towards a comprehensive approach to shared-user modelling

3. Index 1.Introduction of EGOKITUZ 2.Objectives 3.Personal accessibility to the web 4.Accessibility to Ubiquitous Computing environments 5.Web mining for user modelling 6.Conclusions

4. EGOKITUZ: Laboratory of HCI for Special Needs Created in 1985. Main goal: the application of computer technology to provide support to people with disabilities and elderly people. Staff: Variable (currently 10 fulltime researchers). http://go.ehu.es/Egokituz 4

5. EGOKITUZ: Laboratory of HCI for Special Needs International activities IFIP TC13 Human-Computer Interaction (1991-) IFIP WG 13.3 HCI and Disability (1993-) IFIP WG 13.1 Education in HCI and HCI Curriculum (1999-) EU Adviser, reviewer, evaluator, expert roles EU projects, COST European actions Research HCI & Assistive Technology Ambient Intelligence & Ubiquitous Computing Web Accessibility Teaching Advanced interaction systems Networks, OS & HW design Accessibility & Usability 5

6. Index 1.Introduction of EGOKITUZ 2.Objectives 3.Personal accessibility to the web 4.Accessibility to Ubiquitous Computing environments 5.Web mining for user modelling 6.Conclusions

7. Objectives Enhancing the accessibility for people with temporary or permanent restrictions. Adapting the interaction system to – the features, needs and likes of each specific user, and – the characteristic of each place and task. By compiling information about the users and their environment to create suitable user models And dynamically creating personalized interfaces. Future: Sharing or exporting models among remote applications

8. Index 1.Introduction of EGOKITUZ 2.Objectives 3.Personal accessibility to the web 4.Accessibility to Ubiquitous Computing environments 5.Web mining for user modelling 6.Conclusions

9. Universal Accessibility to the web The problem of Web accessibility is mainly treated from the Design for All or Universal Accessibility point of view. This approach is extremely convenient for ensuring the civil rights to electronic inclusion of people with any type of disability. Many methodologies and tools have been created to apply these guidelines. This approach failed to help specific users to find suitable web sites

10. EvalAccess: Automatic Web Accessibility Evaluator A result of the IRIS European Project: Built as a web-service to be used from mainstream applications. Not built-in Guidelines: able to evaluate diverse sets of guidelines. Tool to allow the creation of machine-readable new guidelines: specific purpose guidelines. It provides statistical data to create quantitative accessibility metrics.

12. Personal vs. Universal Accessibility Evalaccess allowed us to tackle Personal Accessibility: Starting from a combination of – Quantitative metrics and – The use of specific guidelines or WAI subsets In order to select the most adequate guidelines users where modelled. – Abilities and restrictions to access the Web

13. Index 1.Introduction of EGOKITUZ 2.Objectives 3.Personal accessibility to the web 4.Accessibility to Ubiquitous Computing environments 5.Web mining for user modelling 6.Conclusions

14. EGOKI INREDIS Project INterfaces for RElations between Environment and people with DISabilities – Consortium: 14 companies, 18 research institutions. – Period: 2007 to 2010. – Investment 23.6 million. – Purpose: to develop basic accessible and interoperable technologies that enable the communication and interaction between people with disabilities and their environment. – Some work-packages: Interoperability protocols. Assistive technology and ubiquitous software. Adaptive user interfaces and device configuration. Interoperability in mobile devices. – http://www.inredis.es/Default.aspx. INREDIS project inspired us to create EGOKI 14

15. Scenario: Interacting with Ubiquitous Computing Environments 15 Middleware 1. The user device and the target machine somehow transparently communicate (through a wireless network) 2. The ATM service is offered to the user. He/She accepts it (using his/her mobile personal device) 3. The system creates (and downloads to the user device) an instance of the UI adapted to the user/device/context

16. Automatic generation of accessible User Interfaces EGOKI: Automatic generation of adapted UIs for ubiquitous computing For users with restrictions: people with disabilities, elderly people. people performing other activities (driving) or using special devices (mobiles). Goal: to provide ubiquitous access to intelligent machines (ATMs, information kiosks, intelligent home appliances, etc.). Context: users are provided with their own device adapted to their features and needs. 16

17. Automatic generation of accessible User Interfaces Service designers provide abstract specifications of the UI for each service by means of a User Interface Modelling Language (UIML) The system maintains user/task/context models (in an ontology) EGOKI selects the most suitable interaction resources (from those supplied by the service provider) taking into account the users capability for each communication modality. It creates an accessible adapted UI, which is suited to the service. 17

18. Automatic generation of accessible User Interfaces Case Study: Underground Ticketing 18

19. Validation In order to to prove the correct functionality and the accessibility of interfaces that the EGOKI generated automatically, it was carried out: – Barrier Walkthrough exercise – User Based Testing: Blind users and Users with cognitive disabilities

20. Index 1.Introduction of EGOKITUZ 2.Objectives 3.Personal accessibility to the web 4.Accessibility to Ubiquitous Computing environments 5.Web mining for user modelling 6.Conclusions

21. User Modelling based on Web Usage Mining 1.Data acquisition and pre-processing – Complex (the most time consuming and computationally expensive step) – Users privacy issue. – Diverse possible sources (client machines, proxies, servers...) – It includes: user and session identification, and data fusion and cleaning. 2.Pattern discovery and pattern analysis. – Machine learning techniques are applied in order to find sets of web users with common web-related characteristics and the corresponding patterns. – Paradigms : unsupervised learning (or clustering), association rules, and paradigms used to find frequent patterns such as frequent episodes. – Subsequently: selection of the most meaningful patterns. manually by experts in the area or based on the parameters of the machine learning algorithms used

22. ModelAcces Project Currently we are working on profiling functional abilities of the users, using data extracted from their web interaction. Logs from a large website DISCAPNET run by ONCE. Some variables automatically extracted from the server log data, can have direct connections with t user abilities: – number of different URLs visited – average time spent on each URL (taking into account if the page is of authority type or hub type) – maximum and/or average depth of each session – diversity in semantic content of the visited URLs – etc. We use these types of parameters to make assumptions about the possible limitations of the users (specific disabilities, how lost they are, etc.). The results will be used to enrich the recommendations generated using other strategies.

23. Conclusion Proliferation of adaptive applications (each one handling and maintaining its own model). But Public Ubiquitous Computing environments do not have a model of each user. Is it possible to share models among applications? Development of methods to… – …(partly or completely) share models. – …provide remote access to private models. – …define formats for interoperable model description. – …protect user privacy. – …adopt Virtual User Modelling [VUMS White Paper].

24. EGOKITUZ: Laboratory of HCI for Special Needs Location University of the Basque Country/ Euskal Herriko Unibertsitatea Donostia. Spain 24