1. March 9, 2008 Vermelding onderdeel organisatie 1 SEARIS'08 Workshop IEEEVR 2008, Reno NV, USA Gerwin de Haan G. de Haan, F.H. Post Data Visualization Group & VRLab http://visualization.tudelft.nl/VRVis Flexible Architecture for the Development of Real-Time Interaction Behavior (p.71)‏

2. March 9, 20082 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Real-Time Interaction Behavior (VR) application behavior is interaction/event-based Interaction Trends: Multi – Object Multi – User Multi – Cursor Multi – System Interaction Trends: Multi – Object Multi – User Multi – Cursor Multi – System Development Cycle: Implementation Architecture Interaction Model Front-End (Storyboard)‏ Unexpected complexity, behavior, structure Prototype, Experiment, Analyse

3. March 9, 20083 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Work in Progress Prototyping Interaction Software: Base Architecture: VRMeer Interaction Model: StateStream Run-time/Development Environment -> Unifying through a dynamic language

4. March 9, 20084 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Architecture: VRMeer [2] G.de Haan et. al. “Flexible Abstraction Layers for VR application development” IEEE VR '07

5. March 9, 20085 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop StateStream Model Low-level design of techniques, relations Actors Conceptual containers e.g. VR Objects, Interactors, (Algorithms)‏ Dual aproach for Interaction Modeling Statemachine: Discrete behavior Streammachine: Continuous exchange of data [6] R.Jacob et. al. “A Software Model and Specification Language for Non-WIMP user interfaces”, ACM TOCHI '99

6. March 9, 20086 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop StateStream Model: StateMachines StateCharts: Hierarchical, Concurrent Statemachines Functionality in callbacks of Events, Transitions

7. March 9, 20087 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop StateStream Model: StreamMachines Data Flow Graph: Nodes, Connections, Ports Functionality in callbacks of ports

8. March 9, 20088 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop StateStream Model: Relations

9. March 9, 20089 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Integration with Python StateStream components are Python Classes Methods: expressive functionality Dynamic Typing: Flexible with restructuring Inheritance: Derive and override Introspection: run-time decisions, accessible Mix-ins: Quick integration with base arch. Instantiation: Create new components on-the-fly Python in control: Intercept and introspect “anywhere, anytime”

10. March 9, 200810 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Iterated Development Challenges: containment, hierarchy, timing, order Gradual maturing Model Extension Transfer to Model e.g. Templated sub-statemachines Complexity explosion unevitable Supporting analysis tools (e.g. Visualisation, logging)‏ Run-Time Environment Towards end-user environment

11. March 9, 200811 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Run-Time Environment Python glue ~ concurrent w. VR GUI components Introspection Scripting Mix event models (d.tools)‏ [4] B. Hartmann, “Reflective Pysichal Prototyping through integrated design, test, and analysis”, UIST 2006

12. March 9, 200812 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Conclusions, Future Directions StateStream model and architecture Work in progress Visibility, flexibility, expressiveness Speed up prototyping, development Future work Extensible prototyping environment (Semi-) Formal model properties Serialization, Optimization, Distribution Multiple Python instances

13. March 9, 200813 G. de Haan, F.H. Post “Flexible Architecture for the Development of Real-Time Interaction Behavior” SEARIS'08 Workshop Questions ? Remarks ! g.dehaan@ewi.tudelft.nlg.dehaan@ewi.tudelft.nl - http://visualisation.tudelft.nl/VRVis !