1. 6 th Framework Programme - Priority 2 “Information Society Technologies” FP6/2003/IST/2 Joint Action Science and Technology JAST - FP6-003747 Joint-Action Science and Technology JAST

2. Overview 1.Goals 2.Means 3.Co-ordinator 4.Organization 5.Activities 6.Website 7.Delegation Joint-Action Science and Technology

3. 1. Goals Cognitive Systems –JAST will extend cognitive science beyond the domain of studying individual cognitive systems Ultimate goal of JAST –To build jointly-acting autonomous systems that communicate and work intelligently on non-trivial mutual tasks Primary goal –Understanding the cognitive architecture of collaborating cognitive systems

4. 2a. Means: Consortium Partners 1.Radboud Universiteit Nijmegen - Nijmegen Institute for Cognition and Information - FC Donders Centre for Cognitive Neuroimaging The Netherlands – NICI + FCDC 2.Max Planck Institute for Biological Cybernetics, Tübingen Germany – MPIT 3.Institute of Communication and Computer Systems, Athens Greece – ICCS 4.The University of Edinburgh United Kingdom – UEDIN 5.Max Planck Institute for Psycholinguistics Nijmegen The Netherlands – MPIN 6.Technische Universität München Germany – TUM 7.Universidade do Minho Portugal – UMP

5. 2b. Multidisciplinary team Partners Disciplines 1.NICI Neurocognitive scientists 2.FCDCid. 3.MPIT Cognitive scientists 4.ICCS Neuroscientists 5.UEDINPsycholinguists 6.MPIN id. 7.TUM Robotocists 8.UMP id.

6. 2c. Means: Common Scenario Arbitrary initial object layout Resulting objects after completion of multimodal dialogue sequence Joint-Action Science and Technology

7. 2d. JAST Construction Task Joint-Action Science and Technology (video)

8. 2e: State-of-the-art starting conditions: Demonstrator-Hardware –Two directly cooperating arms. A third arm may be used for holding aggregates –Assembly without any fixtures or specialised tools –A rich set of action primitives (motor, sensor, sensorimotor) has been implemented for positioning, grasping, assembling, disassembling, goal-directed motion under collision avoidance, etc. –Robust recognition and manipulation of parts in all positions –3 Robots, 10 colour cameras (partly articulated)

9. 2f. Beyond state-of-the-art goals System to be developed: real-time, adaptive planning dialogue-supported perception, reasoning, action cross-modal associations model of action-dynamics rule- and self-organization based learning monitoring and repairing errors by self/other multiple degrees-of-freedom in perception-action

10. 3a. Co-ordinator http://www.nici.kun.nl/People/BekkeringH/index.html

11. 3b. Manager http://www.nici.kun.nl/People/MeulenbroekRGJ/index.html

12. 4. Work-Packages

13. 5. Activities Two-day Opening Conference –Athens, Greece –February, 2005 –Dates: to be announced R&D activities in WP 2-3-4-5 –See excerpt JAST (http://bscw.socsci.kun.nl/pub/bscw.cgi/0/1706107)

14. 6. JAST Website http://212.205.85.69/jast/index.htm

15. 7. Delegation Members of JAST attending the CogSys Kick-Off Meeting