1. LOGO

2. Artificial Life in Virtual Environments Rogério Perino de Oliveira Neves Laboratory of Integrable Systems Artificial Life Group A.L.I.V.E.

3. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 3 Presentation Parts 1. Introduction(3) 2. ALife Concepts(14) 3. Project Specification (19) 4. Experimental Results(12) 5. Conclusions (6) Total(54)

4. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 4 Objectives Research on ALife Apply VR technologies to the visualization of ALife experiments Build a customizable experimental development framework Implement AL experiments within the developed framework

5. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 5 Project Parts Theoretical part –Related studies –“State of the Art” research look up –Open problems Practical part –Framework development –Experiment development based on it

6. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 6 About ALife Combines biology and computer science to create synthetic models of living systems evolution A tentative to elucidate the logical structure (in a most general form) of biological evolution Originally dominated by computer scientists Nowadays studied by researches of almost all areas

7. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 7 Artificial Life The expression was first introduced by Christopher Langton in 1987, when was used as a conference name held in Los Alamos, New México, about “The Synthesis and Simulation of Living Systems”. “Artificial life: The proceedings of an Interdisciplinary Workshop on the Synthesis and Simulation of Living Systems” September, 1987, Los Alamos, New Mexico, Addison-Wesley Pub. further information...

8. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 8 Key concepts The initial definition considered two types: –Strong AL: re-creation of life in-silico, i.e. in the computer –Weak AL: simulation of biological phenomena Possible attacks –Bottom-up –Top-down

9. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 9 Bottom-Up –Observed in the nature –No planning –Comes from emergence/evolution –Generally associated to strong AL Top-Down –Humanistic procedures –Comes from planning/foresight –Generally associated with weak AL Attacks

10. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 10 Life Simulations Rules –Local rather than global –Simple rather than complex –Emergent rather than pre-defined (behavior)

11. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 11 Types of ALife research Origins of Life, self-organization and self- replication Development and replication Evolutionary dynamics and adaptation Autonomous agents and robots Communication, cooperation and social behavior Simulation, synthesis tools and methodologies

12. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 12 Open problems in Artificial Life A. How does life arise from the nonliving? 1. Generate a molecular proto-organism in vitro 2. Achieve the transition to life in an artificial chemistry in silico 3. Determine whether fundamentally novel living organizations 4. Simulate a unicellular organism over its entire lifecycle. 5. Explain how rules and symbols are generated from physical dynamics in living systems.

13. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 13 Open problems in Artificial Life B. What are the potentials and limits of living systems? 6. Determine what is inevitable in the open-ended evolution of life. 7. Determine minimal conditions for evolutionary transitions from specific to generic response systems. 8. Create a formal framework for synthesizing dynamical hierarchies at all scales. 9. Determine the predictability of evolutionary consequences of manipulating organisms and ecosystems. 10. Develop a theory of information processing, information flow, and information generation for evolving systems.

14. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 14 Open problems in Artificial Life C. How is life related to mind, machines, and culture? 11. Demonstrate the emergence of intelligence and mind in an artificial living system 12. Evaluate the influence of machines on the next major evolutionary transition of life 13. Provide a quantitative model of the interplay between cultural and biological evolution 14. Establish ethical principles for artificial life further information... From Bedau et. al – “Open Problems in Artificial Life”

15. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 15 ALife tools Examples: State Machines Non-linear Systems / Chaotic Dynamics Fuzzy Logic Artificial Neural Networks Evolutionary Search Genetic Algorithms

16. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 16 Multi Agent Systems Autonomous agents Biological agentsRobotic agentsComputational Agents...Artificial biological agents Search agents Entertainment agents VirusesIntelligent agents ALife agentsElectronic agents...

17. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 17 Experiments in ALife Actor Agent EnvironmentVirtual scene UI / Interaction Visualization device

18. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 18 Examples of ALife Programs

19. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 19 State of the Art in ALife * Neves, Rogério “Karl Sims videos”, http://www.lsi.usp.br/~rponeves/research/sims, access 18/09/2003 http://www.lsi.usp.br/~rponeves/research/sims further information...

20. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 20 PROJECT SPECIFICATION

21. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 21 Project Specification Motivation Characteristics Resources Technical tools Java, Java3D Visualization / Interactivity Framework proposal Experiments

22. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 22 Motivation Weak visualization and Interaction –Most of ALife programs provides a poor visual representation of the Virtual Environment –The programs allow only the change of some parameters at start-up or during the experiment Hard code access –When available, the sources are frequently in low-level or at least not object oriented languages (ASM, C) Support to parallel architectures –Allowing the performance improvement in concurrent execution of agents in a Multi-threaded, Multi-Agent context A full 3D Environment simulation –Allowing the employment of vector mathematics to operate objects in the scene Apply the “State of the Art” in visualization technologies –Employ computer graphics, accelerator boards and VR technologies to the visualization of the Virtual Environment

23. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 23 Project features OOP Paradigm –Allows easy object/agent description/operation Cross-platform execution capability Open source philosophy Simulation of a true 3D space with vector dynamics –Providing easy manipulation of objects into 3D space Multiple-device 3D graphical support Visualization in Virtual Reality and immersive environments Concurrent execution of programs –Allow experiment speed-ups in multi-processed and distributed architectures Browser applet / Internet execution

24. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 24 Techniques / tools OOP MAS Vector Mathematics Discrete Time-Dynamics Concurrent Programming Computer Graphics Networking ALife Related

25. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 25 Development resources Java / Java3D API (from SUN) Personal Computers Graphical Workstations (Silicon Graphics) Multi-processed systems (SPADE project) Cluster of PCs (CAVE) Visualization devices (from monitors to CAVES) GB Ethernet Network

26. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 26 Java & Java3D Java Cross-platform capability Internet compliant Built over the OOP paradigm Concurrent programming support ( through Threads) Extensible Reliable Java3D New standard in VR development OpenGL/DirectX hi-level interface Scene description through scene-graphs Extend Java features

27. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 27 Java3D scene-graph example

28. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 28 Visualization Directed, but not limited to: Ordinary 3D boards Professional graphical accelerators From ordinary to stereo Monitors Shutter Glasses Head Mounted Displays (HMD) CAVES Other VR devices

29. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 29 Interactivity Mouse* Keyboard Gloves* Wands* Other tracking devices* *Through Java3D picking behavior

30. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 30 Levels of operability A.L.I.V.E. Framework Java/Java3D Byte code Super classes Java VM/Machine Code User Interface User Classes Mid-Level/Language Code Hi-Level/Pseudo Code Custom User Interface Runtime Interface/Interaction Project Scope

31. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 31 Platform architecture RenderClient Subset

32. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 32 UML diagram

33. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 33 UML diagram

34. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 34 Render Client Scene Multicast Packages Server RenderClient Env

35. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 35 Environment configuration

36. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 36 UI UI

37. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 37 Agent diagram example

38. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 38 Demo code DEMO CODE

39. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 39 EXPERIMENTS & RESULTS

40. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 40 Developed Experiments Program test ALGA – Evolution / Adaptation Predator-Prey system Fish Schooling Flocking Biological demos –Cellular dynamics –Fungus growth –Lymphocytes & virus –Mitosis

41. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 41 Demo Experiments

42. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 42 Predator-Prey System

43. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 43 Predator sight R G B + ACT W1W1 W2W2 W3W3 FILTER RADIATION

44. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 44 Predator DNA Reproduction condition Death condition Sensibility radius Strength Stamina Metabolism temperature Temperature tolerance Toxic resistance W1: red filter weight (R) W2: green filter weight (G) W3: blue filter weight (B)

45. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 45 Predator-Prey population graphs

46. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 46 Predator-Prey population graphs

47. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 47 Visual improvements Cellular dynamics

48. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 48 Fish Schooling

49. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 49 Flocking

50. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 50 Performance -1

51. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 51 Conclusions The project explores the representational potential of ALife experiments employing 3D and VR to the visualization of experiment environment The developed framework provides a quick experiment prototype development tool The developed experiments demonstrates the framework capabilities and resources, serving as models to new user experiments

52. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 52 Conclusions Making the project available in Sourceforje.net, users around the world are allowed to contribute to the framework improvement The developed experiments can be published thought the internet allowing greater and faster interaction between research groups Also allows ordinary people outside the scientific community to experiment with this experimental virtual lab, serving as a scientific divulgation tool The experiments can take advantage of new coming visualization technologies while they appear, without the need of code adaptation

53. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 53 Possible employments ALife experiment development Biological scholar demonstrations Problem solving in sciences/engineering * System training in robotics * Simulation of genetics and evolutionary systems User oriented pattern search in virtual spaces Employment in future technologies (such nanotechnologies) * Neves, Rogério P. O. and Netto, Marcio L. “Evolutionary Search for Optimization of Fuzzy Logic Controllers” 1st International Conference on Fuzzy Systems and Knowledge Discovery, Volume I, on Hybrid Systems and Applications I further information...

54. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 54 Proposal to future works Interaction through sensitive devices File access Experiments: –Variable morphology –Intelligent agents / humanoids * Cavalhieri, Marcos, “Virtual Human Project”, http://www.lsi.usp.br/~mac/, access in 18/09/2003http://www.lsi.usp.br/~mac/ further information...

55. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 55 Acknowledgments Claudio Ranieri, Group ARTLIFE, LSI, USP Marcos Cavalhieri, Group ARTLIFE, LSI, USP Prof. Emilio Hernandez, LSI, USP Artur Gonzalez, PCS, USP Prof. Wolfgang Banzhaf, Dortmund University

56. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 56 Related Documents Rogério Neves, ALIVE Project Site & thesis http://www.lsi.usp.br/~rponeves/ Official ALIVE Project site http://www.lsi.usp.br/~alive/ ARTLIFE Site, Artificial Life group http://www.lsi.usp.br/~artlife/ Questions & doubts rponeves@lsi.usp.br

57. 3 4 5 6 7 8 10 11 12 13 14 15 16 17 19 20 21 22 23 24 25 26 27 28 29 30 33 34 35 36 40 41 49 50 51 52 53 54 57 LOGO