1. A Self-Manageable Infrastructure for Supporting Web-based Simulations Yingping Huang Xiaorong Xiang Gregory Madey Computer Science & Engineering University of Notre Dame Sponsored by NSF/ITR-DEB

2. Outline Introduction Autonomic Computing Web-based Simulations Self-manageable infrastructure Self-Configuring Self-Healing Self-Optimizing Self-Protecting Conclusion and future work

3. Autonomic Computing Motivation What’s next? – A dozen information technology research goals (J. Gray, Microsoft Research) Goal The SysAdmin sets system goals and high level polocies System takes care of itself http://www.ibm.com/autonomic

4. Autonomic Computing (cont) Self-Configuring New simulations, new simulation servers Self-Healing Completed simulations Self-Optimizing Efficient usage of system resources Self-Protecting No unauthorized access

5. Web-based Simulations Features of Web-based simulations Simulations run on the simulation servers Simulation data is downloadable for users Simulation reports are generated dynamically Simulation status is sent to users by email Collaboration among users Challenges Reliability Availability Efficiency Security

6. Motivation: NOMSIM Simulate natural organic matter (NOM) evolution behavior Agent-based stochastic simulation method Multi-disciplinary project that involves chemists, biologists, environmental scientists, geologists and computer scientists Collaboration is essential Funded by NSF-ITR

7. Outline Introduction Autonomic Computing Web-based Simulations Self-manageable infrastructure Self-Configuring Self-Healing Self-Optimizing Self-Protecting Conclusion and future work

8. The Infrastructure

9. Features of the Infrastructure Scalability Web server tier: new application servers can be added to the balanced application server cluster Simulation server tier: can be scaled almost linearly by installing new simulation servers running identical simulations Database server tier: real application cluster (RAC) enables all active instances executing transactions against a shared database

10. Features of the Infrastructure (cont) Availability Web server tier: eliminates single point of failure by redundancy and failover, and session state is maintained in the database server tier Simulation server tier: simulation checkpointing and resuming Database server tier: eliminates single point of failure by redundancy and failover

11. Simulation Metadata jdbc:oracle:thin:username/password@hostname:port:sid dbusername dbpassword

12. Simulation Manager and Intelligent Agents One intelligent agent runs on one simulation server Functionalities of intelligent agents Register new simulation servers to simulation manager Reports metrics of simulation servers to simulation manager Deploy new simulation models Check for simulation jobs Transport data from simulation servers to database servers Cancel simulation jobs as directed by the simulation manager Functionalities of simulation manager Dispatch and manage simulation jobs Notify users simulation job status

13. Self-Configuring jdbc:oracle:thin:username/password@hostname:port:sid dbusername dbpassword HTML form JavaScript Form ValidationDatabase Table JSP Code

14. Self-Configuring (cont) On simulation servers Intelligent agents must run Install simulation software (To simplify: the simulation software is installed on an NFS server and which is mounted on the simulation servers) On simulation manager Email masquerading

15. Self-Healing Self-Healing Web servers Clustered application server instances Automatic recovery of failed instance Self-Healing simulation servers Simulation checkpointing Simulation resuming Self-Healing database servers Clustered database instances Automatic recovery of failed instance Raid 0+1

16. Self-Healing (cont) Simulation RDBMS Simulation Server TierDatabase Server Tier Checkpointing Resuming

17. Self-Protecting Role based access control Public Owner Grant Firewall Port scan IPTABLES Log messages scanning Network traffic monitoring, Intrusion Detection (Future work)

18. Self-Optimizing Self-Optimizing web server tier Load balanced application server cluster Self-Optimizing database servers Database parameter self-tuning Online index rebuilding Summary and aggregation

19. Self-Optimizing (cont) Time Simulation Server 1Simulation Server 2 Checkpoint Migrate DBMS

20. Implementation of self-* Tools IBM’s ABLE (agent building and learning environment) Oracle Data Mining Unix Crontab Languages Java SQL and PL/SQL Bourne shell scripts

21. Outline Introduction Autonomic Computing Web-based Simulations Self-manageable infrastructure Self-Configuring Self-Healing Self-Optimizing Self-Protecting Conclusion and future work

22. Conclusions and Future Work Conclusions Self-Manageable infrastructure Intelligent agents Simulation manager Future work Applying data mining “Intelligent agents” Proactive critical event prediction Job completion time prediction

23. Questions? Thank You