1. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu GARUDA - The National Grid Computing Initiative of India Subrata Chattopadhyay C-DAC, Bangalore, India subratac@cdac.in

2. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Outline GARUDA Overview Architecture & Network Resources Partners Applications for PoC Interoperability

3. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Motivation for GARUDA Sharing of high-end computational resources with the larger scientific and engineering community across the country Emerging High Performance Computing (HPC) applications require integration of geographically distributed resources Collaborative Framework for solving applications which are interdisciplinary requiring experts from multiple domains and distributed locations Universal (location-independence, ubiquitous) access to resources Computational Grids effectively address the above application requirements

4. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Project Overview Precursor to the National Grid Computing Initiative –Test Bed for grid technology/concepts and applications leading to the plan for the main grid initiative Project initiated by the Dept. of IT in November 2004 Major Deliverables –Technologies, Architectures, Standards & Research Initiatives –Nation-wide high-speed communication fabric –Aggregation of Grid Resources –Deployment of Select applications of National Importance –Grid Strategic User Group High-speed Networking Component in collaboration with ERNET

5. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Garuda Component Architecture Resources Compute, Data, Storage, Scientific Instruments, Softwares,.. Access Methods Access Portal Problem Solving Environments Data Management Storage Resource Broker Development Environment DIViA for Grid Management & Monitoring Paryaveekshanam Collaborative Environment Video Conferencing over IP Access Grid Resource Mgmt & Scheduling Moab from Cluster Resources Load Leveler, Torque Globus 2.x Application (PoC) Disaster Management Bioinformatics

6. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu GARUDA Component Deployment Scenario`

7. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Cyber Infrastructure – Network Fabric The Proof of Concept network has been established in collaboration with ERNET The MPLS Virtual Private Network (VPN) connects 22 institutions at 100 Mbps and 23 institutions at 10 Mbps across 17 Indian cities with SLA agreements Collaborative environment enabled through Video Conferencing over IP at the following centres of C-DAC : Bangalore, Pune, Chennai, Hyderabad, Mumbai and Trivandrum

8. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Cyber Infrastructure – Resources In addition to PARAM Padma, Linux Clusters have been setup at Pune, Hyderabad & Chennai Grid Labs have been setup at Bangalore, Pune & Hyderabad Fourteen of the partner institutions are contributing resources including satellite terminals (compute aggregating to more than 300 CPUs)

9. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Resource Details HPC Clusters from C-DAC Bangalore : AIX Cluster Pune, Chennai, Hyderabad : Linux Clusters Linux Clusters from IISc & RRI, Bangalore IMSc & MIT, Chennai IIT, Guwahati IIT, Kharagpur AIX SMP from University of Hyderabad SAC, Ahmedabad is contributing GSAT3 terminals (GSAT4 when launched) and Satellite bandwidth

10. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Job submission flow AIX Cluster Shared User Space Shared Data Space Linux Cluster Bangalore Solaris Cluster Linux Cluster Shared User Space Shared Data Space Pune Chennai Hyderabad Resource Manager for Grids Linux Cluster Resource Manager for Grids Garuda Access Portal Other Users Pune Users End Users access the grid through the Garuda Access Portal High Availability High Availability Resource Manager for Grids High Availability High Availability Resource Manager for Grids Bangalore Users

11. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Grid Management & Monitoring Centre An integrated Resource Management & Monitoring Framework Network Traffic Analysis and Congestion Management Help desk for Grid Users

12. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu GARUDA Partners Motivation –To Collaborate on Research and Engineering of Technologies, Architectures, Standards and Applications in Grid Computing –To Contribute to the aggregation of resources in the Grid Current Participation –36 research & academic institutions in the 17 cities –ERNET-HQ in Delhi –8 centres of C-DAC –Total of 45 institutions

13. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu GARUDA Partners (contd..) C-DAC Centres (8): Pune (2) Bangalore(2) Hyderabad Mumbai Chennai Thiruvananthapuram Academia Motilal Nehru National Institute of Technology, Allahabad Indian Institute of Science, Bangalore Punjab Engineering College, Chandigarh Madras Institute of Technology, Chennai Jawaharlal Nehru University, Delhi Guwahati University, Guwahati University of Hyderabad, Hyderabad Indian Institute of Technology at : Chennai Delhi Guwahati Kanpur Kharagpur Mumbai Roorkee University of Pune, Pune Institute of Technology, Banaras Hindu University, Varanasi Government Collaborators ERNET India

14. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu GARUDA Partners (contd..) Research Labs & Institutions Institute for Plasma Research, Ahmedabad Physical Research Laboratory, Ahmedabad Space Application Centre, Ahmedabad Harish Chandra Research Institute, Allahabad Indian Institute of Astrophysics, Bangalore National Centre for Biological Sciences, Bangalore Raman Research Institute, Bangalore Institute of Mathematical Sciences, Chennai Institute of Microbial Technology, Chandigarh Institute of Genomics and Integrative Biology, Delhi Centre for DNA fingerprinting and Diagnostics, Hyderabad Saha Institute of Nuclear Physics, Kolkatta Sanjay Gandhi Post Graduate Institute of Medical Sciences, Lucknow Bhabha Atomic Research Centre, Mumbai Tata Institute of Fundamental Research, Mumbai Inter-University Centre for Astronomy and Astrophysics, Pune National Chemical Laboratory, Pune National Centre for Radio Astrophysics, Pune Regional Cancer Centre, Thiruvananthapuram Vikram Sarabhai Space Centre, Thiruvananthapuram

15. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu I llustrative Applications

16. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Objectives and Deliverables Objectives –Enable applications of national importance requiring aggregation of geographically distributed resources Deliverables –Grid enablement of illustrative applications and some demonstrations such as Bioinformatics Disaster Management

17. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Bioinformatics Bioinformatics Resources & Applications Facility (BRAF) on PARAM Padma Supports highly optimized Bioinformatics codes on the PARAM Padma Web computing portal providing all computational facility to solve related problems

18. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Disaster Management PARAM Padma at Bangalore Flight data transmission from nearby Airport Grid Partner Resource at Pune User Agencies GRID Communication Fabric High Speed Communication User Agencies

19. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Virtual User Community Astrophysics High Energy Physics & Astronomy Grid Technology Disaster Management Earth Science Bioinformatics (Genome) Network Technology

20. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Garuda – EGEE Interoperability Garuda components EGEE components Options for interoperability Discussion

21. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Job Submission Flow Through Grid Portal Login to Portal PSE Develop Application Use resource browser and identify the platform Write Application Compile If Error Get & Match Requirement and identify resources Use Debugger View O/P files The files get transferred to the execution machine(s) The job executes The job completes execution The files get transferred to the Grid Head Node Yes No Submit Job with its requirements Get & Match Requirement and identify resources Upload Input datasets The files get transferred to the Grid Head Node

22. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Genome Grid 10 Mbps PUNE Bangalore 8 Node Dual CPU Xeon Cluster 8 Node Dual CPU Xeon Cluster 8 Node Dual CPU Xeon Cluster 8 Node Dual CPU Xeon Cluster 100 Mbps 10 Mbps Chennai Hyderabad Garuda Portal Dynamic Resource Scheduling User Client GARUDA Globus middleware 100 Mbps

23. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu EGEE Services API Access Job Mgmt. Services Computing Element Workload Management Metadata Catalog Data Management Storage Element Data Movement File & Replica Catalog Authorization Security Services Authentication Information & Monitoring Information & Monitoring Services Service Discovering Accounting Auditing Job Provenance Package Manager CLI Network Monitoring

24. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Basic Interop. Job submission PBS-Like Master Node WN-1 WN-2 WN-n lcg-CE (PBS submission) Mixed WN: GARUDA + gLite TAR-WN GARUDA Submission (Portal) gLite Submission (WMS) GARUDA Linux Resources GARUDA Portal Submission gLite (TAR)UI or subset(WMProxy APIs) JDL creation & Job submission gLite WMS glIte Resources cloud WNs must support GARUDA ENV. In case of AIX sys. could be evaluated AIX-ENEA solution gLite WN & UI TAR available on SLC3/4

25. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Job Submission Flow for EGEE Grid User

26. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Job Submission Flow for GARUDA Grid User

27. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Challenges ! Multiple components – evolving User authentication mechanisms Complexity and stability Open source and commercial license Accounting

28. EU-IndiaGrid (RI-031834) is funded by the European Commission under the Research Infrastructure Programme www.euindiagrid.eu Thank you! www.garudaindia.in