1. Javier Magnin Brazilian Center for Research in Physics & ROC-LA
GRID and ROC-LA
Javier Magnin
Brazilian Center for Research in Physics
&
ROC-LA
Workshop in Physics and Technology at CERN - Bogota, Oct , 2010

2. Outline The concept of GRID Different GRID “flavors”
The Worldwide LHC Computing GRID: WLCG
The ROC-LA
How to become a site member of ROC-LA
The typical structure of a site under ROC-LA
ROC-LA outreach
Conclusions

3. The concept of GRID
Web is a service for sharing information over the Internet, Grid is a service for sharing computer power and data storage capacity over the Internet.

4. Web is a service for sharing information over the Internet, Grid is a service for sharing computer power and data storage capacity over the Internet.
The five big ideas
Resource Sharing
Secure Access
Resource Use
The Death of Distances
Open Standards
The concept of GRID

5. The concept of GRID Isolated resources Cluster 1 Cluster 5 Cluster 4

6. The concept of GRID
Cluster 1
Cluster 5
Cluster 4
Cluster 3
Cluster 2
Resource sharing  direct access to remote computers, software and data
Death of distances  high speed connections between computers
Open standards  applications made to run on one resource will run on all other

7. The concept of GRID Security:
Cluster 1
Cluster 5
Cluster 4
Cluster 3
Cluster 2
Security:
Digital certificates to identify clusters in the GRID

8. The concept of GRID
Cluster 1
Cluster 5
Cluster 4
Cluster 3
Cluster 2
VO 1
VO 2
VO 3
VO 4
Secure access  Access policy, authentication and authorization
Resource use  you should be able to calculate the optimal allocation of resources

9. The concept of GRID VO (Virtual Organization):
Cluster 1
Cluster 5
Cluster 4
Cluster 3
Cluster 2
VO 1
VO 2
VO 3
VO 4
VO (Virtual Organization):
Is a group of people sharing common interests.
Individuals are identified by digital certificates
Individuals pertaining to a given VO have granted access to resources supporting the given VO

10. The concept of GRID ROC /NGI Monitoring services:
Cluster 1
Cluster 5
Cluster 4
Cluster 3
Cluster 2
VO 1
VO 2
VO 3
VO 4
ROC
/NGI
Monitoring services:
ROC/NGI´s in the European GRID
Something else in the American GRID

11. The concept of GRID
COD

12. The concept of GRID In summary, the GRID is:
Hardware  a large amount of computers across the world
Network  to interconnect the hardware
Middleware  the software which brings together all the hardware across the internet to setup the GRID infrastructure
A set of usage rules  Digital Certificates, VO’s, monitoring structures and goals, etc.
which sound like a “Virtual Super Computer”

13. Different GRID “flavors”
There exists several GRID initiatives around the world
Europe
EGI
Nordugrid
WLCG
etc.
National projects
Open Science Grid (OSG) - USA
TeraGrid - USA
CNGrid - China
Garuda - India
National Grid Service – United Kingdom
INFN Grid – Italy
etc

14. Different GRID “flavors”
They mostly differ in the middleware
gLite
Unicore
ARC
dCache.org
Globus Toolkit
etc.

15. Different GRID “flavors”
They mostly differ in the middleware
gLite
Unicore
ARC
dCache.org
Globus Toolkit
etc.
EMI (European Middleware Initiative):
Common middleware
Three years project
Started in May 2010
26 partners across Europe

16. Different GRID “flavors”
They mostly differ in the middleware
gLite
Unicore
ARC
dCache.org
Globus Toolkit
etc.
EMI (European Middleware Initiative):
Common middleware
Three years project
Started in May 2010
26 partners across Europe
Conversations with OSG

17. Different GRID “flavors”
EMI
Objectives: consolidate a middleware distribution simplifying services and components, evolve functionalities following the requirements of the community
Improve usability
Improve security
Standardization
interoperability
service integration
Integration with new technologies
messaging - for monitoring, accounting, service management, etc.
virtualization – usage of virtual machines

18. The Worldwide LHC computing GRID: WLCG
WLCG is a collaboration linking grid infrastructure and computer centers worldwide
More than 130 computing centers in 34 countries
CPU cores (Oct. 2010) available to process, and analyze data produced at LHC
Large storage capacity (some Pb)
Equally available to all partners, regardless of their physical location
Individual institutions contribute to WLGC with hardware and human resources

19. The Worldwide LHC computing GRID: WLCG
WLCG consists of three mains layers or Tiers, made up of computer centers:
Tier-0: One site (the CERN computing center). All data from LHC passes through this central hub. Contributes with less than 20% of the total computing power
Tier-1: 11 large computer centers with large storage capacity and round-the-clock support. Used for processing of raw data, data analysis and data storage.
Tier-2: about 160 smaller computing centers with enough computing power and storage for data analysis and MC generation

20. The Worldwide LHC computing GRID: WLCG
WLCG consists of three mains layers or Tiers, made up of computer centers:

21. The Worldwide LHC computing GRID: WLCG

22. The ROC-LA Created as a joint effort by CBPF, ICN-UNAM and UNIANDES
It was a response to the
end of the ROC-CERN as a catch-all ROC
absence of a ROC infrastructure in LA
ROC-LA operations started in Sept. 30, 2009
CBPF, ICN-UNAM and UNIANDES were under ROC-CERN until Sept. 30, 2009
ROC-LA technical team trained at CERN during 6 months in 2009 – (financial support by WLCG and host institutions)
Fully founded by the host institutions

23. The ROC-LA Structure of ROC-LA Management Board:
Dr. Carlos Avila (UNIANDES)
Dr. Javier Magnin (CBPF)
Dr Lukas Nelen (ICN-UNAM)
Technical Board:
Eng. Luciano Diaz (ICN-UNAM)
Eng. Andrés Olguin (UNIANDES)
Eng. Renato Santana (CBPF)
Technical support team provided by the host Institutions

24. The ROC-LA Objectives of ROC-LA
To provide a GRID infrastructure for LA (HEP and non-HEP sites)
To give support to the GRID infrastructure by certifying, testing and monitoring sites in Latin America
Services provided by ROC-LA
Information  through the central GOCDB, site-BDII, APEL
Support  GGUS tickets
Monitoring  Nagios, SAM-tests, GSTAT

25. The ROC-LA Responsibilities of ROC-LA
Follow up and dispatch tickets addressed to ROC-LA
Review (on a daily basis) the backlog of tickets and take appropriated actions
Review (on a daily basis) alarms and take appropriated actions
Certify new sites and follow up new sites in certification process
Provide a support mailing list

26. The ROC-LA UNIANDES CBPF 216 cores 312 cores SAMPA 120 cores ICN-UNAM
UTFSM
44 cores

27. The ROC-LA ROC-LA in numbers: 5 sites in production (WLCG) 750 cores
CBPF
312 cores
UNIANDES
216 cores
SAMPA
120 cores
ICN-UNAM
58 cores
UTFSM
44 cores
ROC-LA in numbers:
5 sites in production (WLCG)
750 cores
1 site in final tests (LNCC-COMCIDIS)
1 site in certification process (UFRJ-NACAD)
Support to the VO’s: LHCb, CMS, ALICE, ATLAS, biomed, fussion, Auger, oper.vo.eu-eela.eu, prod.vo.eu-eela.eu

28. How to become a site member of ROC-LA
First
Send to asking to become a site member describing your hardware and network infrastructure and human resources
Describe also your needs in terms of VO’s your site will support
Sign up the Letter of Agreement
then
The ROC-LA technical board will start the process of certification and setup of your site

29. The typical structure of a site under ROC-LA
It depends on your needs/resources but at least you will have
A Computing Element (CE)  this is the portal of your site
A Storage Element (SE)  for data storage – depending on your needs (VO depending)
A number of Working Nodes  for processing – typically a few (as much as you can!) servers with multi-core processors
RAM memory  for the WN’s – depending on the data you will have to process (VO depending)
A System Manager (of course!)
Internet connection (of course!)

30. ROC-LA outreach Home page: http://www.roc-la.org I ROC-LA Workshop
I ROC-LA Workshop
CERN, Oct. 6 to 8, 2010

31. ROC-LA outreach Home page: http://www.roc-la.org I ROC-LA Workshop
I ROC-LA Workshop
CERN, Oct. 6 to 8, 2010
Annual workshop open to all ROC-LA users

32. Conclusions GRID in LA shows a slow but consistent growth
GRID activities in LA are mainly driven by the HEP community (which is the largest user in the region)
ROC-LA commitment is to provide a sustainable infrastructure for the GRID community/users in LA
monitoring services
technical support
certification of sites/users
The ROC-LA born to provide support to the HEP community, but is open to the non-HEP users too
ROC-LA is financially supported by its hosts institution