National Institute of Advanced Industrial Science and Technology ApGrid: Asia Pacific Partnership for Grid Computing - Introduction of testbed development.

Slides:



Advertisements
Similar presentations
Kento Aida, Tokyo Institute of Technology Grid Working Group Meeting Aug. 27 th, 2003 Tokyo Institute of Technology Kento Aida.
Advertisements

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
National Institute of Advanced Industrial Science and Technology Experiences through Grid Challenge Event Yoshio Tanaka.
Demonstrations at PRAGMA demos are nominated by WG chairs Did not call for demos. We will select the best demo(s) Criteria is under discussion. Notes.
Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.
PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
International Grid Trust Federation Session GGF 20 Manchester, UK Wednesday, May CAOPS-WG session #2.
Does the implementation give solutions for the requirements? Flexibility GridRPC enables dynamic join/leave of QM servers. GridRPC enables dynamic expansion.
CERN Summary Ian Bird eInfrastructure Workshop 9 December, 2003.
An overview of the EGEE project Bob Jones EGEE Technical Director DTI International Technology Service-GlobalWatch Mission CERN – June 2004.
GEODE Workshop 16 th January 2007 Issues in e-Science Richard Sinnott University of Glasgow Ken Turner University of Stirling.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
National Institute of Advanced Industrial Science and Technology ApGrid: Current Status and Future Direction Yoshio Tanaka (AIST)
International Workshop APAN 24, Current State of Grid Computing Researches and Applications in Vietnam Nguyen Thanh Thuy 1, Nguyen Kim Khanh 1,
National Institute of Advanced Industrial Science and Technology Introduction to Grid Activities in the Asia Pacific Region jointly presented by Yoshio.
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
UK GRID Firewall Workshop Matthew J. Dovey Technical Manager Oxford e-Science Centre.
DoSon Grid Computing School, Current State of Grid Computing Researches and Applications in Vietnam Vu Duc Thi 1, Nguyen Thanh Thuy 2, Tran Van.
Kento Aida, Tokyo Institute of Technology Grid Challenge - programming competition on the Grid - Kento Aida Tokyo Institute of Technology 22nd APAN Meeting.
PRAGMA: Cyberinfrastructure, Applications, People Yoshio Tanaka (AIST, Japan) Peter Arzberger (UCSD, USA)
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.
Australian Access Federation and other Middleware Initiatives Presented at TF-EMC2, Prague 4 Sep 2007 Patty McMillan, The University of Queensland.
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
GGF12 – 20 Sept LCG Incident Response Ian Neilson LCG Security Officer Grid Deployment Group CERN.
National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
The HEPiX IPv6 Working Group David Kelsey EGI TF, Prague 18 Sep 2012.
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Kento Aida, Tokyo Institute of Technology Grid Committee meeting Aug. 25 th, 2005 Taipei Kento Aida.
OSG Tier 3 support Marco Mambelli - OSG Tier 3 Dan Fraser - OSG Tier 3 liaison Tanya Levshina - OSG.
Connecting Advanced Networks in Asia-Pacific Kilnam Chon APAN Focusing on Applications -
Introduction. Background Founded in Geneva in 2002 as a linux training company, EBA Business Partner Sept 08 Now delivering on the largest Open Source.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
National Institute of Advanced Industrial Science and Technology APGrid PMA: Stauts Yoshio Tanaka Grid Technology Research Center,
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
WP6: Authorization Service Workshop in Eger Marcin Adamski, Michał Chmielewski, Sergiusz Fonrobert, Jarek Nabrzyski and Tomasz Ostwald Poznań Supercomputing.
Infrastructure areas Middleware – deployment - development Computer resources (incl hardware) Networking.
Pacific Rim Application and Grid Middleware Assembly: PRAGMA A community building collaborations and advancing grid-based applications Peter Arzberger,
DataGRID Testbed Enlargement EDG Retreat Chavannes, august 2002 Fabio HERNANDEZ
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
Kento Aida, Tokyo Institute of Technology Grid Working Group Aug. 29 th, 2003 Tokyo Institute of Technology Kento Aida.
Kento Aida, Tokyo Institute of Technology Grid working group meeting Jan. 26 th, 2005 Bangkok.
Welcome to the Grid Middleware Workshop ☆ Joint workshop of Grid WG and Middleware WG Middleware Working Group at a glance 20 th APAN (Taipei, Aug. 2005)
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
National Institute of Advanced Industrial Science and Technology GGF12 Workshop on Operational Security for the Grid Cross-site authentication and access.
Enabling Grids for E-sciencE Software installation and setup Viet Tran Institute of Informatics Slovakia.
Grid Interoperability Update on GridFTP tests Gregor von Laszewski
Thoughts on International e-Science Infrastructure Kevin Thompson U.S. National Science Foundation Office of Cyberinfrastructure iGrid2005 9/27/2005.
National Institute of Advanced Industrial Science and Technology Developing Scientific Applications Using Standard Grid Middleware Hiroshi Takemiya Grid.
APGrid PMA face-to-face meeting, 9/16/2008 PRAGMA-UCSD CA Team Pacific Rim Application and Grid Middleware Assembly
1 CREATING AND MANAGING CERT. 2 Internet Wonderful and Terrible “The wonderful thing about the Internet is that you’re connected to everyone else. The.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
Kento Aida, Tokyo Institute of Technology Joint Meeting Grid activities committee and Grid working group Jan. 28 th, 2004 Honolulu.
GRIDSTART a European GRID coordination attempt Fabrizio Gagliardi CERN.
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
Bob Jones EGEE Technical Director
Vietnam Research and Education Network (vinaREN)
Ian Bird GDB Meeting CERN 9 September 2003
Connecting the European Grid Infrastructure to Research Communities
MDS2 alpha Testing Phase
Presentation transcript:

National Institute of Advanced Industrial Science and Technology ApGrid: Asia Pacific Partnership for Grid Computing - Introduction of testbed development efforts in Asia Pacific Region - Yoshio Tanaka

Asia Asia Grid Initiative North America Europe International Collaboration Standardization Possible Applications on the Grid Bio Informatics ( Rice Genome, etc. ) Earth Science ( Weather forecast, Fluid prediction, Earthquake prediction, etc. ) ApGrid Testbed International Grid Testbed over the Asia Pacific countries ApGrid focuses on  Sharing resources, knowledge, technologies  Developing Grid technologies  Helping the use of our technologies in create new applications  Collaboration on each others work

History of ApGrid ApGrid Exhibition at HPCAsia ( Gold Coast, Australia) ApGrid Exhibition / SC Global Event at SC 2001 ( Denver, USA) 1 st ApGrid Core Meeting (Phuket, Thailand) 1 st ApGrid Workshop (Tokyo, Japan) 2 nd ApGrid Workshop / 2 nd ApGrid Core Meeting (Taipei, Taiwan) 2000 Kick-off meeting (Yokohama, Japan) Presentation at GF5 (Boston, USA) ApGrid Exhibition at SC 2002 ( Baltimore, USA) 15 countries, 41 organizations (as of Aug, 2003) 2003 We are here ApGrid Demo at CCGrid 2003 (Tokyo, Japan)

ApGrid Testbed – features - Truly multi national/political/institutional VO not an application-driven testbed differences in languages, culture, policy, interests, Donation (Contribution) based Not a single source funded for the development Each institution contributes his own share grass-roots approach We can have experiences on running international VO verify the feasibility of this approach for the testbed development

ApGrid Testbed – implementation - Use Globus Toolkit Ver.2 as a common software GSI based security infrastructure Build MDS tree ApGrid CAs ’ ApGrid allows multiple root CAs Trying to build trust-relationship between CAs ApGrid MDS ApGrid MDS is running on mds.apgrid.org planning to run more top-level MDS and cross- register resources

ApGrid Testbed: Status

Lessons Learned We have to pay much efforts for initiation Problems on installation of GT2/PBS/jobmanger Installation/configuration of GT2/PBS/jobmanager is still not so easy for application people. Most sites needed help for the installation. Software requirements depends on the application and middleware used by the application. In order to run GridRPC (Ninf-G) applications, I asked Open firewall/TCP Wrapper Additionally build Info SDK bundle with gcc32dbg Install Ninf-G change configuration of xinetd/inetd Enable NAT

Lessons Learned (cont ’ d) MDS is not scalable and still unstable Terrible performance GIIS lookup takes several ten seconds ~ minutes Some parameters in grid-info-slapd.conf such as sizelimit, timeout, cahcettl, etc., should be set to appropriate values depends on your environment (number of registered objects, network performance between GRISes and GIISes, etc.). Well known problem Well known problem Firewall, private IP addresses …

Lessons Learned (cont ’ d) Difficulties caused by the grass-roots approach. It is not easy to keep the GT2 version coherent between sites. Different requirements for the Globus Toolkit between users. Middleware developers needs the newest one. Application developers satisfy with using the stable (older) one. It is not easy to catch up frequent version up of the Globus Toolkit. CoG is a current problem 

Lessons Learned (cont ’ d) Difficulties caused by the grass-roots approach (cont ’ d) Most resources are not dedicated to the ApGrid Testbed. (though this is a common problem for Grids) There may be busy resources Need grid level scheduler, fancy Grid reservation system?

Lessons Learned (cont ’ d) Some resources are not stable example: If I call many RPCs, some of them fails (but sometimes all will done) not yet resolved GT2? Ninf-G? OS? Hardware? Other instability System maintenance (incl. version up of software) without notification realized when the application would fail. it worked well yesterday, but I ’ m not sure whether it works today But this is the Grid But this is the Grid

Relation to other international activities Contribution to APAN and PRAGMA APAN: Asia Pacific Advanced Network Network people + application people + Grid people Plan to reform ApGrid under APAN PRAGMA: Pacific-Rim Application and Grid Middleware Assembly PRAGMA is focusing on applications Provide ApGrid Testbed for their applications Activities at the GGF Production Grid Management RG Draft a Case Study Document (ApGrid Testbed) Groups in the Security Area CAOPs (Grid PMA) Discuss about the policy management Grid Federation RG (1 st BOF at GGF9) Discuss federation of Grid I ’ ll be a co-chair

Summary Difficulties are caused by not technical problems but sociological/political problems Each site has its own policy account management firewalls trusted CAs … Differences in interests / expertise Application, middleware, networking, etc. Differences in culture, language, etc. Human interaction is very important

Summary (cont ’ d) What has been done? Resource sharing between more than 10 sites (around 500cpus) Use GT2 as a common software Run Ninf-G applications What hasn ’ t? I could use, but it is difficult for others I was given an account at each site by personal communication Formalize “ how to use the Grid Testbed ” Provide documentation Define ApGrid Policy for international collaboration Keep the testbed stable Tools for management Browse information CA/Cert. management

For more info Home Pagehttp:// Mailing Lists Core Member Tech. Contacts (approved members) ML for (open for anyone)