Pacific Rim Application and Grid Middleware Assembly Wireless Sensor Networks and Their Applications in the Environment 29 January 2004 Peter Arzberger, UCSD Philip Papadopoulos, UCSD pragma -grid.net A community building collaborations and advancing grid-based applications

Founding Motivations The grid is transforming computing and collaboration The problem remains that the grid is too hard to use Middleware software needs to interoperate Science is an intrinsically global activity IVOA

PRAGMA PARTNERS Affiliate Member

Participating Institutions –Academia Sinica Computer Centre –Asia-Pacific Advanced Network (Affiliate Member) –Australia Partnership for Advanced Computing and its partners –Bioinformatics Institute of Singapore, part of Agency for Science and Technology and Research –Center for Computational Physics, University of Tsukuba –Computer Network Information Center, Chinese Academy of Sciences –Cray Inc (Industrial Affiliate Member) –Global Scientific Information and Computing Center, Tokyo Institute of Technology –Grid Technology Research Center, National Institute of Advanced Industrial Science and Technology –Kasetsart University –Korea Institute of Science and Technology Information –National Center for High Performance Computing –National Center for Supercomputing Applications –Research Center for Ultra-High Voltage Electron Microscopy and the Cybermedia Center, Osaka University –STAR TAP/StarLight initiative, supported by NSF and organized by the University of Illinois at Chicago, Northwestern University and Argonne National Laboratory –Thai Social/Scientific Academic and Research Network (ThaiSARN-3), National Electronics and Computer Technology Center –TransPAC initiative, supported by NSF at Indiana University –Universiti Sains Malaysia –University of California, San Diego and SDSC, CalIT 2, CRBS, NLANR –University of Hyderabad

Overarching Goals Establish sustained collaborations and Advance the use of the grid technologies for applications among a community of investigators working with leading institutions around the Pacific Rim PRAGMA Working closely with established activities that promote grid activities or the underlying infrastructure, both in the Pacific Rim and globally.

Fifth PRAGMA Workshop NCHC Hsinchu, Taiwan

PRAGMA Success Stories Grid Community Pulls together to Battle SARS Merging Grid Technology and Computational Chemistry Telescience Marshals Rich Network of Technologies at iGRID2002 Grid Demo Sets US to Japan Data Speed Records EcoGrid Encyclopedia of Life grid.net/ SC03 BWC App Award

PRAGMA: Telescience Highlights at SC03 Full IPv6 Compliance Project wide compliance with IPv6 for both video (via DV and HDTV) and data transfer (GridFTP) has been demonstrated at iGrid2002 and SC2003, highlighting globally distributed PRAGMA collaborations. (only entrant to use IPv6 Protocols, susptain 1.13 Gbps) OGSA Compliant Instrumentation Control An OGSA/GT3 compliant, generalized web-service based Telemicroscopy architecture has been demonstrated to control UHV-TEM at KBSI, and NCMIR/UCSD based microscopes. Integration w/ the UHVEM in Osaka is underway. Grid Compliant Telescience Portal Interface A generalized Telescience Portal installation package is available for download and compliant with current Grid standards. The Telescience Portal has been adopted by KBSI e-Science Grid. Integration and distribution of PRAGMA Applications NCMIR/UCSD Gtomo has been distributed to KBSI to be integrated with e-Science Portal. NCHC Level Set Segmentation Suite is being integrated with Telescience Portal.

File replication performance between Japan and US (total) National Institute of Advanced Industrial Science and Technology Source: Osamu Tatebe Stable transfer rate of 3.79Gbps out of theoretical peak 3.9 Gbps (97%) using 11 node pairs (MTU 6000B) 1.5TB data was transferred in an hour Participants:Maffin, APAN, NII, Abilene, Tsukuka, SuperSINET, Force10 Netowrks, PRAGMA, ApGrid, SDSC, TransPAC/Indiana U, Kasetshart U Astronomical Object Survey Subaru Tele- Scope [AIST] Lattice QCD [CCP, U Tsukuba]

Climate simulation using Ninf-G 3D Visualization System (by NCHC) Client (AIST) Weather Portal Ninf-G …… Results on the Web Courtesy Yoshio Tanaka : GridRPC System based on the Globus Toolkit Enables Large Scale Computing Across Supercomputers on the Grid

MOE NPUST NDHU NCHC-HQ NCHC-CENTRAL NCHC-SOUTH EcoGrid: Fushan Liberty Time 2003 March 09 United Daily 2003 March 09

LTER-AND Corvallis, OR SDSC La Jolla, CA LTER-VCR Charlottesville, VA CNIC / CAS Beijing, China NARC Tsukuba, Japan NCHC Hsinchu, Taiwan SOAP / XML JDBC JDBC / EML JDBC - SOAP Servers where web services are deployed - Database Servers where data sources are hosted HTTP - Sensor Data from web cam deployed at fields Sensors in North Temperate Lakes: Trout Lake, Allequash Lake, Big Muskellunge, Sparking Lake, Crystal Lake etc. I2G Web Services Infrastructure and Sensor- based Lake Monitoring and Analysis Understanding Impacts of Episodic Events in Lake Metabolism Sensors in Yuan Yang Lake LTER-NTL Madison, WI

I2G Architecture Internet GeMS Mediator Services Internet HTTP/SOAP …… Metadata Information System Application Clients Middle Tier Services Data Services & Data Sources HTTP/SOAP NTL Data Services Oracle JDBC EML describe HTTP HTTP/SOAP VCR Data Services mySQL JDBC AND Data Services SQL Server JDBC …… HTTP / SOAP LTER Network Sites MetBroker Java MetBroker Weather DBs …… RMI JDBC/FTP MetSOAP Services TERN DBs JDBC NCHC Data Services Weather DBs JDBC CNIC / CAS Data Services PRAGMA International Partners HTTP / SOAP Lake data: Temp, DO, Chla etc

Architecture, technology Architecture, technology Based on GT2 Based on GT2 Allow multiple CAs Allow multiple CAs Build MDS Tree Build MDS Tree Grid middleware/tools from Asia Pacific Grid middleware/tools from Asia Pacific Ninf-G (GridRPC programming) Ninf-G (GridRPC programming) Nimrod-G (parametric modeling system Nimrod-G (parametric modeling system) SCMSWeb (resource monitoring) Grid Data Farm (Grid File System), etc. Status Status 26 organizations (10 countries) 27 clusters (889 CPUs) ApGrid/PRAGMA Testbed Courtesy: Yoshio Tanaka

PRAGMA Testbed Affiliate Member

Testbed and the Resources/Middleware Working Group Bottom-up approach on hardware –Most systems linux-based –More than 240 nodes across 15 (or more) sites –Work with ApGrid ( –Contrast with TeraGrid Agreement to Participate: –Minimum software requirement to join (e.g. Globus 2.2) –Need to exchange certificates with all other sites Goodness Index –Format provides a way to document a minimal level of interoperability Technical and Policy Issues –Compatibility of basic middleware (versions of Globus) –What other software to have at all sites Which of competing software to have Where are the incompatible software Can software be packaged for easy installation –Tracking users –Monitor system dynamically (and update “degree of interoperability of system) Challenges –Run applications on grid on routine basis (only a few at first) –Capture rough measure of usage (international resource) –What does it mean to dedicate a resource to an international group (with national funding supporting the resource)?

Steering Committee Came into effect 25 Feb 2003 John O’Callahan, David Abramson, Bernard Pailthorpe: APAC Larry Ang: BII Baoping Yan, Kai Nan: CAS/CNIC Satoshi Matsuoka: TITech/GSICC Satoshi Sekiguchi, Yoshio Tanaka: AIST Jysoo Lee: KISTI Whey-Fone Tsai, Fang- Pang Lin: NCHC Shinji Shimojo: Osaka University/CMC Royol Chitradon, Piyawut Srichaikul: NECTEC Maxine Brown: StarTap Rick McMullen, Jim Williams: Habibah Wahab: U Sains Malaysia Philip Papadopoulos, Peter Arzberger: UCSD/SDSC/Cal- (IT) 2 /CRBS

Schedule of Meetings PRAGMA 4: 4-5 June 2003, Melbourne, Australia –ICCS2003: 3-4 June –David Abramson (APAC): Chair; Co-chair: Fang-Pang Lin (NCHC) PRAGMA 5: October 2003, Hsinchu/Fushan, Taiwan –Fang-Pang Lin (NCHC): Chair; Co-chair: Kai Nan (CNIC) PRAGMA 6: 16 – 18 May 2004, Beijing, China –Baoping Yan (CNIC): Chair; Co-chairs: Mason Katz (UCSD), Jim Williams (TransPAC) PRAGMA 7: September 2004, San Diego, USA –Chairs: Mason Katz (UCSD), Jim Williams (TransPAC)

Thank you pragma -grid.net