Promoting Global Collaborations through Cyberinfrastructure Peter Arzberger Philip Papadopoulos Chinese American Networking Symposium 1 December 2004 Pacific Rim Application and Grid Middleware Assembly
PRAGMA’s Founding Motivations The grid is transforming computing and collaboration The problem remains that the grid is too hard to use Middleware software needs to interoperate Science is an intrinsically global activity IVOA
PRAGMA PARTNERS Affiliate Member
Participating Institutions –Academia Sinica Computer Centre –Asia-Pacific Advanced Network (Affiliate Member) –Australia Partnership for Advanced Computing and its partners –Bioinformatics Institute of Singapore, part of Agency for Science and Technology and Research –Center for Computational Physics, University of Tsukuba –Computer Network Information Center, Chinese Academy of Sciences –Cray Inc (Industrial Affiliate Member) –Global Scientific Information and Computing Center, Tokyo Institute of Technology –Grid Technology Research Center, National Institute of Advanced Industrial Science and Technology –Kasetsart University –Korea Basic Science Institute –Korea Institute of Science and Technology Information –National Agriculture Research Center –National Center for High Performance Computing –National Center for Supercomputing Applications –National Grid Office Singapore –Research Center for Ultra-High Voltage Electron Microscopy and the Cybermedia Center, Osaka University –STAR TAP/StarLight initiative, supported by NSF and organized by the University of Illinois at Chicago, Northwestern University and Argonne National Laboratory –Thai Social/Scientific Academic and Research Network (ThaiSARN-3), National Electronics and Computer Technology Center –TransPAC initiative, supported by NSF at Indiana University –Universiti Sains Malaysia –University of California, San Diego and SDSC, CalIT 2, CRBS, NLANR, NCMIR –University of Hyderabad
Overarching Goals Establish sustained collaborations and Advance the use of the grid technologies for applications among a community of investigators working with leading institutions around the Pacific Rim PRAGMA Working closely with established activities that promote grid activities or the underlying infrastructure, both in the Pacific Rim and globally.
Sixth PRAGMA Workshop CNIC, Beijing China
Key Activities and Outcomes Encourage and conduct joint (multilateral) projects that promote development of grid facilities and technologies Share resources to ensure project success Conduct multi-site training Exchange researchers Advance scientific applications Create grid testbeds for regional e-science projects Contribute to the international grid development efforts Increase interoperability of grid middleware in Pacific Rim and throughout the world Activities Outcomes
PRAGMA Success Stories: 2003 Grid Community Pulls together to Battle SARS Merging Grid Technology and Computational Chemistry Telescience Marshals Rich Network of Technologies at iGRID2002 Grid Demo Sets US to Japan Data Speed Records EcoGrid Encyclopedia of Life grid.net/ SC03 BWC App Award
Contents: Overview Accomplishments PRIME Working Groups Institutions References Opportunities Sponsors
Accomplishments: Achieving Success through Partnership Telescience: KBSI, Software for camera Computational Chemistry: Nimrod/GAMESS- APBS/Kepler (ligand protein docking) EcoGrid and Lake Metabolism –Prototype International Lake Observatory –Coral Reef Sensing –Meeting on September 2004 (plan global lake observatory network; link coral reef experts) –Follow-on meeting March 2005 Gfarm and iGAP –Middleware Integration –Proteome Analysis Bandwidth Challenge Awards from SC03 –Distributed Infrastructure (Gfarm) –Application (Telescience) Middleware Interoperability –Rock Rolls, Ninf-G, Gfarm –KRocks krocks.cluster.or.kr KROCK Nov 04
A collaborative effort in the fight against bio-terrorism Gfarm makes it possible to use iGAP to analyze the complete proteome (available 9/28/04) of the bacteria, Burkholderia mallei, a known biothreat agent, on distributed international resources. This is a collaboration under PRAGMA and the data is available through
PRIME: Preparing Undergraduates for the Global Workforce Gabriele Wienhausen, Linda Feldman, Peter Arzberger Expanding PRAGMA Collaborations, Applications, and Successes Monash University - Australia Osaka University - Japan NCHC and NCREE - Taiwan
Distance Training – Project Based First activity with CNIC and UCSD Topic: Web Services – focused on climate data Language: Chinese 20 Researchers in CNIC
Working Groups: Integrating PRAGMA’s Diversity Telescience – including Ecogrid Biological Sciences: –Proteome Analysis using iGAP in Gfarm Data Computing –Online Data Processing of KEKB/Belle Experimentation in Gfarm Resources –Grid Operations center
Source: Cindy Zheng
Grid Testbed Participation USA - UCSD/SDSC (Mason Katz, Cindy Zheng) USA - NCSA (Radha Nandkumar, Tom Roney) Japan - AIST (Yoshio Tanaka, Yusuke Tanimura) Japan - TITECH (Satoshi Matsuoka, Shirose Ken'ichiro) Korea - KISTI (Jysoo Lee, Jae-Hyuck Kwak) Thailand - KU (Sugree Phatanapherom, Somsak Sriprayoonsakul) Malaysia - USM (Habibah Wahab, Bukhary Ikhwan Ismail) Taiwan - NCHC (WeiCheng Huang, Yu-Chung Chen) Taiwan - ASCC (Hurng-Chun Lee, Mike Chiang) Singapore - BII (Stephen Wong, Nigel Teow) Mexico - UNAM (Jose Luis Gordillo Ruiz, Eduardo Murrieta Leon) India - UoHyd (Arun Agarwal) Source: Cindy Zheng
Building a Production Grid Thru Running Applications Routine-basis experiments –Ninf-G based TDDFT, goc.rocksclusters.org/tddft/default.htmlhttp://pragma- goc.rocksclusters.org/tddft/default.html –BioGrid, goc.rocksclusters.org/biogrid/default.htmlhttp://pragma- goc.rocksclusters.org/biogrid/default.html –iGAP over Gfarm Learn requirements/issues Research/implement solutions Improve middleware integrations Source: Cindy Zheng
Lessons Learned Information sharing Trust and access Resource requirements User/application environment Job submission Resource/job monitoring Resource/job accounting Fault tolerance Source: Cindy Zheng
Collaborations Applications Global Grid Ninf-G SCMSWeb Easy To Use Rocks Middleware BioGrid TDDFT GXP Gfarm iGAP Source: Cindy Zheng
Members: Providing Expertise, Tools and Resources Hurng-Chen Lee, Academia Sinica Computing Centre (ASCC) Kento Aida, Asia Pacific Advanced Network (APAN) David Abramson, Australia Partnership for Advanced Computing (APAC) Taisuke Boku, Center for Computational Sciences (CSS), University of Tsukuba Shinji Shimojo, Cybermedia Center (CMC), Osaka University Yoshio Tanaka, Grid Technology Research Center (GTRC), National Institute of Advanced Industrial Science and Technology (AIST) Kum Won Cho, Korea Institute of Science and Technology Information (KISTI) Fang-Pang Lin, National Center for High-performance Computing (NCHC) Radha Nandkumar, National Center for Supercomputing Applications (NCSA) Maxine Brown, StarLight Initiative John Hicks, TransPAC, Indiana University Mason Katz, University of California San Diego Joint Presentations at SC’04 – NCHC booth
More Information Ninf-G: –Hiroshi Takemiya, Kazuyuki Shudo, Yoshio Tanaka, and Satoshi Sekiguchi. Constructing Grid Applications using Standard Grid Middleware, Journal of Grid Computing, 2004 (to appear). Grid Data Farm –Osamu Tatebe, Hirotaka Ogawa, Yuetsu Kodama, Tomohiro Kudoh, Satoshi Sekiguchi, Satoshi Matsuoka, Kento Aida, Taisuke Boku, Mitsuhisa Sato, Youhei Morita, Yoshinori Kitatsuji, Jim Williams, John Hicks, "The Second Trans-Pacific Grid Datafarm Testbed and Experiments for SC2003", Proceedings of 2004 International Symposium on Applications and the Internet - Workshops (SAINT 2004 Workshops), January 2004, Tokyo, JapanSAINT 2004 Workshops Nimrod and GAMESS: –W. Sudholt, K.K. Baldridge, D. Abramson, C. Enticott and S. Garic. Parameter Scan of an Effective Group Difference Pseudopotential Using Grid Computing. New Generation Computing, Vol.22 No 2 (Special Feature Grid Systems for Life Sciences). February –Sudholt, W., Baldridge, K., Abramson, D., Enticott, C. and Garic, S., Applying Grid Computing to the Parameter Sweep of a Group Difference Potential, The International Conference on Computational Sciences, ICCS04, Krakow Poland, June 6 - 9, EOL (including GridSpeed): –W.W. Li, R.W. Byrnes, J. Hayes, A. Birnbaum, V.M. Reyes, A. Shahab, C. Mosley, D. Pekurovsky, G.B. Quinn, I.N. Shindyalov, H. Casanova, L. Ang, F. Berman, P.W. Arzberger, M.A. Miller and P.E. Bourne. The Encyclopedia of Life Project: Grid Software and Deployment. New Generation Computing, Vol.22 No 2 (Special Feature Grid Systems for Life Sciences). February Accepted: – Atif Shahab, Danny Chuon, Toyotaro Suzumua, Wilfred W. Li, Robert W. Byrnes, Kouji Tanaka, Larry Ang, Satoshi Matsuoka, Philip E. Bourne, Mark A. Miller, Peter W. Arzberger Grid Portal Interface for Interactive Use and Monitoring of High-Throughput Proteome Annotation. First International Workshop on Life Science Grid (LSGRID2004) –Adam Birnbaum, James Hayes, Wilfred W. Li, Mark A. Miller1 Peter W. Arzberger4 Philip E. Bourne, Henri Casanova. Grid Workflow Software for High-Throughput Proteome Annotation Pipeline. First International Workshop on Life Science Grid (LSGRID2004)
More Information (2) Telescience: –Peltier ST, Lin AW, Lee D, Mock S, Lamont S, Molina T, Wong M, Martone ME, Ellisman MH (2003) The Telescience Portal for Advanced Tomography Applications. Journal of Parallel and Distributed Applications, Special Edition on Computational Grids 63(5): –Lee D, Lin AW, Hutton T, Akiyama T, Shinji S, Lin FP, Peltier S, Ellisman MH (2003) Global Telescience Featuring IPv6 at iGrid2002. Future Generation of Computer Systems, 19(6): Lakes Project: –New Wireless Sensory Network for Studing Lake Metabolism. The Network Newsletter Vol. 17 No.1 Spring PRAGMA Overview –P.W. Arzberger, A. Farazdel, A. Konagaya, L. Ang, S. Shimojo and R.L. Stevens, Life Sciences and Cyberinfrastructure: Dual and Interacting Revolutions that will Drive Future Science. New Generation Computing, Vol.22 No 2 (Special Feature Grid Systems for Life Sciences). February 2004 (Includes some information) –Cassie Ferguson, Pacific Rim Grid Group evolves into International Model of Collaboration. Envision, Vol 19 No 3 (July – Sept 2003). Pp –Peter Arzberger, Tony Fountain, Philip Papadopoulos. PRAGMA: the Pacific Rim Application and Grid Middleware Assembly. LTER Databits, The Information Management Newsletter of the Long Term Ecological Research Network. Spring Affiliated Activities –H. Nakamura, S. Date, H. Matsuda and S. Shimojo. A Challenge towards Next-Generation Research Infrastructure for Advanced Life Science. New Generation Computing, Vol.22 No 2 (Special Feature Grid Systems for Life Sciences). February 2004 –E. Tantoso, H.A. Wahab and H.Y. Chan. MOLECULAR DOCKING: An Example of Grid Enabled Applications. New Generation Computing, Vol.22 No 2 (Special Feature Grid Systems for Life Sciences). February
Steering Committee Came into effect 25 Feb 2003 John O’Callahan, David Abramson, Bernard Pailthorpe: APAC Larry Ang: BII Baoping Yan, Kai Nan: CAS/CNIC Satoshi Matsuoka: TITech/GSICC Satoshi Sekiguchi, Yoshio Tanaka: AIST Jysoo Lee: KISTI Whey-Fone Tsai, Fang- Pang Lin: NCHC Shinji Shimojo: Osaka University/CMC Royol Chitradon, Piyawut Srichaikul: NECTEC Maxine Brown: StarTap Rick McMullen, Jim Williams: TransPAC Habibah Wahab, Admad Yusoff Hassan: U Sains Malaysia Philip Papadopoulos, Peter Arzberger: UCSD/SDSC/Cal- (IT) 2 /CRBS
The PRAGMA Steering Committee
The Central Issue Collaborations - The foundation for global Grid Source: Cindy Zheng Interoperability - Involves people – starts with trust
Source: Jim Williams
Global Lambda Integrated Facility Predicted Bandwidth for Scheduled Experiments, December Visualization courtesy of Bob Patterson, NCSA. Source: Maxine Brown
Global Lambda Integrated Facility World Map – December 2004 Predicted international Research & Education Network bandwidth, to be made available for scheduled application and middleware research experiments by December Visualization courtesy of Bob Patterson, NCSA. Source: Maxine Brown
National Laboratory for Applied Network Research NLANR Measurement and Network Analysis Group –Passive Measurement and Analysis (PMA): Passive header trace data to study workload profiles –Active Measurement Project (AMP): Full mesh (each monitor testing to all the others) between the approximately 150 active monitors Across all sites, round trip time (RTT), packet loss, topology, and throughput (user/event driven) are currently measured. CNIC hosts monitor Upcoming release of new AMP software Contact Ronn Ritke,
Location of Measure Collaborations Groups AMP now in China Hosted by CNIC
MOE NPUST NDHU NCHC-HQ NCHC-CENTRAL NCHC-SOUTH EcoGrid: Fushan Liberty Time 2003 March 09 United Daily 2003 March 09 Source and Inspiration: FP Lin
Lake Metabolism: Aug 03 to Oct 04, March 05 Aug 03: La Jolla, Sensor Network Meeting Sep 03: Seattle, LTER meeting Oct 03: PRAGMA 5, trip to YYL Nov 03: Supplement to NSF Jan 04: Hawaii Feb 04: San Diego Workshop, Travel to NTL, Start VTC’s Apr 04: YYL Buoy Jul 04: Students in Taiwan, DC Aug 04: Typhoon in Taiwan! Sep 04: Environmental Sensor net Oct 04: New sensors, in Typhoon Mar 05: International Meeting to expand global network
Wind Speed (m/s) Barometric Pressure (mmHg) Water Temperature (C) Dissolved Oxygen Source: Yuan-Yang Lake and Typhoons Source: Tim Kratz
Virtual Observatories: Potential Collaboration Interest in US and China (CAS) SC’04: Demonstration: Sent 1.5 Tb of release three of Sloan Digital Sky Survey –First time data NOT shipped on disks. –Bob Grossman, UIC There needs to be –Researchers working together with networking folks –Persistent infrastructure to change way of research
Geosciences Network: Potential Collaboration Mission: prototype cyberinfrastructure for the Earth Sciences, based on close collaboration among IT and Earth Science researchers Linking models with data using data integration techniques Interested in creating an iGEON: China, Mexico, Australia, Canada, … PRIME Contributors
The GEONgrid PoP+Data Idaho ASU Partner Projects Chronos CUAHSI SCEC BrynMawr RiceU UNAVCO DLESE UofA Utah EGI Utah Ystone PennState VaTech PoP Node ESRI 1TF Cluster LLNL Partner Services Geological Survey of Canada USGS NASA Missouri SDSC PoP+Compute UTEP Driven by Two Testbeds Source: Chaitan Baru
Opportunities Postdocs and Graduate Student National Science Foundation (NSF) –International Research Fellowship Program (IRFP) –East Asia Pacific Summer Institute (EAPSI) Japan Society for the Promotion of Science (JSPS) –JSPS Postdoctoral Fellowship Korean Science and Engineering Foundation (KOSEF) –APEC Post-doctoral Fellowship in Science and Engineering
What are the main lessons/experiences that you can share with other members in the Internet2 community trying to do projects that involve international participation and connections? Take small steps to build trust; –Expand from that trust –Follow through Focus on common vision and outcomes, avoid politics –Don’t do everything for everyone Operate from principles (minimum set) –Follow procedures; no surprises if possible; be flexible; follow through Communicate –In the organization and with the outside world Share culinary and cultural experiences Support from funding agency instrumental Remain PRAGMA TIC
Observations about Starting an Organization: Andrew IBRCS Meeting 4-6 Sept 2003 Form a team: –Be constructive in comments –“Break Bread” –Keep meeting and talking –Celebrate your many eccentricities Focus: “like a hedgehog” while meeting other demands Stay flexible, room to improvise –In times of trouble – focus on unity and future vision, even if it means deferring difficult issues for a while Andrew Neitlich, The Sago Group,
Summary Dream big – build the imagination of those involved Start small - build trust Stay concrete – build infrastructure Focus on people – build community Opportunities: –Networking and Measurements –Testbed: Mutual learning –Applications: Geosciences, Astronomy, Ecology, Biomedicine, … –Exchange: Undergraduates and Graduates –Participate in Meetings and between meetings
Future Workshops PRAGMA 8 –BII and NGO Chair: Larry Ang, Co-Chair Arun Agarwal Dates: 2 May 2005 – Reception –Meeting 3, 4 May 2005 Grid Asia 2005 (2 – 6 May) PRAGMA 9 –University Hyderabad Chair: Arun Agarwal Dates: 20 October 2005 – Reception –Meeting October 2005
Thank you pragma -grid.net Office of International Science and Engineering Division of Shared Cyberinfrastructure Division of Biological Infrastructure