Cindy Zheng, PRAGMA 11, 10/16/2006 Resources Group P acific R im A pplication and G rid M iddleware A ssembly

Slides:



Advertisements
Similar presentations
PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Advertisements

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
OSG All Hands, 3/5/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University.
Update Progress Since PRAGMA 9 Bringing the Grid to Coastal Zones Townsville PRAGMA – 28 March 2006.
CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Reports from Resource Breakout PRAGMA 16 KISTI, Korea.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29, 2009.
Steering Committee Meeting Summary PRAGMA 18 4 March 2010.
Investment for the Future of PRAGMA Progress Since PRAGMA 10: PRAGMA 11 Osaka University 15 – 17 October 2006.
PRAGMA 10 Townsville, Australia Re-Capping John OCallaghan APAC.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Thanks to All of the Sponsors: –APAC, QPSF, AARNET, Grangenet, SGI, Nexium, ReefHQ, Sun Local Coordinators: Ian Atkinson and his many helpers Kathryn Ottaway.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Resources WG Update PRAGMA 9 Hyderabad. Status (in 1 slide) Applications QMMD (AIST) Savannah (MU) iGAP (SDSC, AIST) Middleware Gfarm (AIST) Community.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.
Cindy Zheng, Pragma Grid, 5/30/2006 The PRAGMA Testbed Building a Multi-Application International Grid Cindy Zheng P acific R im A pplication and G rid.
PRAGMA 11 Biosciences Working Group Activities Raj Chhabra Wilfred W. Li, Ph.D. Habibah Wahab, Ph.D.
Resource/data WG Summary Yoshio Tanaka Mason Katz.
2 nd APGrid PMA F2F Meeting Osaka University Convention Center October 15 09: :20 # Participants: 26.
Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.
PRAGMA Update 21 October 2005 Hyderabad. PRAGMAs Founding Motivations – Updated 2005 The grid is transforming e-science: computing, data *, and collaboration.
Resource WG Report. Projects Applications EOL Ninf-G Climate model GridBlast GOC Gangla / SCMSWeb => Uniform Database Goodness Status map (e.g. IVDGL)
PRAGMA Institute, 9/26/2007 Cindy Zheng, David Abramson, Peter Arzberger, Shahaan Ayyub, Colin Enticott, Slavisa Garic, Wojtek Goscinski, Mason J. Katz,
PRAGMA Summit, 3/17/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly
National Institute of Advanced Industrial Science and Technology Advance Reservation-based Grid Co-allocation System Atsuko Takefusa, Hidemoto Nakada,
Biosciences Working Group Update & Report Back Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29,
CCGrid 2006, 5/19//2006 The PRAGMA Testbed Building a Multi-Application International Grid San Diego Supercomputer Center / University of California, San.
GIN Testbed Status 5/11/2006 Peter Arzberger, Cindy Zheng
Cindy Zheng, SC2006, 11/12/2006 Cindy Zheng PRAGMA Grid Testbed Coordinator P acific R im A pplication and G rid M iddleware A ssembly San Diego Supercomputer.
ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,
GRID COMPUTING AND SOME RESEARCH ISSUES IN DEVELOPMENT GEOGRID AT VAST Dao Van Tuyet Department for Computational & Knowledge Engineering.
Updates of the APGrid PMA Catania March 3, 2009 Yoshio Tanaka APGridPMA Chair, AIST, Japan.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
Pacific Rim Application and Grid Middleware Assembly - PRAGMA: An Overview of Past and Future Catalyzing Global Team Science PRIME, PRIUS, GLEON Peter.
Overview of PRAGMA View to the Future Examples of Team Science and Global Engagement in Asia Pacific and South Asia Peter Arzberger Philip Papadopoulos.
Global Lake Ecological Observatory Network - GLEON: Catalyzing Global Team Science based on PRAGMA Peter Arzberger Tim Kratz, Fang-Pang Lin Philip Papadopoulos,
CANS2006, 12/7/2006 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of.
PRAGMA21 – PRAGMA 22 Collaborative Activities Resources Working Group.
PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.
Cindy Zheng, PRAGMA9, 10/21/2005 PRAGMA Grid Testbed & Routine-basis Experiments May – October 2005 Cindy Zheng Pacific Rim Application and Grid Middleware.
Cindy Zheng, Pragma Cloud, 3/20/2013 Building The PRAGMA International Cloud Cindy Zheng For Resources Working Group.
PRAGMA: Cyberinfrastructure, Applications, People Yoshio Tanaka (AIST, Japan) Peter Arzberger (UCSD, USA)
Bioinformatics Grid-based Applications and IOIT-HCM Grid Tran Van Lang, Do Van Long Members of VNGrid Project HCM City Institute of Information Technology.
24th APAN Meeting, Xian, China - August 2007 e-Science on VNGrid Project Tran Van Lang, Do Van Long Members of VNGrid Project HCM City Institute of Information.
Status of PRAGMA Activities at KISTI Jongbae Moon 1.
Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.
Cindy Zheng, Geon Workshop, 7/20/2006 PRAGMA Grid A Multi-Application Route-Use Global Grid Cindy Zheng PRAGMA Grid Coordinator P acific R im A pplication.
National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware Assembly San Diego Supercomputer Center.
1 The state of Grid computing in Vietnam, and which aims the VNGrid Project wants to reach Dr. Lang Van, Tran HCM City Institute of Information Technology.
National Institute of Advanced Industrial Science and Technology Recent activities on building a production Grid in the Asia Pacific Region - PRAGMA routine-basis.
APGrid PMA face-to-face meeting, 4/8/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng, SDSC, USA Yusuke Tanimura, AIST, Japan Pacific Rim Application Grid Middleware.
PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.
PRAGMA 10 Biosciences Working Group Update Habibah Wahab, Ph.D Wilfred W. Li, Ph.D. On behalf of Karpjoo Jeong, Ph.D.
Routine-Basis Experiments in PRAGMA Grid Testbed Yusuke Tanimura Grid Technology Research Center National Institute of AIST.
Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng, SDSC, USA Yusuke Tanimura, AIST, Japan Pacific Rim Application Grid Middleware.
Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)
National Institute of Advanced Industrial Science and Technology APGrid PMA: Stauts Yoshio Tanaka Grid Technology Research Center,
Pacific Rim Application and Grid Middleware Assembly: PRAGMA A community building collaborations and advancing grid-based applications Peter Arzberger,
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
Thoughts on International e-Science Infrastructure Kevin Thompson U.S. National Science Foundation Office of Cyberinfrastructure iGrid2005 9/27/2005.
APGrid PMA face-to-face meeting, 9/16/2008 PRAGMA-UCSD CA Team Pacific Rim Application and Grid Middleware Assembly
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
Updates of the APGrid PMA
Presentation transcript:

Cindy Zheng, PRAGMA 11, 10/16/2006 Resources Group P acific R im A pplication and G rid M iddleware A ssembly Progress Since PRAGMA 10

Cindy Zheng, PRAGMA 11, 10/16/2006 PRAGMA Grid Testbed AIST OSAKAU TITECH Japan CNIC GUCAS China KISTI Korea ASCC NCHC Taiwan UoHyd India MU Australia BII IHPC NGO Singapore KU NECTEC Thailand NCSA USA SDSC USA CICESE Mexico UNAM Mexico UChile Chile QUT Australia UZurich Switzerland JLU China MIMOS USM Malaysia IOIT-HCM Vietnam BU USA UMC USA 30 Clusters from 27 institutions in 14 countries

Cindy Zheng, PRAGMA 11, 10/16/2006 PRAGMA Grid Resources

Cindy Zheng, PRAGMA 11, 10/16/2006 Applications Achieved long run and scientific results –Savannah/Nimrod, MU, Australia –FMO/Ninf-G, AIST, Japan Successful run –MM5/Mpich-Gx, CICESE/KISTI, Mexico/KISTI 11 applications continue run in testbed –Savannah: climate model, MU, Australia –MM5: climate model, CICESE, Mexico –QM-MD, FMO: quantum-mechanics, AIST, Japan –iGAP: genomics, UCSD, USA –HPM: genomics, IOIT-HCM, Vietnam –mpiBlast: genomics, ASCC, Taiwan –Gamess-APBS: organic chemistry, UZurich, Switzerland –Siesta: molecular simulation, UZurich, Switzerland –Amber: molecular simulation, USM, Malaysia

Cindy Zheng, PRAGMA 11, 10/16/2006 Grid Security IGTF (OGF) –APGrid PMA, site-CAs are IGTF accredited –AIST, ASGC, CNIC, KISTI, NCSA PRAGMA CA –Naregi-CA, APGrid, UChile, … –Experimental CA in use for users/hosts –Working on production CA under APGRID PMA GAMA and Naregi-CA integration –GAMA, –User private key issue

Cindy Zheng, PRAGMA 11, 10/16/2006 Grid Application Middleware Ninf-G (AIST, Japan) –3 applications (TDDFT, QMMD, FMO) –Uchile working on a bioinformatic application –Achieved long runs (1 week ~ 50 days) –Improved fault-tolerance (papers) –Simplified deployment procedures –Speed-up development cycles Nimrod/G (Monash University, Australia) –3 applications (Savanah, Gamess, Siesta) –Achieved long runs (90 different scenarios of 6 weeks each –Improved fault-tolerance –Enhanced scheduling augorithms Mpich-Gx (KISTI, Korea) –2 applications (MM5 and WRF, CICESE) –Use private ip nodes for grid computing –Improved fault tolerance –Demonstrate performance

Cindy Zheng, PRAGMA 11, 10/16/2006 Infrastructure Middleware Gfarm (AIST, Japan) –First phase Gfarmfs-FUSE deployment AIST, SDSC, Tsukuba, NCHC –Applications: iGAP (SDSC), GriddLeS (MU), … SCMSWeb (KU, Thailand) –Deployed to 26 sites –Many new features, enhancements MOGAS (NTU, Singapore) –Deployed to 17 sites –Will continue and setup server on goc AMPlet (Waikato University, New Zealand) –Deployed to 4 sites –Will continue

Cindy Zheng, PRAGMA 11, 10/16/2006 Meta-schedulers Community Scheduler Framework (CSF) – JLU, China –Support GT2,4, GRAM or WS, SGE/PBS/LSF –Tested with iGAP, next in testbed –New release –Resource info (now conf file, future MDS) –Schedule algorithm (now round-robin, future dynamic) Multi-Resource Scheduling (MRS) – IHPC, Singapore –Dynamic estimation (statistics, simulations, algorisms) –Predict, schedule, backfill Dynamic co-allocation –Grid Unified Remote (GUR) - SDSC, USA –SGE extention - AIST, Japan Advance Reservation-based Grid Co-allocation System – AIST, Japan CSF

Cindy Zheng, PRAGMA 11, 10/16/2006 Application Services Bioportal (QUT/SDSC/PRIUS) Computational Grid Portal (NCHC) CSF portal (JLU/SDSC) CSE-online (UUtah) –Tested Gamess with 3 sites: SDSC, NCSA, AIST –Next – more sites, Amber, Sander

Cindy Zheng, PRAGMA 11, 10/16/2006 Sharing With Grid Communities CCGrid 2006 –3 out of 4 keynotes were given by PRAGMA members Phil Papadopoulos (SDSC) Satoshi Sekiguchi (AIST) Jysoo Lee (KISTI) –Paper presented by PRAGMA members Cindy Zheng, David Abramson, Peter Arzberger, Shahaan Ayyub, Colin Enticott, Slavisa Garic, Mason J. Katz, Jae-Hyuck Kwak, Bu Sung Lee, Phil M. Papadopoulos, Sugree Phatanapherom, Somsak Sriprayoonsakul, Yoshio Tanaka, Yusuke Tanimura, Osamu Tatebe, Putchong Uthayopas, "The PRAGMA Testbed - Building a Multi- Application International Grid," ccgrid, p. 57, David Abramson, Amanda Lynch, Hiroshi Takemiya, Yusuke Tanimura, Susumu Date, Haruki Nakamura, Karpjoo Jeong, Suntae Hwang, Ji Zhu, Zhong-hua Lu, Celine Amoreira, Kim Baldridge, Hurng-Chun Lee, Chi-Wei Wang, Horng-Liang Shih, Tomas Molina, Wilfred W. Li, Peter W. Arzberger, "Deploying Scientific Applications to the PRAGMA Grid Testbed: Strategies and Lessons," ccgrid, pp , Bu-Sung Lee, Ming Tang, Junwei Zhang, Ong Yew Soon, Cindy Zheng, Peter Arzberger, David Abramson, "Analysis of Jobs in a Multi-Organizational Grid Test- bed," ccgrid, p. 59, Weicheng Huang, Chien-Lin Huang, Chien-Heng Wu, "The Development of a Computational Grid Portal," ccgrid, p. 56, Other publications –Arzberger, P., Papadopoulos, P. "PRAGMA: Example of Grass-Roots Grid Promoting Collaborative e-Science Teams," CTWatch Quarterly, Volume 2, Number 1, February 2006.

Cindy Zheng, PRAGMA 11, 10/16/2006 PRAGMA/GEON Collaboration GEON workshop (Beijing, July 2006) –PRAGMA: Satoshi Sekiguchi, Kai Nan, Cindy Zheng –GEON: Chaitan B., Mian Liu, Huai Zhang, … –Sharing data, software know-how and computing resources –Run geoscience application (co-allocation issue) Near term – run on cluster, but pull and use distributed data Future – needs meta-scheduler can do reservation Actions –GUCAS completed a compute cluster setup geon roll installed Is a member of PRAGMA testbed –CNIC working with GEON team on setting up a data node Will be a part of PRAGMA testbed Will share data with GEON data nodes

Cindy Zheng, PRAGMA 11, 10/16/2006 Grid Interoperation Now (GIN) GIN testbed (started Feb. 2006) –PRAGMA, TeraGrid, EGEE, OSG, NorduGrid Applications –TDDFT/Ninf-G Lead: Yoshio Tanaka, Yusuke Tanimura (AIST, Japan) Deployed and run –PRAGMA - AIST, NCSA, SDSC –TeraGrid – ANL –OSG – UCSD –NordiGrid Working on deployment to EGEE –Savanah Study (data intensive) Lead: Colin Enticott (MU, Australia) In preparation

Cindy Zheng, PRAGMA 11, 10/16/2006 Grid Interoperation Now (GIN) [2] Somsak Sriprayoonsakul, Sugree Phatanapherom, (KU, ThaiGrid) Infrastructure testing matrix –Test 7 clusters from 5 grids –New version to handle various grid service configurations/tests GIN map –implemented a XML-> LDIF translator for GIN map Cross-grid monitoring –Common schema operation_Now%29_Monitoring

Cindy Zheng, PRAGMA 11, 10/16/2006 Thank You