PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.

Slides:

Advertisements

Similar presentations

PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.

Advertisements

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.

Ronn Ritke Tony McGregor NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/SCI cooperative agreement no. ANI

Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.

PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

Reports from Resource Breakout PRAGMA 16 KISTI, Korea.

Resources WG Report Back. Account Creation Complaint –Too difficult to obtain user account on all resources Observations –Just ask Cindy and she will.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29, 2009.

Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.

Steering Committee Meeting Summary PRAGMA 18 4 March 2010.

Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Daejeon, Korea, March 24, 2009.

PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.

Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.

Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.

Cindy Zheng, PRAGMA 8, Singapore, 5/3-4/2005 Status of PRAGMA Grid Testbed & Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware.

Cindy Zheng, Pragma Grid, 5/30/2006 The PRAGMA Testbed Building a Multi-Application International Grid Cindy Zheng P acific R im A pplication and G rid.

Resource/data WG Summary Yoshio Tanaka Mason Katz.

1 Bio Applications Virtualization using Rocks Nadya Williams UCSD.

Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.

Biosciences Working Group Update & Report Back Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29,

CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding or College of Computer.

Gfarm v2 and CSF4 Osamu Tatebe University of Tsukuba Xiaohui Wei Jilin University SC08 PRAGMA Presentation at NCHC booth Nov 19,

CCGrid 2006, 5/19//2006 The PRAGMA Testbed Building a Multi-Application International Grid San Diego Supercomputer Center / University of California, San.

Cindy Zheng, SC2006, 11/12/2006 Cindy Zheng PRAGMA Grid Testbed Coordinator P acific R im A pplication and G rid M iddleware A ssembly San Diego Supercomputer.

ACOMP, 3/15/2007 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of California,

1 Applications Virtualization in VPC Nadya Williams UCSD.

PRAGMA Overview and Future Directions Workshop on Building Collaborations in Clouds, HPC and Applications 17 July 2012.

Virtualization in PRAGMA and Software Collaborations Philip Papadopoulos (University of California San Diego, USA)

PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.

PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.

Clouds, Interoperation and PRAGMA Philip M. Papadopoulos, Ph.D University of California, San Diego San Diego Supercomputer Center Calit2.

Progress Since PRAGMA 19 Planning for PRAGMA’s Future PRAGMA March2011 University of Hong Kong.

PRIME Pacific Rim Experiences for Undergraduate 24 November 2008 Information Session Gabriele Wienhausen Peter Arzberger.

PRIME Tutorial, 4/22/2009 Prime Tutorial 4/22/2011 Cindy Zheng For PRAGMA Grid/Cloud Team And the PRAGMA communities Pacific Rim Application and Grid Middleware.

CANS2006, 12/7/2006 Cindy Zheng Peter Arzberger Philip Papadopoulos Mason Katz P acific R im A pplication and G rid M iddleware A ssembly University of.

Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by AIST Sapporo, Japan, Oct 17-20, 2011.

PRAGMA21 – PRAGMA 22 Collaborative Activities Resources Working Group.

1 port BOSS on Wenjing Wu (IHEP-CC)

Cindy Zheng, Pragma Cloud, 3/20/2013 Building The PRAGMA International Cloud Cindy Zheng For Resources Working Group.

Updates of APGrid PMA 22 June, Members (15 + 1) 15 Accredited CAs AIST (JP) APAC (AU) ASGC (TW) CNIC (CN), SDG IGCA (IN) IHEP (CN) KEK (JP) KISTI.

PRAGMA 25 Working Group Report Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD)

Bioinformatics Grid-based Applications and IOIT-HCM Grid Tran Van Lang, Do Van Long Members of VNGrid Project HCM City Institute of Information Technology.

24th APAN Meeting, Xian, China - August 2007 e-Science on VNGrid Project Tran Van Lang, Do Van Long Members of VNGrid Project HCM City Institute of Information.

Status of PRAGMA Activities at KISTI Jongbae Moon 1.

E-AIRS Reporting and Issues Resource Working Group, PRAGMA 15 Jongbae Moon, Byungsang Kim, Kum Won Cho Korea Institute of Science and Technology Information.

Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.

CFD Cyber Education Service using Cyberinfrastructure for e-Science PRAGMA 15 DEMO SESSION Jongbae Moon Byungsang Kim

Cindy Zheng, Geon Workshop, 7/20/2006 PRAGMA Grid A Multi-Application Route-Use Global Grid Cindy Zheng PRAGMA Grid Coordinator P acific R im A pplication.

National Institute of Advanced Industrial Science and Technology Introduction of PRAGMA routine-basis experiments Yoshio Tanaka

3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.

Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng Pacific Rim Application and Grid Middleware Assembly San Diego Supercomputer Center.

APGrid PMA face-to-face meeting, 4/8/2008 Cindy Zheng PRAGMA Grid Coordinator Pacific Rim Application and Grid Middleware Assembly

PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.

Simplifying Resource Sharing in Voluntary Grid Computing with the Grid Appliance David Wolinsky Renato Figueiredo ACIS Lab University of Florida.

“Metagenomics Over Lambdas: Update on the CAMERA Project" Invited Talk 6 th Annual ON*VECTOR International Photonics Workshop UCSD February 27,

Building the PRAGMA Grid Through Routine-basis Experiments Cindy Zheng, SDSC, USA Yusuke Tanimura, AIST, Japan Pacific Rim Application Grid Middleware.

Reports on Resources Breakouts. Wed. 11am – noon - Openflow demo rehearsal - Show physical information. How easily deploy/configure OpenvSwitch to create.

Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)

Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.

SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.

NTU Cloud 2010/05/30. System Diagram Architecture Gluster File System – Provide a distributed shared file system for migration NFS – A Prototype Image.

Thoughts on International e-Science Infrastructure Kevin Thompson U.S. National Science Foundation Office of Cyberinfrastructure iGrid2005 9/27/2005.

National Institute of Advanced Industrial Science and Technology Developing Scientific Applications Using Standard Grid Middleware Hiroshi Takemiya Grid.

PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.

PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.

Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.

Update of APGridPMA Eric Yen 25 th EUGridPMA & IGTF All Hands Meeting KIT, Germany 7 May, 2012.

Biosciences Working Group Update

Updates of the APGrid PMA

Presentation transcript:

PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group

Works by PRAGMA21 VM issues – Supporting cluster environments E.g. Condor (as a batch scheduler) + MPI – Expand three sites to more IU, ASTI, Monash, Osaka, Tsukuba – TBC: LZU, MIMOS, USM, Create their own VM images Start with F-Motif and Bloss – VM repository to share VM images Use Gfarm as back end Deploy Gfarm at San Diego by the end of March – San Diego, AIST, Tsukuba – From prototyping to production What is the real scenario? – Contribution by HKU Live migration on PRAGMA? Possible collaboration between HKU and AIST Start Beginning of May Start with HK, JP, US

PRAGMA Grid/Clouds 26 institutions in 17 countries/regions, 23 compute sites, 10VM sites UZH Switzerland NECTEC KU Thailand UoHyd India MIMOS USM Malaysia HKU HongKong ASGC NCHC Taiwan HCMUT HUT IOIT-Hanoi IOIT-HCM Vietnam AIST OsakaU UTsukuba Japan MU Australia KISTI KMU Korea JLU China SDSC USA UChile Chile CeNAT-ITCR Costa Rica BESTGrid New Zealand CNIC China LZU China UZH Switzerland LZU China ASTI Philippines IndianaU USA UValle Colombia

Gfarm Development and deployment Gfarm to (U. Tsukuba) – Major enhancement: GSI authentication Gfarm roll for Rocks 5.4 (SDSC) Gfarm deployed to 7 sites – SDSC (meta server, file system, client) – AIST (client) – NCHC, IU, LZU, OsakaU, CNIC (file system nodes, clients)

VM Deployment Automation VM-deploy scripts (SDSC, AIST) – see demo – Get VM image from gfarm – Modify VM image to fit local system Do this by scripts – Start VM Web-OS (NCHC) – Deploy VM via internet to physical non-VM systems User account Access to /srv/cloud

Application VMs AIST developed 3 timely and important applications – WMS Server: provide a simple HTTP interface for requesting geo-registered map images from one or more distributed geospatial databases – Hot Spot: find high-temperature, e.g. a forest fire, spot from satellite data – QuickQuake: generate ground motion map of earth quake

AIST HotSpot + Condor gFS SDSC (USA) Rocks Xen NCHC (Taiwan) OpenNebula KVM LZU (China) Rocks KVM AIST (Japan) OpenNebula Xen IU (USA) Rocks Xen Osaka (Japan) Rocks Xen gFC gFS GFARM Grid File System (Japan) AIST QuickQuake + Condor AIST Geogrid + Bloss AIST Web Map Service + Condor UCSD Autodock + Condor NCHC Fmotif = VM deploy Script VM Image copied from gFarm VM Image copied from gFarm VM Image copied from gFarm VM Image copied from gFarm VM Image copied from gFarm Condor Master VM Image copied from gFarm S S S S S S S gFC gFS = Grid Farm Client = Grid Farm Server slave Put all together VM images stored in Gfarm systems Deployment scripts Run at PRAGMA Sites Copy VM images on Demand from gFarm Modify/start VM instances at PRAGMA sites Jobs managed by Condor

Breakouts Breakout 1 – Test and confirm the demo Breakout 2 – Discuss next steps