Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.

Slides:



Advertisements
Similar presentations
Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
Advertisements

CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Reports from Resource Breakout PRAGMA 16 KISTI, Korea.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
PRAGMA Institute on PRAGMA 19 Wilfred W. Li, Ph.D., UCSD, USA Xiaohui Wei, Ph.D., JLU, PRC Hosted by JLU Changchun, Jilin, PRC, Sept 13,
Resource WG Update PRAGMA 8 Singapore. Routine Use - Users make a system work.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by JLU Changchun, Jilin, PRC, Sept 13-15, 2010.
11 Application of CSF4 in Avian Flu Grid: Meta-scheduler CSF4. Lab of Grid Computing and Network Security Jilin University, Changchun, China Hongliang.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
1 Bio Applications Virtualization using Rocks Nadya Williams UCSD.
Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.
CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding or College of Computer.
Gfarm v2 and CSF4 Osamu Tatebe University of Tsukuba Xiaohui Wei Jilin University SC08 PRAGMA Presentation at NCHC booth Nov 19,
1 Applications Virtualization in VPC Nadya Williams UCSD.
VC Deployment Script for OpenNebula/KVM Yoshio Tanaka, Akihiko Ota (AIST)
Yingcai Xiao Chapter 4 The Visualization Pipeline.
NorduGrid Grid Manager developed at NorduGrid project.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
NBCR Science Gateway: Transparent Access to Remote Resources Through Rich Desktop Clients NBCR Science Gateway: Transparent Access to Remote Resources.
An OpenFlow based virtual network environment for Pragma Cloud virtual clusters Kohei Ichikawa, Taiki Tada, Susumu Date, Shinji Shimojo (Osaka U.), Yoshio.
PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.
PRAGMA9 – Demo Bioinformatics applications inside Gfarm using meta-scheduler (CSF) and local schedulers (LSF/SGE/etc) Dr. Xiaohui Wei, JLU, China Dr. Wilfred.
Towards High-Availability for IP Telephony using Virtual Machines Devdutt Patnaik, Ashish Bijlani and Vishal K Singh.
A Grid Resource Broker Supporting Advance Reservations and Benchmark- Based Resource Selection Erik Elmroth and Johan Tordsson Reporter : S.Y.Chen.
VIRTUALISATION OF HADOOP CLUSTERS Dr G Sudha Sadasivam Assistant Professor Department of CSE PSGCT.
Minerva Infrastructure Meeting – October 04, 2011.
System Center 2012 Setup The components of system center App Controller Data Protection Manager Operations Manager Orchestrator Service.
Cloud and Virtualization Panel Philip Papadopoulos UC San Diego.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia You-Qiang Song, Ph.D, HKU, PRC Hosted by HKU Hong.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
PRAGMA21 – PRAGMA 22 Collaborative Activities Resources Working Group.
PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.
NAREGI WP4 (Data Grid Environment) Hideo Matsuda Osaka University.
Cindy Zheng, Pragma Cloud, 3/20/2013 Building The PRAGMA International Cloud Cindy Zheng For Resources Working Group.
1.  PRAGMA Grid test-bed : Shares clusters which managed by multiple sites Realizes a large-scale computational environment. › Expects as a platform.
Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.
1 Evolution of OSG to support virtualization and multi-core applications (Perspective of a Condor Guy) Dan Bradley University of Wisconsin Workshop on.
BOSCO Architecture Derek Weitzel University of Nebraska – Lincoln.
PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.
High Performance File System Service for Cloud Computing Kenji Kobayashi, Osamu Tatebe University of Tsukuba, JAPAN.
CSF4 Meta-Scheduler Name: Zhaohui Ding, Xiaohui Wei
Simplifying Resource Sharing in Voluntary Grid Computing with the Grid Appliance David Wolinsky Renato Figueiredo ACIS Lab University of Florida.
Reports on Resources Breakouts. Wed. 11am – noon - Openflow demo rehearsal - Show physical information. How easily deploy/configure OpenvSwitch to create.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
A Brief Documentation.  Provides basic information about connection, server, and client.
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Resources Working Group Update Cindy Zheng (SDSC) Yoshio Tanaka (AIST) Phil Papadopoulos (SDSC)
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
NTU Cloud 2010/05/30. System Diagram Architecture Gluster File System – Provide a distributed shared file system for migration NFS – A Prototype Image.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
Panel “Making real large-scale grids for real money-making users: why, how and when?” August 2005 Achim Streit Forschungszentrum Jülich in der.
Application Programming in Cloud via Swift Swift Tutorial, CCGrid 2013, Hour 2 Ketan Maheshwari.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Bulk Data Transfer Activities We regard data transfers as “first class citizens,” just like computational jobs. We have transferred ~3 TB of DPOSS data.
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.
Nivo 300 Windows server Roles and features - Luka Manojlovic Jure Purgar.
VIRTUAL MACHINE – VMWARE. VIRTUAL MACHINE (VM) What is a VM? – A virtual machine (VM) is a software implementation of a computing environment in which.
Towards Dynamic Database Deployment LCG 3D Meeting November 24, 2005 CERN, Geneva, Switzerland Alexandre Vaniachine (ANL)
Parag Mhashilkar (Fermi National Accelerator Laboratory)
Biosciences Working Group Update
Pegasus WMS Extends DAGMan to the grid world
GWE Core Grid Wizard Enterprise (
Gluondb1 (online) Resides on gluon25, own IP address
Licensing Overview January 2019.
Presentation transcript:

Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current –SDSC –AIST –NBCR Future –ASTI (Philippine) –NCHC –Osaka University

Working steps Hosting services setup SDSC, AIST, NBCR, … VM setup for baseline system Rocks VM baseline system (SDSC) VM setup with applications Use the VM baseline system Build application VMs Avian Flu Grid VM (SDSC, NBCR) VM replication manually AFG VM from SDSC to AIST and NBCR VM replication automation Fast live-migration systems and scheme (AIST leads research)

Opal2 User Interface Resource Manager Meta Scheduler Grid Resources CSF 4 Scheduling : workflow job array Job Input/Output files: stage in stage out Grid sites Generate RSL files NBCR VM hosting server AFG VM replica 3 VM Replication Experiment AFG VM original AIST VM hosting server AFG VM replica 2 VM replication VM hosting server: Rocks 5.3 Xen roll VM change: hostname, IP & compute nodes system network configuration Globus configuration SGE configuration SDSC VM hosting server AFG VM replica 1 AFG VM Rocks VM Globus/SGE Autodock VM Opal server