PRAGMA Institute on PRAGMA 19 Wilfred W. Li, Ph.D., UCSD, USA Xiaohui Wei, Ph.D., JLU, PRC Hosted by JLU Changchun, Jilin, PRC, Sept 13,

Slides:



Advertisements
Similar presentations
PRAGMA – TeraGrid – AIST Interoperation Testing Philip Papadopoulos.
Advertisements

Resource WG Breakout. Agenda How we will support/develop data grid testbed and possible applications (1 st day) –Introduction of Gfarm (Osamu) –Introduction.
Biosciences Working Group Update
CSF4 Meta-Scheduler Tutorial 1st PRAGMA Institute Zhaohui Ding or
Multi-organisation Grid Accounting System (MOGAS): PRAGMA deployment update A/Prof. Bu-Sung Lee, Francis School of Computer Engineering, Nanyang Technological.
PRAGMA 17 (10/29/2009) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD Karpjoo Jeong, Ph.D., Konkuk University, South Korea Habibah Wahab, Ph.D., USM, Malaysia.
Reports from Resource Breakout PRAGMA 16 KISTI, Korea.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29, 2009.
Motivation 1.Application resources setup – make it easy 2.Transform PRAGMA grid – add on demand –Continue using Grid resources –Add cloud resources Current.
The Avian Flu Grid Project Rommie Amaro & Dong Xu University of California, San Diego PRAGMA 13 - NCSA Sept 25, 2007.
Steering Committee Meeting Summary PRAGMA 18 4 March 2010.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Daejeon, Korea, March 24, 2009.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by JLU Changchun, Jilin, PRC, Sept 13-15, 2010.
11 Application of CSF4 in Avian Flu Grid: Meta-scheduler CSF4. Lab of Grid Computing and Network Security Jilin University, Changchun, China Hongliang.
PRAGMA 15 (10/24/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Resources.
Resource WG Update PRAGMA 14 Mason Katz, Yoshio Tanaka, Cindy Zheng.
Slides Please send to Arun
Resource WG PRAGMA Mason Katz, Yoshio Tanaka, Cindy Zheng.
Lixian 19 Changchun, Jilin,Sep 15,2010 College of Computer Science and Technology, Jilin University, ChangChun, P.R.China Lixian.
Resource/data WG Summary Yoshio Tanaka Mason Katz.
1 Bio Applications Virtualization using Rocks Nadya Williams UCSD.
Resource WG Summary Mason Katz, Yoshio Tanaka. Next generation resources on PRAGMA Status – Next generation resource (VM-based) in PRAGMA by UCSD (proof.
Biosciences Working Group Update & Report Back Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by IOIT Hanoi, Vietnam, Oct 29,
CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding or College of Computer.
Dynamic Resource Management for Virtualization HPC Environments Xiaohui Wei College of Computer Science and Technology Jilin University, China. 1 PRAGMA.
PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
A Proposal of Capacity and Performance Assured Storage in The PRAGMA Grid Testbed Yusuke Tanimura 1) Hidetaka Koie 1,2) Tomohiro Kudoh 1) Isao Kojima 1)
Gfarm v2 and CSF4 Osamu Tatebe University of Tsukuba Xiaohui Wei Jilin University SC08 PRAGMA Presentation at NCHC booth Nov 19,
1 Mixing Public and private clouds a Practical Perspective Maarten Koopmans Nordunet Conference 2009 Maarten Koopmans Nordunet Conference 2009.
Virtualization, Cloud Computing, and TeraGrid Kate Keahey (University of Chicago, ANL) Marlon Pierce (Indiana University)
Gilbert Kalb B ilateral R esearch and I ndustrial Development enhancing and integrating G rid E nabled technologies Bridge Project Presentation Third
1 Applications Virtualization in VPC Nadya Williams UCSD.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
NBCR Science Gateway: Transparent Access to Remote Resources Through Rich Desktop Clients NBCR Science Gateway: Transparent Access to Remote Resources.
PRAGMA19, Sep. 15 Resources breakout Migration from Globus-based Grid to Cloud Mason Katz, Yoshio Tanaka.
© UC Regents 2010 Extending Rocks Clusters into Amazon EC2 Using Condor Philip Papadopoulos, Ph.D University of California, San Diego San Diego Supercomputer.
Progress Since PRAGMA 19 Planning for PRAGMA’s Future PRAGMA March2011 University of Hong Kong.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia You-Qiang Song, Ph.D, HKU, PRC Hosted by HKU Hong.
Developing Reusable Software Infrastructure – Middleware – for Multiscale Modeling Wilfred W. Li, Ph.D. National Biomedical Computation Resource Center.
PhD course - Milan, March /09/ Some additional words about cloud computing Lionel Brunie National Institute of Applied Science (INSA) LIRIS.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by AIST Sapporo, Japan, Oct 17-20, 2011.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
Installation and Integration of Virtual Clusters onto Pragma Grid NAIST Nara, Japan Kevin Lam 06/28/13.
PRAGMA20 – PRAGMA 21 Collaborative Activities Resources Working Group.
1 port BOSS on Wenjing Wu (IHEP-CC)
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by CNIC, CAS Beijing, China Oct 16-18, 2013.
Resource WG PRAGMA 18 Mason Katz, Yoshio Tanaka.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
PRAGMA 17 – PRAGMA 18 Resources Group. PRAGMA Grid 28 institutions in 17 countries/regions, 22 compute sites (+ 7 site in preparation) UZH Switzerland.
INFSO-RI Enabling Grids for E-sciencE V. Breton, 30/08/05, seminar at SERONO Grid added value to fight malaria Vincent Breton EGEE.
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
PRAGMA Avian Flu Grid: Drug Discovery against Infectious Diseases Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Nara Institute of Science and technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
Biosciences Working Group Update Seok Jong Yu, KISTI Hosted by Kunkuk University Seoul, Korea, Oct 10-12, 2012.
EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,
Avian Flu Data Challenge Hsin-Yen Chen ASGC 29 Aug APAN24.
SC2008 (11/19/2008) Resources Group Pacific Rim Application and Grid Middleware Assembly Reports.
Adventures in Computational Chemistry McCammon Group, UCSD/HHMI.
1 Grid Activity Summary » Grid Testbed » CFD Application » Virtualization » Information Grid » Grid CA.
Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
PRAGMA19 – PRAGMA 20 Collaborative Activities Resources Working Group.
PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.
Biosciences Working Group Update Wilfred W. Li, Ph.D., UCSD, USA Habibah Wahab, Ph.D., USM, Malaysia Hosted by UCSD San Diego, USA, March 3, 2010.
Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Biosciences Working Group Update
Tools and Services Workshop
Presentation transcript:

PRAGMA Institute on PRAGMA 19 Wilfred W. Li, Ph.D., UCSD, USA Xiaohui Wei, Ph.D., JLU, PRC Hosted by JLU Changchun, Jilin, PRC, Sept 13, 2010 Avian Flu Grid: Transition from Grid to Cloud Computing

Scientific Driver and Use Cases Harris et al, PNAS, 2006

Relaxed Complex Scheme and Ensemble based Virtual Screening Contributed to HIV Integrase Inhibitor Development Exploration of the structural basis for this unexpected result … suggests an approach to the development of integrase inhibitors with unique resistance profiles. D. Hazuda et al., Proc. Natl. Acad. Sci. USA (Aug. 2004), refers to Schames, et al. (2004). Discovery of unexpected binding site in HIV-1 Integrase using MD and AutoDock: Schames, … & McCammon, J. Med. Chem. (released on web, early 2004) February, 2006 – Phase III Clinical Trials February, 2007 – Name announced: Isentress (raltegravir) October, 2007 – FDA fast track approval New Class of HIV Drugs: Merck & Co. MK-0518 Source: A. McCammon

Ensemble-based Virtual Screening with Relaxed Complex Scheme NAMD2 Amber NCI Diversity Set: 3.3 MB, 2000 compounds; Required at each site ZINC subset: 200,000. A few hundred MB Multiple targets: HA, NA subtypes Each target: 30~50 MD snapshots, 1~2 MB each AutoDock4 Simulation Data: hundreds of GB Docking Data: hundreds of MB Total data to date: ~5 TB in long term storage. Each experiment is about 1 Petaflops accumulative in computation cost. Source: Amaro

Advances in Computing Infrastructure Enables Complex Simulations of Biomolecular Systems Amaro & Li, CTMC, 2010

New Challenges Virtualization – What does it mean to us? – Rockn Rolls, on demand virtual machines, Production environment – Where is it? What form should it take? – GPU clusters, virtual machines, cloud services Most work is still done on local clusters, the desire to use the grid/Cloud is there – Its happening, and quite exciting Collaboration – How to stay in touch better, PRIME, MURPA, research in general?

Transparent access of applications on Avian Flu Grid through middleware CNIC Duckling Portal Konkuk Glyco-M*Grid NBCR CADD

2 – 4 March 2010 PRAGMA 18, San Diego8 Nornisah Mohamed, USM

Other Examples of Continued Software Development at Member Institutions – Drugscreener-G – KISTI, Korea – Grid Enabled Virtural Screening Service – ASGC, Taiwan – CADD Pipeline – NBCR, USA – WISDOM project – CNRS, EU – Glyco-M*Grid – Kookmin & Konkuk U, Korea

Virtual Screening with CSF Virtual screening web services with remote clusters including TeraGrid and PRAGMA Grid resources. Virtual cluster at SDSC AMAZON EC2

Integrating Visualization Workflows using Real-time bioMEdical data Streaming and visualization (RIMES) Kevin Dong, CNIC

Lau, Haga and Date ViewDock TDW

OPAL as resource manager of CSF4 CSF4 allocate service instances of OPAL for jobs 13 New OPAL-CSF4 Cloud model PRAGMA 19 workshop, Changchun, Jilin, China, Sep.13-15, 2010.

14 Parallel job scheduling in CSF4 Two phase resource allocation in parallel job plugin – Construct virtual clusters according to job requirements – Distribute real jobs to virtual clusters PRAGMA 19 workshop, Changchun, Jilin, China, Sep.13-15, 2010.

Social Networks and Collaborative Environment Social Network SiteNumber of UsersFeaturesAPI Examples Google170 million (Gmail)Google Integrated Suite of Tools Google Apps Engine LinkedIn65 millionProfessionalHuddle/Zoho Office Online Twitter100 millionShort MMS/SMSTwitPic Google Wave100,000 X 7?Upload any fileGoogle Wave Robot Facebook400 million+Social networkFacebook Apps Are these too big to fail? Utility Computing finally?

Kepler Opal Web Services Actor

Web Form for Virtual Screening Service

Cloud Computing with Amazon EC2

AutoDock Workflow

A Virtual Screening Vision Workflow A web service

Condor poolSGE Cluster PBS Cluster Globus Application Services Opal GUIPMV/VisionKepler Transparent Access Layer for Applications Grid/Cloud Resources

22 Vision Workflow Snippet Using Opal Two Major Steps 1.Run PDB2PQR web service. This step is skipped if an appropriate PQR file exists on the local machine. 2.Run PrepareReceptor web service. Output is URL to PDBQT PDB2PQR and PrepareReceptor are skipped if an appropriate PDBQT file exists on the local machine. – Output is PDBQT path on local machine. Macro that runs PDB2QR web service. Macro that runs PrepareReceptor web service

Opal 2 for SaaS

VM Replication Experiment SDSC VM hosting server AIST VM hosting server AFG VM (original) AFG VM (copy) VM hosting server: Rocks 5.3 Xen roll Avian Flu Grid VM Rocks VM Globus/SGE Autodock Replication updates hostname and IP Compute nodes Network configurations Globus configuration SGE configuration NBCR VM hosting server AFG VM (copy) VM replication