MCell Usage Scenario Project #7 CSE 260 UCSD Nadya Williams

Slides:



Advertisements
Similar presentations
Processes Management.
Advertisements

MapReduce Online Created by: Rajesh Gadipuuri Modified by: Ying Lu.
A Computation Management Agent for Multi-Institutional Grids
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
CS CS 5150 Software Engineering Lecture 19 Performance.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
CSE 160/Berman Programming Paradigms and Algorithms W+A 3.1, 3.2, p. 178, 6.3.2, H. Casanova, A. Legrand, Z. Zaogordnov, and F. Berman, "Heuristics.
NPACI Alpha Project Review: Cellular Microphysiology on the Data Grid Fran Berman, UCSD Tom Bartol, Salk Institute.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
Computer Organization and Architecture
Workload Management Massimo Sgaravatto INFN Padova.
Lecture 2 – MapReduce CPE 458 – Parallel Programming, Spring 2009 Except as otherwise noted, the content of this presentation is licensed under the Creative.
Hands-On Microsoft Windows Server 2008 Chapter 11 Server and Network Monitoring.
Computer System Lifecycle Chapter 1. Introduction Computer System users, administrators, and designers are all interested in performance evaluation. Whether.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
Chapter 3 Operating Systems Introduction to CS 1 st Semester, 2015 Sanghyun Park.
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
Scheduling in Heterogeneous Grid Environments: The Effects of Data Migration Leonid Oliker, Hongzhang Shan Future Technology Group Lawrence Berkeley Research.
Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Computing and LHCb Raja Nandakumar. The LHCb experiment  Universe is made of matter  Still not clear why  Andrei Sakharov’s theory of cp-violation.
J OINT I NSTITUTE FOR N UCLEAR R ESEARCH OFF-LINE DATA PROCESSING GRID-SYSTEM MODELLING FOR NICA 1 Nechaevskiy A. Dubna, 2012.
Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.
Composition and Evolution of Operating Systems Introduction to Operating Systems: Module 2.
WP9 Resource Management Current status and plans for future Juliusz Pukacki Krzysztof Kurowski Poznan Supercomputing.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
D0 SAM – status and needs Plagarized from: D0 Experiment SAM Project Fermilab Computing Division.
RISICO on the GRID architecture First implementation Mirko D'Andrea, Stefano Dal Pra.
What are the main differences and commonalities between the IS and DA systems? How information is transferred between tasks: (i) IS it may be often achieved.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Performance Monitor for Complex, Distributed ORB Instances Chen Chen, Kaijian Liu, Hui Long, Gabe Plank Aug. 29, 2010 Problem: Assuming massive data flow.
IMDGs An essential part of your architecture. About me
Processes and OS basics. RHS – SOC 2 OS Basics An Operating System (OS) is essentially an abstraction of a computer As a user or programmer, I do not.
Chapter 4 Realtime Widely Distributed Instrumention System.
Invitation to Computer Science 5 th Edition Chapter 6 An Introduction to System Software and Virtual Machine s.
EFFECTIVE LOAD-BALANCING VIA MIGRATION AND REPLICATION IN SPATIAL GRIDS ANIRBAN MONDAL KAZUO GODA MASARU KITSUREGAWA INSTITUTE OF INDUSTRIAL SCIENCE UNIVERSITY.
Problem Solving with NetSolve Michelle Miller, Keith Moore,
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Using DIANE for astrophysics applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak.
Chapter 1: Introduction and History  Where does the operating system fit in a computing system?  What does the operating system achieve?  What are the.
Lecture 8: 9/19/2002CS149D Fall CS149D Elements of Computer Science Ayman Abdel-Hamid Department of Computer Science Old Dominion University Lecture.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 3: Process-Concept.
CMS Computing Model Simulation Stephen Gowdy/FNAL 30th April 2015CMS Computing Model Simulation1.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Introduction to Grid Computing and its components.
HPC HPC-5 Systems Integration High Performance Computing 1 Application Resilience: Making Progress in Spite of Failure Nathan A. DeBardeleben and John.
An Active Security Infrastructure for Grids Stuart Kenny*, Brian Coghlan Trinity College Dublin.
Vincenzo Innocente, CERN/EPUser Collections1 Grid Scenarios in CMS Vincenzo Innocente CERN/EP Simulation, Reconstruction and Analysis scenarios.
Modeling and Simulation of Signal Transduction Pathways Mark Moeller & Björn Oleson Supervisors: Klaus Prank Ralf Hofestädt.
Grid Activities in CMS Asad Samar (Caltech) PPDG meeting, Argonne July 13-14, 2000.
An operating system (OS) is a collection of system programs that together control the operation of a computer system.
Joint Institute for Nuclear Research Synthesis of the simulation and monitoring processes for the data storage and big data processing development in physical.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
Apr. 25, 2002Why DØRAC? DØRAC FTFM, Jae Yu 1 What do we want DØ Regional Analysis Centers (DØRAC) do? Why do we need a DØRAC? What do we want a DØRAC do?
Enabling Grids for E-sciencE Agreement-based Workload and Resource Management Tiziana Ferrari, Elisabetta Ronchieri Mar 30-31, 2006.
OPERATING SYSTEMS CS 3502 Fall 2017
2. OPERATING SYSTEM 2.1 Operating System Function
Technology Literacy Hardware.
湖南大学-信息科学与工程学院-计算机与科学系
World-Views of Simulation
Wide Area Workload Management Work Package DATAGRID project
GRUBER: A Grid Resource Usage SLA Broker
A General Approach to Real-time Workflow Monitoring
Gordon Erlebacher Florida State University
Operating System Overview
Presentation transcript:

MCell Usage Scenario Project #7 CSE 260 UCSD Nadya Williams

Outline What is MCell ? How to run MCell ? Resources Usage Scenario Summary

What is MCell ? A General Monte Carlo Simulator of Cellular Microphysiology … MCell now makes it possible to incorporate high resolution ultrastructure into models of ligand diffusion and signaling … Thomas M. Bartol Jr. Computational Neurobiology Laboratory The Salk Institute Joel R. Stiles Neurobiology & Behavior Cornell University

What is MCell ?

MCell uses Monte Carlo diffusion Chemical reaction algorithms in 3D MCell simulates Release of ligands in solution Creation/destruction of ligands Ligand diffusion within spaces Chemical reactions undergone by ligand and effector

What is MCell ?

Main biochemical interactions 3D diffusion of ligand molecules based on Brownian motion the average net flux from one region of space to another depends on molecules mobility depends on 3D concentration gradient between the regions

What is MCell ? Different approaches to computing 3D gradients With Voxels Assume well-mixed condition Use PDEs for average net changes PROS: correct average system behavior CONS: too complex for realistic structures output has no direct stochastic information Monte Carlo approach Directly approximate the Brownian movements of the individual ligand Chemical reaction rates are solution rate const PROS: events are considered on a molecule-by-molecule basis the simulation results include realistic stochastic noise CONS: complexity

How to run MCell ? Simulate the system behavior Running the same computation with different seeds Averaging all the instances Each instance has A pre-defined number of time steps Input data Input Data consists of one or more MDL scripts files describing elements of the simulation spatial geometry effector location chemicals' repartitions Output files resulting stochastic model visualization files

Resources Typical run now: 5 MBytes of input data per task 1000 tasks 1 MBytes 2-D output files per task 10 MBytes 3-D output files per task usually 100 MBytes of RAM require on the order of 10 minutes of processing on today's most powerful CPUs. Modeling ligands exchange, diffusion Run envisioned: 50 MBytes of input data per task 1,000,000 tasks Tens of GBytes 2-D and 3-D output files per task RAM not easily available to an average user CPUs of MPPs. Modeling entire cells

Resources Salk Institute UCSD U. of Tennessee Bartol and Sejnowski Casanova and Berman Dongarra and Wolski MCell executes multiple instances of a given code on different parameter set and collects (and perhaps processes) the results. PROS: each instance is independent from the others each instance can be executed anywhere Challenges: 1 tasks share common files 2 resource discovery 3 fault detection 4 fault recovery 5 scheduling

Usage Scenario

Security Requirements data confidentiality need for digital signatures, encryption, authorization public vs. private information on application status and execution Performance Requirements network bandwidth latency and jitter CPU load information service query time disk capacity, speed application timing formats

Usage Scenario Programming Model user interfaces (submit, monitor, steer runs) support for data analysis and visualization Information Service Requirements frequency of information access application preferences on location, structure, representation, and format of IS information : CPU RAM Disk Network Queue waiting time

Usage Scenario Scheduling Requirements resource reservation application components, computation data, intermediate files remote instruments tolerance to delays during execution Remote Data Access requirements publication, management, storage streaming vs. batch processing User Services system status, its format application needs for system services and tools

Summary The MCell development contributions: larger problem size model for a class of science applications parameter sweep application model for the Grid. MCell needs: large-scale MCell runs further improvement and development of application scheduling mechanism

Milestones 1.What are current problems and bottlenecks ? 2.Can one improve basic usage scenario ? 3.Current needs of application from GIS 4.What are requirements for –job scheduling, –job control –storage infrastructure