Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported.

Slides:



Advertisements
Similar presentations
Integrated Environment for Computational Chemistry on the APAC Grid Dr. Vladislav Vassiliev Supercomputer Facility, The Australian National University,
Advertisements

GridChem and ParamChem: Science Gateways for Computational Chemistry (and More) Marlon Pierce, Suresh Marru Indiana University Sudhakar Pamidighantam NCSA.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
OxGrid, A Campus Grid for the University of Oxford Dr. David Wallom.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Simo Niskala Teemu Pasanen
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Integrating HPC and the Grid – the STFC experience Matthew Viljoen, STFC RAL EGEE 08 Istanbul.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
1 Integrating GPUs into Condor Timothy Blattner Marquette University Milwaukee, WI April 22, 2009.
Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.
University of Virginia Experiences with NMI at the University of Virginia NMI Integration Testbed: Experiences in Middleware Deployment Spring 2003 Internet2.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
National Center for Supercomputing Applications GridChem: Integrated Cyber Infrastructure for Computational Chemistry Sudhakar.
GridChem-- User Support Kent Milfeld Supported by the NSF NMI Program under Award # Oct. 10, 2005.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
GridChem A Computational Chemistry Cyber-infrastructure Sudhakar Pamidighantam NCSA, University of Illinois at Urabana Champaign
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.
WebMO: A Web-Based Interface for MOPAC Jordan R. Schmidt and William F. Polik Department of Chemistry, Hope College, Holland, MI
PNPI HEPD seminar 4 th November Andrey Shevel Distributed computing in High Energy Physics with Grid Technologies (Grid tools at PHENIX)
Grid MP at ISIS Tom Griffin, ISIS Facility. Introduction About ISIS Why Grid MP? About Grid MP Examples The future.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Kurt Mueller San Diego Supercomputer Center NPACI HotPage Updates.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
Algorithmic Finance and Tools for Grid Execution (the Swift Grid Scripting/Workflow tool) Tiberiu (Tibi) Stef-Praun.
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
INFSO-RI Enabling Grids for E-sciencE Running ECCE on EGEE clusters Olav Vahtras KTH.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
National Computational Science National Center for Supercomputing Applications National Computational Science Integration of the MyProxy Online Credential.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
GridChem Architecture Overview Rion Dooley. Presentation Outline Computational Chemistry Grid (CCG) Current Architectural Overview CCG Future Architectural.
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
GridChem Developers Conference Focus For Final Year Sudhakar Pamidighantam NCSA 25 August 2006.
GridChem Sciene Gateway and Challenges in Distributed Services Sudhakar Pamidighantam NCSA, University of Illinois at Urbaba- Champaign
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Computational chemistry with ECCE on EGEE.
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
Miron Livny Computer Sciences Department University of Wisconsin-Madison Condor and (the) Grid (one of.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
David P. Anderson Space Sciences Laboratory University of California – Berkeley Public Distributed Computing with BOINC.
The GRIDS Center, part of the NSF Middleware Initiative Grid Security Overview presented by Von Welch National Center for Supercomputing.
A Desktop Client for HPC Chemistry Applications: GridChem Kent Milfeld Supported by the NSF NMI Program under Award #
Mobile Analyzer A Distributed Computing Platform Juho Karppinen Helsinki Institute of Physics Technology Program May 23th, 2002 Mobile.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
Geant4 GRID production Sangwan Kim, Vu Trong Hieu, AD At KISTI.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Scientific Data Processing Portal and Heterogeneous Computing Resources at NRC “Kurchatov Institute” V. Aulov, D. Drizhuk, A. Klimentov, R. Mashinistov,
PLG-Data and rimrock Services as Building
Consulting Services JobScheduler Architecture Decision Template
GPIR GridPort Information Repository
GridChem Current Status
Example: Rapid Atmospheric Modeling System, ColoState U
Consulting Services JobScheduler Architecture Decision Template
Enable computational and experimental  scientists to do “more” computational chemistry by providing capability  computing resources and services at their.
Grid Computing AEI Numerical Relativity Group has access to high-end resources in over ten centers in Europe/USA They want: Bigger simulations, more simulations.
Grid Computing.
Recap: introduction to e-science
CSC 480 Software Engineering
Haiyan Meng and Douglas Thain
Distributed Systems Bina Ramamurthy 12/2/2018 B.Ramamurthy.
Introduction to High Performance Computing Using Sapelo2 at GACRC
Presentation transcript:

Cluster Computing through an Application-oriented Computational Chemistry Grid Kent Milfeld and Chona Guiang, Sudhakar Pamidighantam, Jim Giuliani Supported by the NSF NMI Program under Award # April 24, 2005

Outline Computational Chemistry Grid Overview HPC Application Computing through a Client Interface Architecture for the GridChem Client Supporting the Virtual Organization

The Big Picture

Computation Chemistry Grid (CCG) “GridChem” A collection of “grid-enabled” resources to routinely run chemical physics applications Integrates a desktop environment into an infrastructure for a specific community of users –comp. chemists with large/small scale needs –experimental chemists who occasionally need simulation capabilities to verify experimental results Establishes a distributed infrastructure for open scientific research– a virtual organization

The Components Applications Resources Desktop Environment the GridChem Client Compute Intensive hrs runs High Speed Infrastructure Not Needed 4 – 16 CPUS/job Batch Support Secure Access (grid-enabled) Multi-platform support (XP, OS X, Linux) Responsive Client Interface to the Grid Cluster Systems Atoms, Small Molecules, Clusters Electronic Structure

Applications GridChem supports some apps already –Gaussian 98/03, GAMESS, MolPro Schedule of integration of additional software –NWChem –ACES-2 –Crystal –Q-Chem –NBO –Wein2K –MCCCS Towhee homegrown computational chemistry codes developed at LSU

Computational Chemistry Resource Providers TACC CCT NCSA CCSOSC

Resources Over 400 processors and 3,525,000 CPU hours available annually System (Site)Procs AvailTotal CPU Hours/Year HP Intel Cluster (OSC)12100,000 Intel Cluster (OSC)36315,000 Intel Cluster (UKy)96840,000 HP Integrity Superdome33290,000 Intel Cluster (NCSA)64560,000 SGI Origin2000 (NCSA)1281,000,000 Intel Cluster (LSU)32280,000 IBM Power4 (TACC)16140,000

Desktop Use your workstation! Data Storage Graphics Computing Resource 596 MB for Internet Files Intel: GMA 900 Graphics,… Mac: ATI Radeon 9200 with 32MB DDR Gigaflop Processors GigaBytes for Storage

Desktop -- GridChem Java Based Client –“Same” Look and Feel on “every” machine. –Consistent Environment No Globus Installation Designed for “Application Services” through a Server; but Can be used as Stand-Alone Client for job submission

3-tier Architecture GridChem ClientGC Middleware ServerHPC Resources Authentication Kerberos MyProxy SSH modules Resource specs.  into Local Batch Specs  Batch Script  Queue Submission Application Execution + Output & File Transfers inputs, resource specs. & temp. cert. transfer Kerb. & MyProxy Servers Input Preparation Molecular Editor Application Options Site Info (stat./dyn.) J2EE MySQL Site Monitors Site Preference Job Submission Resource Management File Management Remote Storage Molecular Editor + Visualization User See Two-Tier Architecture

Infrastructure (now) Server, GridChem Client* –MyProxy (X-500 Certs), Kerberos (Security) –CGI Scripts  GSI ( for Data Movement & Job Launch) Job Monitoring –Perl filters, MySQL Support –PCS, Portable Consulting Service EOT –OSU *

Infrastructure (future) Server –Condor + ? (Job Launch) –GSI ( Data Transfer,  uberftp) –Information Repository (IGRID, GPIR,…?) Support –GridPort 3.0  Monitoring, Consulting (PCS), Accounting…

Infrastructure (future) GridClient –3-rd party file transfers (Trebuchet) –More intelligence in input construction –Increase Application Space –Web Start –Indirect DB access for preferences –Advanced visualization support (Molden,…) Resource Sites –Condor –Globus Utils

GridChem Client

GridChem Nanocad Molecular Editor

Lexical Analysis And Parsing Follows the progress of the calculation while it is still running or has completed. Plots the energy, gradient, etc versus iteration number.

Monitoring User Storage HTTP HTML,PHP,… Service Login DB Batch cron Filter

Job-Status-Monitor = JSM

Consulting Database Report Problem User Interface Consultant Interface Notification Further Interaction Consultant Monitor Page Front-line triage Ticket Transfer & Response Page Ticket Owner & CCs Problem Form Personalized Monitor Page Notification Notifications

User Submission

Consultant View Consultant’s View

Post Processing 2d and 3d Orbital isosurfaces Using NCSAChem/Slice/Molden/Cartona/Free Software Molecule Viewers

Electron Structure: Orbitals or electron densities,… 5-dehydro-m-xylylene triradical

Transcription Regulator (molecular modeling)

Summary GridChem Client Resources Community  “Better Living Through Chemistry”

References