Sergiu December 2006 TG User Services Coordination December 2006 SDSC NCAR TACC UC/ANL NCSA ORNL PU IU PSC.

Slides:



Advertisements
Similar presentations
Test harness and reporting framework Shava Smallen San Diego Supercomputer Center Grid Performance Workshop 6/22/05.
Advertisements

Xsede eXtreme Science and Engineering Discovery Environment Ron Perrott University of Oxford 1.
1 US activities and strategy :NSF Ron Perrott. 2 TeraGrid An instrument that delivers high-end IT resources/services –a computational facility – over.
Extreme Scalability RAT Report title=RATs#Extreme_Scalability Sergiu Sanielevici,
User Services Transition To XD TG Quarterly Management Meeting, San Juan 12/7/2010 Amit & Sergiu.
User Introduction to the TeraGrid 2007 SDSC NCAR TACC UC/ANL NCSA ORNL PU IU PSC.
Advancing Scientific Discovery through TeraGrid Scott Lathrop TeraGrid Director of Education, Outreach and Training University of Chicago and Argonne National.
(e)Science-Driven, Production- Quality, Distributed Grid and Cloud Data Infrastructure for the Transformative, Disruptive, Revolutionary, Next-Generation.
Ian Foster Computation Institute Argonne National Lab & University of Chicago Education in the Science 2.0 Era.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Workload Management Massimo Sgaravatto INFN Padova.
Simo Niskala Teemu Pasanen
TG QM Arlington: GIG User Support Coordination Plan Sergiu Sanielevici, GIG Area Director for User Support Coordination
Network, Operations and Security Area Tony Rimovsky NOS Area Director
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
CONDOR DAGMan and Pegasus Selim Kalayci Florida International University 07/28/2009 Note: Slides are compiled from various TeraGrid Documentations.
TeraGrid National Cyberinfrasctructure for Scientific Research PRESENTER NAMES AND AFFILIATIONS HERE.
GIG Software Integration: Area Overview TeraGrid Annual Project Review April, 2008.
TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.
Advancing Scientific Discovery through TeraGrid Scott Lathrop TeraGrid Director of Education, Outreach and Training University of Chicago and Argonne National.
August 2007 Advancing Scientific Discovery through TeraGrid Scott Lathrop TeraGrid Director of Education, Outreach and Training University of Chicago and.
August 2007 Advancing Scientific Discovery through TeraGrid Adapted from S. Lathrop’s talk in SC’07
SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.
TeraGrid Overview Cyberinfrastructure Days Internet2 10/9/07 Mark Sheddon Resource Provider Principal Investigator San Diego Supercomputer Center
Coordinating the TeraGrid’s User Interface Areas Dave Hart, Amit Majumdar, Tony Rimovsky, Sergiu Sanielevici.
1 PY4 Project Report Summary of incomplete PY4 IPP items.
Kelly Gaither Visualization Area Report. Efforts in 2008 Focused on providing production visualization capabilities (software and hardware) Focused on.
TeraGrid Quarterly Meeting Dec 5 - 7, 2006 Data, Visualization and Scheduling (DVS) Update Kelly Gaither, DVS Area Director.
TeraGrid CTSS Plans and Status Dane Skow for Lee Liming and JP Navarro OSG Consortium Meeting 22 August, 2006.
Introduction to Grid Computing Ed Seidel Max Planck Institute for Gravitational Physics
Advanced User Support Amit Majumdar 5/7/09. Outline  Three categories of AUS  Update on Operational Activities  AUS.ASTA  AUS.ASP  AUS.ASEOT.
Pegasus: Running Large-Scale Scientific Workflows on the TeraGrid Ewa Deelman USC Information Sciences Institute
SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Joint Meeting of the AUS, US, XS Working Groups TG10 Tuesday August 3, hrs Elwood II.
Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.
TeraGrid Extension Gateway Activities Nancy Wilkins-Diehr TeraGrid Quarterly, September 24-25, 2009 The Extension Proposal!
SC06, Tampa FL November 11-17, 2006 Science Gateways on the TeraGrid Powerful Beyond Imagination! Nancy Wilkins-Diehr TeraGrid Area Director for Science.
Portal Update Plan Ashok Adiga (512)
TeraGrid NOS Turnover Jeff Koerner Q meeting December 8, 2010.
1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
© 2006 The University of Chicago Team Science, Team Scholarship Tom Barton Chad Kainz.
Biomedical and Bioscience Gateway to National Cyberinfrastructure John McGee Renaissance Computing Institute
Sergiu April 2006June 2006 Overview of TeraGrid Resources and Services Sergiu Sanielevici, TeraGrid Area Director for User.
Sergiu April 2006June 2006 TeraGrid: ASTA Program Status June 2006 SDSC NCAR (mid-2006) TACC UC/ANL NCSA ORNL PU IU PSC.
SDSC TACC UC/ANL NCSA ORNL PU IU PSC NCAR Caltech USC/ISI UNC/RENCI UW Resource Provider (RP) Software Integration Partner Grid Infrastructure Group (UChicago)
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
Network, Operations and Security Area Tony Rimovsky NOS Area Director
TeraGrid User Portal Eric Roberts. Outline Motivation Vision What’s included? Live Demonstration.
GADU: A System for High-throughput Analysis of Genomes using Heterogeneous Grid Resources. Mathematics and Computer Science Division Argonne National Laboratory.
Interoperability Achieved by GADU in using multiple Grids. OSG, Teragrid and ANL Jazz Presented by: Dinanath Sulakhe Mathematics and Computer Science Division.
TeraGrid Overview John-Paul “JP” Navarro TeraGrid Area Co-Director for Software Integration University of Chicago/Argonne National Laboratory March 25,
Attribute-based Authentication for Gateways Jim Basney Terry Fleury Stuart Martin JP Navarro Tom Scavo Nancy Wilkins-Diehr.
October 2007 TeraGrid : Advancing Scientific Discovery and Learning Diane A. Baxter, Ph.D. Education Director San Diego Supercomputer Center University.
Software Integration Highlights CY2008 Lee Liming, JP Navarro GIG Area Directors for Software Integration University of Chicago, Argonne National Laboratory.
Advanced User Support Amit Majumdar 8/12/10. Outline  Three categories of AUS  Operational Activities  AUS.ASTA  ASTA examples  AUS.ASP  AUS.ASEOT.
SAN DIEGO SUPERCOMPUTER CENTER Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director for Science Gateways SDSC Director of Consulting,
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
Data Infrastructure in the TeraGrid Chris Jordan Campus Champions Presentation May 6, 2009.
Education, Outreach and Training (EOT) and External Relations (ER) Scott Lathrop Area Director for EOT and ER July 2008.
TeraGrid’s Process for Meeting User Needs. Jay Boisseau, Texas Advanced Computing Center Dennis Gannon, Indiana University Ralph Roskies, University of.
VGES Demonstrations Andrew A. Chien, Henri Casanova, Yang-suk Kee, Richard Huang, Dionysis Logothetis, and Jerry Chou CSE, SDSC, and CNS University of.
TeraGrid Software Integration: Area Overview (detailed in 2007 Annual Report Section 3) Lee Liming, JP Navarro TeraGrid Annual Project Review April, 2008.
TeraGrid User Portal and Online Presence David Hart, SDSC Area Director, User-Facing Projects and Core Services TeraGrid Annual Review April 6, 2009.
NSF TeraGrid Review January 10, 2006
Advancing Scientific Discovery through TeraGrid
Presentation transcript:

Sergiu December 2006 TG User Services Coordination December 2006 SDSC NCAR TACC UC/ANL NCSA ORNL PU IU PSC

Sergiu December 2006 Strategic Issues Petascale simulation needs strongly coupled TeraGrid resources for pre- and post-processing, data analysis,mining/filtering, visualization, steering, and management at various time scales. We need to get ready: engineer applications & workflows to efficiently use ultrascale systems and Grid based technologies; train our consultants and users; implement a scalable information system to support this work. We have made a start: SC06 successes, user information design.

Sergiu December 2006 TeraGrid Wins Again! "Remote Runtime Steering of Integrated Terascale Simulation and Visualization"SC|06 HPC Analytics Challenge Winning team: CMU/U Texas Austin/UC Davis/PSC "Remote Runtime Steering of Integrated Terascale Simulation and Visualization" Recall that SC|05 Analytics Challenge was also won on TG systems, with ASTA support! SC|06 Bandwidth Challenge Honorable Mention: IU/PSC/ORNL Lustre-WAN experiments: "All in a Day's Work: Advancing Data Intensive Research with the Data Capacitor"

Sergiu December 2006

Sergiu December 2006

Sergiu December 2006 Impact of Completed ASTA Projects Published TG Science Features, News, Nuggets: mpich-G2, Grid interop, GridFTP, Remote Viz, PDIO SteeringArterial Karniadakis (Brown U) CTS mpich-G2, Grid interop, GridFTP, Remote Viz, PDIO Steering mpich-G2, Grid interop, Remote VizVortonics Boghosian (Tufts U) CTS mpich-G2, Grid interop, Remote Viz Grid interop, Steering, GridFTP ; AHESPICE Coveney (UCL) CHE Grid interop, Steering, GridFTP ; AHE GridFTP, WAN-GPFS, DMOVER, SRB, Task MappingENZO Norman (UCSD) AST GridFTP, WAN-GPFS, DMOVER, SRB, Task Mapping pegasus-VDS, GridFTP/tgcp, WAN-GPFS, SRBSCEC yr1 Olsen (SDSU) GEO pegasus-VDS, GridFTP/tgcp, WAN-GPFS, SRB WAN-GPFS, SRBBIRN Ellisman (SDSC) BIO WAN-GPFS, SRB MyCluster/GridShellCMS Newman (Caltech) PHY MyCluster/GridShell MyCluster/GridShellCrystal Deem (Rice) PHY MyCluster/GridShell parallel scalability,I/O design, ensemble simulationsTstorms Droegemeier (OU) ATM parallel scalability,I/O design, ensemble simulations pegasus-VDS, Grid interopGADU Maltsev (U Chicago) BIO pegasus-VDS, Grid interop Infrastructural enablers: parallel scalability Injector Heister (Purdue) ASC parallel scalability gsicp, gsissh; customized portal MD-Data Jakobsson (UIUC) BIO gsicp, gsissh; customized portal parallel scalability NREL Brady (Cornell) BIO parallel scalability community code development, SGW development CIG Gurnis (Caltech) GEO community code development, SGW development parallelization EarthScope Pavlis (IU) GEO parallelization

Sergiu December 2006 GADU on TeraGrid and OSG… Bioinformatics is all about Comparative analysis: Insights of Biology are gained by Comparative Analysis: Comparative analysis to know what is same and different between strains of an Organism Difference between Pathogenic and non-pathogenic organisms. Tools BLAST, Blocks, Chisel, Interpro etc. : An embarrassingly parallel workload. Opportunistic use of resources without reservations. An interoperable setup to use both the Grids. Site selection and scheduling across OSG and TeraGrid Sites. GADU uses Pegasus based Virtual Data System (developed under the Griphyn Project) to generate resource specific job submission files. A common installation and job submission setup for both the Grids. GADU uses TeraGrid and OSG resources simultaneously:

Sergiu December 2006 Results: Last Run.. ( November 2006) Ran BLAST Jobs Ran Blocks Jobs Usage: 70% OSG : 30% Teragrid GADU was able to get about 700 CPUs throughout the last run on OSG and TeraGrid together. TeraGrid Community Space helped in standardizing the GADU’s installation of various TeraGrid sites. Acknowledgements: TeraGrid User Support Group - ASTA David O’Neal (GIG/PSC), Joseph Insley (UC/ANL), Krishna Muriki (SDSC) OSG Operations – Support in getting more resources for GADU VO. Globus and VDS Support. On the Application Level (OSG and TeraGrid resources helped in) : Analyzing more than 1,000 Prokaryotic and Eukaryotic genomes using various tools such as BLAST, Blocks and Chisel via PUMA2, Pathos and Target Analyzing User submitted genomes via GNARE for groups such “Shewanella Federation” (Analyzed 13 Strains of Shewanella) and “Center for Genomic Sciences” at West Penn Allegheny Health System (Analyzed Strains of Beggiatoa and Haemophilus influenzae)

Sergiu December 2006 Current ASTA Projects SCEC yr.2 Olsen (SDSU) GEO Cui (SDSC), Reddy (GIG/PSC) Turbulence Woodward (U Minn) ASC Reddy (PSC) Nemo3D Klimeck (Purdue) ECD Raymond (GIG/PSC), Muriki (SDSC) Epidemiology Barrett (VA Poly) Cuticchia (Duke) BCS Marcusiu (NCSA) Demography Lansing (U Arizona) DBS Majumdar (SDSC), Gomez (PSC) Remote Biological Microscopy Gilpin (U Texas) MCB Hempel (TACC) Adaptive GIN MD/QM Nakano (USC) DMR Brown (PSC) Pulmonary Immunity Benos (Pitt) MCB Raymond (GIG/PSC) Pleistocene Hydrology Person (IU) EAR Wang (IU) Failure of Human Bone Keaveny (UCB) MCA Majumdar (SDSC) QUAKE Bielak (CMU) MCA Urbanic (PSC)

Sergiu December 2006 Vision for TeraGrid Information Flow Info In Wiki Ticket System Knowledge Base MDS Resources Catalog DB (TGCDB) Science Gateways Accounting User News DB Systems monitors Software repository (from users, systems, and staff) Info Out User Info Knowledge Base (in User Info) Portal Wiki Science Gateways RP site User Guides User News Display Inca Software pages

Sergiu December 2006 Ticket System DB Resource Catalog (TGCDB) Allocated Users Wiki MDS Portal Help Desk Consultants, User Services/ ASTA Inca User Info KB Will be in User Info Docs Coord, WG, Portal, KB, Doc Group, & other Staff RP Site Systems Automated/Dynamic Human-mediated Elements of the TeraGrid Information System Software Repository RP Web Sites User News Knowledge Base User News DB Accounting (TGCDB) INCA DB

Sergiu December 2006 Info systems under development for 2007 INCA DB User News DB User News User Info Inca Knowledge Base Allocated Users Help Desk Consultants, etc. KB Will be in User Info KB Staff Ticket System DB RP Site Systems MDS Portal Allocated Users Wiki TG STaff. Automated/Dynamic Human-mediated Resource Catalog (TGCDB) RP Web Sites RP site staff User Info