Goals How can programs using MRCs help each other? How can ITSD help MRC-using programs? Is there utility in creating a shared resource?

Slides:



Advertisements
Similar presentations
University of St Andrews School of Computer Science Experiences with a Private Cloud St Andrews Cloud Computing co-laboratory James W. Smith Ali Khajeh-Hosseini.
Advertisements

Luquillo Experimental Forest Information Management: a Long-Term Ecological Research system to deposit documented data ready for analysis and synthesis.
U.S. Department of Energy’s Office of Science Basic Energy Sciences Advisory Committee Dr. Daniel A. Hitchcock October 21, 2003
Cairo-Durham Central School District 1 Facility Usage Study Final Report April 2010 Cairo-Durham Central School District Facility Usage Study Final Report.
1 3/26/02 Midrange Computing Workshop Sandy Merola Gary Jung March 26, 2002.
Samford University Virtual Supercomputer (SUVS) Brian Toone 4/14/09.
Overview of Midrange Computing Resources at LBNL Gary Jung March 26, 2002.
Technical Review Group (TRG)Agenda 27/04/06 TRG Remit Membership Operation ICT Strategy ICT Roadmap.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
Service Science, Management, and Engineering (SSME)
Software Engineering Techniques for the Development of System of Systems Seminar of “Component Base Software Engineering” course By : Marzieh Khalouzadeh.
 Amazon Web Services announced the launch of Cluster Compute Instances for Amazon EC2.  Which aims to provide high-bandwidth, low- latency instances.
Building a Cluster Support Service Implementation of the SCS Program UC Computing Services Conference Gary Jung SCS Project Manager
How to use Student Voice Training Session Gary Ratcliff, AVC - Student Life.
SCHOOL OF INFORMATION UNIVERSITY OF MICHIGAN Collaboratories at a Glance G Judy Olson Nathan Bos Erik Dahl.
United Nations Economic Commission for Europe Statistical Division NTTS 2015 – Satellite Workshop on Big Data March 9, 2015 The Big Data Project – The.
SCHOOL OF INFORMATION UNIVERSITY OF MICHIGAN Success Factors for Collaboratories Gary M. Olson Collaboratory for Research on Electronic Work School of.
An Introduction to Cloud Computing. The challenge Add new services for your users quickly and cost effectively.
Information Technology Research Areas Alberto Di Meglio – CERN openlab Data acquisition and filteringComputing platforms, data analysis, simulationData.
CLUSTER COMPUTING Prepared by: Kalpesh Sindha (ITSNS)
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
VSS supports knowledge management Knowledge based organizations and improving the absorption capacity.
1 Midrange Computing Working Group Process and Goals Background The MRC Working Group Phase I: - Assessment and Findings - Recommendations for a path forward.
The World Wide Web as a tool for creative design: Current issues and prospects for research Julien Nelson & Todd Lubart Laboratoire Adaptations Travail.
Future role of DMR in Cyber Infrastructure D. Ceperley NCSA, University of Illinois Urbana-Champaign N.B. All views expressed are my own.
RESEARCH & EDUCATION NETWORKS -A CASE STUDY IN GHANA SCHOOL ON RADIO USE FOR INFORMATION AND COMMUNICATION TECHNOLOGY 3 rd - 21 st February 2003, Trieste.
Our Process We Threw Out Preconceptions and Left No Stone Unturned We looked at white papers, articles, Gartner and Forrester reports, and marketing collateral.
Loosely Coupled Parallelism: Clusters. Context We have studied older archictures for loosely coupled parallelism, such as mesh’s, hypercubes etc, which.
07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge
What do students want from education? Individuality (1) Students are individuals, each need a unique academic training. They want to attend classes that.
Alessandra CiocioAugust 10, CSAC meeting1 Mid-Range Computing Working Group Report CSAC and ITSD are working in partnership to determine the value.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
A Few IQSS Quasi-Research Projects Gary King Institute for Quantitative Social Science Harvard University (talk at the Harvard Academic Computing Committee,
CERN openlab V Technical Strategy Fons Rademakers CERN openlab CTO.
Internet Services Introduction Expertise is a collaborative tool for knowledge sharing, interacting and group working that can be adapted to the needs.
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
Alessandra CiocioMay 11, CSAC meeting1 Mid-Range Computing Working Group Report CSAC and ITSD are working in partnership to determine the value.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
Brent Gorda LBNL – SOS7 3/5/03 1 Planned Machines: BluePlanet SOS7 March 5, 2003 Brent Gorda Future Technologies Group Lawrence Berkeley.
ICMC 2004 – Nov. 5 1 Andante: Composition and Performance with Mobile Musical Agents Leo Kazuhiro Ueda Fabio Kon
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
HEPiX FNAL ‘02 25 th Oct 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 25 th October 2002 HEPiX 2002, FNAL.
ESFRI & e-Infrastructure Collaborations, EGEE’09 Krzysztof Wrona September 21 st, 2009 European XFEL.
Alessandra CiocioApril 6, CSAC meeting1 Mid-Range Computing Working Group Report CSAC and ITSD are working in partnership to determine the value.
A scalable and flexible platform to run various types of resource intensive applications on clouds ISWG June 2015 Budapest, Hungary Tamas Kiss,
LSTA Grant Workshop Jennifer Peacock, Administrative Services Bureau Director David Collins, Grant Programs Director Mississippi Library Commission September.
ACCOUNTABILITY LEADERSHIP INSTITUTE FOR ENGLISH LEARNERS & IMMIGRANT STUDENTS Digital Chalkboard: Online Resources for English Learners and Immigrant Students.
Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.
N. RadziwillEVLA Advisory Committee Meeting May 8-9, 2006 NRAO End to End (e2e) Operations Division Nicole M. Radziwill.
IAB Involvement in ERCs: Assessing and Strengthening the Role.
Defining the Functional Needs of Our College. Strategic Technology Plan Project Roadmap Project Principles Developed Readiness Assessment.
Wang Yifang Institute of High Energy Physics October 24, 2013 IHEP Self-assessment.
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-2.
MRC Recap/Progress/Path forward March – MRC Workshop –Centralized services are of interest –Not clear whether there is lab-wide requirement for MRC June.
Alessandra CiocioCSAC meeting - November 9, Milestones Completion of Phase I - MRC WG Document on initial assessment and findings - Recommendations.
NASA Earth Exchange (NEX) Earth Science Division/NASA Advanced Supercomputing (NAS) Ames Research Center.
CHAPTER 3 Systems Considerations in the Design of an HRIS.
Resource Optimization for Publisher/Subscriber-based Avionics Systems Institute for Software Integrated Systems Vanderbilt University Nashville, Tennessee.
Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI Introduction to Science Gateway Sustainability Dr. Wibke Sudholt CloudBroker.
Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.
Lecture 13 Parallel Processing. 2 What is Parallel Computing? Traditionally software has been written for serial computation. Parallel computing is the.
Preparing Mechanical Engineering Students for Collaborations Across Distance and Disciplines (CADD) Nina Robson California State University, Fullerton.
EarthCube Sustaining the Geosciences for 21 st Century Challenges Credits: from top to bottom: NOAA Okeanos Explorer Program (CC BY-SA 2.0), NASA/Kathryn.
A Brief Introduction to NERSC Resources and Allocations
Clouds , Grids and Clusters
An Introduction to Cloud Computing
Scientific Computing At Jefferson Lab
Optena: Enterprise Condor
Presentation transcript:

Goals How can programs using MRCs help each other? How can ITSD help MRC-using programs? Is there utility in creating a shared resource?

Scientist to Scientist Web server/mailing list for MRC (Gary) –setup and admin experiences –Partner ads Cluster user group?

Scientist to Scientist

Support for Scientists

Shared Resources--Alvarez

Shared Resources--PDSF

Shared Resources—Existing Cluster

Shared Resources—NERSC Center

Shared Resource--Institutional Identify the full population of MRCs and the total of the individual costs of management, i.e., are there economies of scale to be gained. What science could we do if we had an MRC that we’re not doing now? What science could we do cheaper and faster with an MRC? There is unsatisfied demand for MRC, quantify? How much MPP, how much serial?

Miscellaneous Barrier to enter parallel coding exists: –Collaboration between computer scientists and potential computational scientists –Computational scientist to computational scientist help will be hard to come by, given dollars and time –There exists NERSC training and NERSC web- based training

Miscellaneous Better turnaround than PDSF, ability for single user to meet a deadline Program-specific, non-sharable (or reservable), resources for real-time computing/analysis in support of large-scale data acquisition, e.g., gamma-ray spectrometer, electron microscope, telescope

Miscellaneous Mini-proceedings of this workshop How do we help those whose software is at the cusp? Comments: –There’s a better way to do things than what we’re doing now, but it’s hard to identify. –Pooling resources increases instantaneous CPU bandwidth.

Miscellaneous –Learn from PDSF model. –Clusters can be optimized for applications. One size cluster does not fit all. Need to determine specific application needs (possible consulting). –Pessimism about shared resources. Alvarez unstable, PDSF not sufficiently generic, sharing with NERSC has difficulties. –Collect information about existing MRC usage, platforms, and success/non-success stories. –Piggybacking or building on existing cluster could result from success stories. –Professional support appears overly expensive. Can these costs come down with time?

Miscellaneous Two solutions would fit most people: explore more nodes on IBM SP, or consider loss-leader on ITSD Linux cluster Surprised that focus is mostly on clusters. Not sure all applications can use clusters. Other architectures? No center of knowledge on clusters. Web page may be beginning of that. People on the cusp need to have a cluster to try. Need interactive forum.

Miscellaneous Open-source clusters. Some groups’ needs already being met by NERSC Develop computational requirements model and cost it Prepurchase consulting including match-making Some groups need centralized computer room facilities and central administration, but pessimistic about sharing a computing resource Small clusters should be optimized for specific applications; sharing them is couter-intuitive.

Miscellaneous What can ITSD provide that fits within existing funding: acquisition advice, housing, not systems administration Systems administration is seen as desirable but expensive Acquiring institutional system or institutional subsidy of systems administration has major hurdles Joining PDSF or similar model system is viable option for some groups.

Miscellaneous Software training in parallelization (scientist to scientist) Parallel programs user group. SMPs may have advantage. Early economies of scale seem to be in order of 50%. Community is not ready for resource sharing, systems admin is critical but expensive; information sharing is the best path forward.

Miscellaneous Have to make scientific case for long-term solution; short-term solutions may disappear. There’s a point where if you can’t do it faster and better, you’re not going to do it at all. Some groups are at that point. Helpful to have division person participating with ITSD in building cluster, so they’re trained for support. Scientists should be doing science, not IT. Professionals can do a better job.

Path Forward Proceedings Detailed Models Web site/ list