Indiana University - IBM Visit IT at IU. n Please cite as: Stewart, C.A. 2001. IU. Presentation. Presented at IBM T.J. Watson Research Center, Feb.

Slides:



Advertisements
Similar presentations
C3.ca in Atlantic Canada Virendra Bhavsar Director, Advanced Computational Research Laboratory (ACRL) Faculty of Computer Science University of New Brunswick.
Advertisements

What is Cyberinfrastructure?
Beowulf Supercomputer System Lee, Jung won CS843.
Background Chronopolis Goals Data Grid supporting a Long-term Preservation Service Data Migration Data Migration to next generation technologies Trust.
Bill Barnett, Bob Flynn & Anurag Shankar Pervasive Technology Institute and University Information Technology Services, Indiana University CASC. September.
Data Gateways for Scientific Communities Birds of a Feather (BoF) Tuesday, June 10, 2008 Craig Stewart (Indiana University) Chris Jordan.
Status of IU’s E10000 and recent activities with Sun Sun NDA Visit June Craig Stewart, Ph.D. Please cite as: Stewart, C.A. Status.
SDSC Computing the 21st Century Talk Given to the NSF Sugar Panel May 27, 1998.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
1 Supplemental line if need be (example: Supported by the National Science Foundation) Delete if not needed. Supporting Polar Research with National Cyberinfrastructure.
FACULTY OF COMPUTER SCIENCE OUTPUT DD  annual event from students for students with contact to industry (~800 visitors)  live demonstrations  research.
UNIVERSITY of MARYLAND GLOBAL LAND COVER FACILITY High Performance Computing in Support of Geospatial Information Discovery and Mining Joseph JaJa Institute.
1 Int System Introduction to Systems and Networking Department Faculty of Computer Science and Engineering Ho Chi Minh City University of Technology.
Waters Corporation Connecting Data to Decisions John Swallow Principal Engineer Waters Data Products
Pti.iu.edu /jetstream Award # A national science & engineering cloud funded by the National Science Foundation Award #ACI Prepared for the.
Research & Academic IU Bradley C. Wheeler Associate Vice President & Dean Office of the VP for Information Technology & CIO
INDIANAUNIVERSITYINDIANAUNIVERSITY April 2002 Implementing advanced IT facilities for the Indiana Genomics Initiative Craig A. Stewart
Compaq - Indiana University Visit IU’s Compaq Parallel PC Cluster.
FutureGrid: an experimental, high-performance grid testbed Craig Stewart Executive Director, Pervasive Technology Institute Indiana University
Statewide IT Conference, Bloomington IN (October 7 th, 2014) The National Center for Genome Analysis Support, IU and You! Carrie Ganote (Bioinformatics.
Research & Academic Computing Bradley C. Wheeler Associate Vice President & Dean.
Research Cyberinfrastructure Alliance Working in partnership to enable computationally intensive, innovative, interdisciplinary research for the 21 st.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
Craig Stewart 23 July 2009 Cyberinfrastructure in research, education, and workforce development.
INDIANAUNIVERSITYINDIANAUNIVERSITY January 2002 INGEN's advanced IT facilities Craig A. Stewart
PCGRID ‘08 Workshop, Miami, FL April 18, 2008 Preston Smith Implementing an Industrial-Strength Academic Cyberinfrastructure at Purdue University.
Goodbye from Indianapolis, IUPUI, and Craig A. Stewart Executive Director, Pervasive Technology Institute Associate Dean, Research Technologies Indiana.
Big Red II & Supporting Infrastructure Craig A. Stewart, Matthew R. Link, David Y Hancock Presented at IUPUI Faculty Council Information Technology Subcommittee.
I-Light: A Network for Collaboration between Indiana University and Purdue University Craig Stewart Associate Vice President Gary Bertoline Associate Vice.
The National Center for Genome Analysis Support as a Model Virtual Resource for Biologists Internet2 Network Infrastructure for the Life Sciences Focused.
Leveraging the National Cyberinfrastructure for Top Down Mass Spectrometry Richard LeDuc.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. The IQ-Table & Collection Viewer A.
RNA-Seq 2013, Boston MA, 6/20/2013 Optimizing the National Cyberinfrastructure for Lower Bioinformatic Costs: Making the Most of Resources for Publicly.
Pti.iu.edu /jetstream Award # funded by the National Science Foundation Award #ACI Jetstream - A self-provisioned, scalable science and.
Pti.iu.edu /jetstream Award # funded by the National Science Foundation Award #ACI Jetstream Overview – XSEDE ’15 Panel - New and emerging.
Tools for collaboration How to share your duck tales…
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Capability Computing - User Environment Anke Kamrath Associate Director, SDSC
INDIANAUNIVERSITYINDIANAUNIVERSITY Spring 2000 Indiana University Information Technology University Information Technology Services Please cite as: Stewart,
November 18, 2015 Quarterly Meeting 30Aug2011 – 1Sep2011 Campus Bridging Presentation.
February 27, 2007 University Information Technology Services Research Computing Craig A. Stewart Associate Vice President, Research Computing Chief Operating.
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Capability Computing – High-End Resources Wayne Pfeiffer Deputy Director NPACI & SDSC NPACI.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
A national science & engineering cloud funded by the National Science Foundation Award #ACI Craig Stewart ORCID ID Jetstream.
Recent key achievements in research computing at IU Craig Stewart Associate Vice President, Research & Academic Computing Chief Operating Officer, Pervasive.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. Update on EAGER: Best Practices and.
Award # funded by the National Science Foundation Award #ACI Jetstream: A Distributed Cloud Infrastructure for.
Jetstream: A new national research and education cloud Jeremy Fischer ORCID Senior Technical Advisor, Collaboration.
A national science & engineering cloud funded by the National Science Foundation Award #ACI Craig Stewart ORCID ID Jetstream.
1 A national science & engineering cloud funded by the National Science Foundation Award #ACI Craig Stewart ORCID ID Jetstream.
Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.
National Computational Science Ky PACS at the University of Kentucky April 2000 –Advanced Computing Resources –EPSCoR Outreach –SURA Liaison –John.
© Trustees of Indiana University Released under Creative Commons 3.0 unported license; license terms on last slide. Informatics Tools at the Indiana CTSI.
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
HPC University Requirements Analysis Team Training Analysis Summary Meeting at PSC September Mary Ann Leung, Ph.D.
Northwest Indiana Computational Grid Preston Smith Rosen Center for Advanced Computing Purdue University - West Lafayette West Lafayette Calumet.
Jetstream Overview Jetstream: A national research and education cloud Jeremy Fischer ORCID Senior Technical Advisor,
© 2007 IBM Corporation IBM Software Strategy Group IBM Google Announcement on Internet-Scale Computing (“Cloud Computing Model”) Oct 8, 2007 IBM Confidential.
PAUL STACEY Except where otherwise noted these materials are licensed under a Creative Commons Attribution 3.0 (CC BY)CC BY Open Licensing Requirements.
Page : 1 SC2004 Pittsburgh, November 12, 2004 DEISA : integrating HPC infrastructures in Europe DEISA : integrating HPC infrastructures in Europe Victor.
Research & Academic Computing Indiana University Statewide IT Conference 11 September 2003 Indianapolis IN.
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
Deploying Regional Grids Creates Interaction, Ideas, and Integration
Clouds , Grids and Clusters
Matt Link Associate Vice President (Acting) Director, Systems
funded by the National Science Foundation Award #ACI
Dr. Craig A. Stewart Orcid ID:
Research and Academic Computing Division
Presentation transcript:

Indiana University - IBM Visit IT at IU

n Please cite as: Stewart, C.A IU. Presentation. Presented at IBM T.J. Watson Research Center, Feb. 7, Hawthorne, NY. Available from: n Except where otherwise noted, the contents of this presentation are © by the Trustees of Indiana University. This content is released under the Creative Commons Attribution 3.0 Unported license ( This license includes the following terms: You are free to share – to copy, distribute and transmit the work and to remix – to adapt the work under the following conditions: attribution – you must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). For any reuse or distribution, you must make clear to others the license terms of this work.

Highlights of IU ’ s IT Efforts Relevant to IBM n Major presence in High Performance Computing u 2 systems in top 500 list u Important CS&E research u Interdisciplinary use of HPC resources n Mass storage systems: leader and innovator n International leader in High Performance Networking: I2, vBNS, Abilene, TransPAC n Growing Digital Libraries projects

Indiana University n Founded in 1820 n $2B Annual Budget n A diverse student enrollment of over 90,000 n One of the nation’s top 10 public research universities n Excellent academic preparation: 878 degree programs; > 100 majors; >60 academic programs ranked among the nation’s top 20 n 3,900 faculty

Indiana University Campuses

Information IU n Approximately $70M annual budget n 500 information technology staff members n Academic programs in IT through computer science, library and information science, engineering and technology, programs. (Also, new IU School of Informatics) n Technology services offered university wide n All IT matters at IU are the responsibility of the Vice President for Information Technology

University Information Technology Services n Teaching and Learning Information Technologies n University Information Services n Telecommunications (Christopher Peebles, Acting Associate Vice President) n Research and Academic Computing (Christopher Peebles, Associate Vice President) u Computation (Craig Stewart, Director) u Data, including Digital Libraries and Massive Data Storage Project (Gerry Bernbom, Director) u High Performance Network Applications Initiative (D. F. “Rick” McMullen, Principal Scientist, Advanced Information Technology Laboratory)

IU n Charter member of Internet2 n vBNS connections grant n Lead US institution in TransPAC (connection between vBNS and APAN) n Abilene NOC n High Performance Network Applications Initiative

Digital IU n Variations Project n LETRS (Library Electronic Text Services) n Hoagy Carmichael Project n DLI-2 Proposal

IU n Major partnership between IU and IBM n HPSS, IBM RS/6000 SP, IBM SSA Disk n Initially 1 TB disk, 17 TB tape n Innovative Web interface using DFS and HPSS n Ongoing research partnership between IU and IBM

Computational IU n 47P IBM RS/6000 SP. IU’s largest supercomputer, currently 357th on Top500 List. Primary parallel and research computing resource for IU. n 64P SGI Origin2000. Currently 385th on Top500 List n 64P Compaq PC Cluster (32 2-processor Compaq Proliants) n Significant (and growing) presence of Sun servers for interactive computing

IU ’ s Parallel PC cluster n 32 Compaq Proliant, dual Pentium II n Key feature: Evenhanded approach to OS issues. Key questions: Which is better under what circumstances? n Combination of computer science research, (production) scientific calculation, and artistic applications n One of three installations in US using NT and Linux interchangeably on same hardware n NSF MRI Proposal

IU ’ s SGI Origin 2000 n Purchased via NSF Infrastructure grant n Used primarily by an interdisciplinary team of 12 research labs, in fields ranging from Astronomy to Theatre n Used for some of the largest Radiance jobs ever rendered

IU ’ s IBM RS/6000 SP n Primary computational resource for IU researchers, ranging from beginning grad students to computer science researchers n Robustness and architecture of IBM RS/6000 SP provide excellent services to this great breadth of users (SPSS to MPI) n The RS/6000 SP has the Globus toolkit installed, and is a key component of our distributed computing efforts

IU - Key areas of intellectual leadership n HPC software technologies, esp. distributed HPC n Cosmology & astrophysics n Computational Chemistry n High Energy Physics (Quantum Chromodynamics) n HPC best practices, practical uses of distributed computing n Virtual Reality, Photorealistic rendering, virtual shopping n Broad, multidisciplinary use of HPC technology

Brief history of IU/IBM Collaborations n IBM 3090 in support of quantum chemistry algorithm development (Davidson) - MELD n Two SUR grants in support of VARIATIONS n SUR grant for IBM SP2, for development of HPC++ and middleware for geographically distributed computing (Gannon) - HPC++, PARDIS n SUR grant for IBM SP Upgrade for Component Technology development (Bramley) - CAT n Major partnership announcement May 25th!

Notable HPC Awards/Presentations n HPC Challenge - SC95 - Best Integration of Heterogeneous Applications. “Galaxies Collide on the I- WAY: An Example of Wide-Area Collaborative Supercomputing.” Team lead by Dennis Gannon n HPC Challenge - SC98 - Best Industrial Collaboration. “"Industrial Mold Filling Simulation Using an Internationally Distributed Software Component Architecture.” Team lead by Randall Bramley n CASCON ‘98: Component architecture toolkit (Bramley); Evolutionary biology and distributed computing (Stewart et al.)

Component Architecture Toolkit n Component architectures revolutionized desktop computing, but have so far had less impact on HPC n IU is a leader in development of component technologies for HPC, and a member of the DOE 2000 CCA group n Significant results already building upon the LSA and implementing the CAT for IBM RS/6000 SPs n The CAT is ideal as a vehicle for exploitation of high performance computing and networking resources n As hardware converges upon clusters of SMP systems, do we really expect many scientists using HPC systems to master MPI, OpenMP, and how to mix them optimally?

Cat Workspace and Info Browser

i GRID n An international collaborative demonstration project to prototype next-generation network-based research and education tools shown at SC98. Partnership between EVL and IU. n Twenty applications demonstrated projects of international collaborative research involving sites located in ten countries around the world. n Demonstrations from the fields of metacomputing (computational fluid dynamics, cosmology and biology); shared virtual workspaces; digital video; tele- manufacturing; instrument control

i GRID Sites vBNS ESNet NREN Teleglobe CANTAT-3 CA*Net2 TransPAC (to APAN) TANet SINGAren

The problem with grids... n How do you create more than a transient demonstration project? n IU is leading multinational effort to create a “free (cycle) trade zone” in support of bioinformatics and evolutionary biology computations with NUS and ACSys n IU is leading efforts to create a persistent computational grid within the CIC n IU is a key partner in the NCSA Alliance

QCD n Prof. Gottlieb is an internationally recognized leader in Lattice Gauge Theory and Quantum Chromodynamics n Gottlieb’s QCD code has been run on a variety of HPC hardware, including PC clusters (Gottlieb Lab, UITS, NCSA, UNM), NCSA Origin2000s n Initial tests with scaling of QCD codes on Power3 nodes yielded disappointing scalability. Investigating and correcting this would be interesting and useful

Evolutionary Biology n International collaboration based primarily on IBM RS/6000 SPs at IU and National University of Singapore n Leverages commonalities in HPC hardware, code, and research interests

IU ’ s Massive Data Storage Project n Based on IBM hardware, HPSS n Now: 1 TB spinning disk, 17 TB tape n Soon: 2 TB spinning disk, 57 TB tape n Serves both academic and business needs of IU. VTS used to automate and improve tape handling.

IU ’ s Massive Data Storage Project n Web-based front end to Massive Data Store - permits easy access to data without installation of additional clients via JavaScript, DFS, and HPSS n Web interface designed to handle both large files and small files (student use). Key question: how to package and manage large numbers of small files n Data management and access a key area of IU’s HPC research activities

Goals for this visit n Present our accomplishments stemming from our partnership with IBM and previous SUR grants. n Strengthen and deepen research relationships between Indiana University and IBM in areas of mutual interest. n Identify areas of joint interest in deep computing research; set plans for joint HPC research activities in the coming year. n Identify opportunities for collaboration in high performance networking applications and digital libraries.

Indiana University - IBM Visit Thank you. Any questions? Craig Stewart Director (Computation), Research & Academic Computing University Information Technology Services, IU