David A. Lifka Chief Technical Officer Cornell Theory Center Cornell Theory Center Windows High Performance Computing Solutions Center.

Slides:



Advertisements
Similar presentations
INDIANAUNIVERSITYINDIANAUNIVERSITY GENI Global Environment for Network Innovation James Williams Director – International Networking Director – Operational.
Advertisements

21 st Century Science and Education for Global Economic Competition William Y.B. Chang Director, NSF Beijing Office NATIONAL SCIENCE FOUNDATION.
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Joint CASC/CCI Workshop Report Strategic and Tactical Recommendations EDUCAUSE Campus Cyberinfrastructure Working Group Coalition for Academic Scientific.
© 2014 Burning Glass Technologies Matching People & Jobs Reemployment & Education Pathways Resume Parsing & Management Real-Time Jobs Intelligence Matching.
GENI: Global Environment for Networking Innovations Larry Landweber Senior Advisor NSF:CISE Joint Techs Madison, WI July 17, 2006.
EInfrastructures (Internet and Grids) US Resource Centers Perspective: implementation and execution challenges Alan Blatecky Executive Director SDSC.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
Tom Sheridan IT Director Gas Technology Institute (GTI)
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
Presented by Scalable Systems Software Project Al Geist Computer Science Research Group Computer Science and Mathematics Division Research supported by.
 Amazon Web Services announced the launch of Cluster Compute Instances for Amazon EC2.  Which aims to provide high-bandwidth, low- latency instances.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
David A. Lifka Chief Technical Officer Cornell Theory Center Cycle Scavenging with Windows The Virtues of Virtual Server David
David A. Lifka Chief Technical Officer Cornell Theory Center Data Intensive Computing Enabling Seamless High Performance Computing.
April 2009 OSG Grid School - RDU 1 Open Science Grid John McGee – Renaissance Computing Institute University of North Carolina, Chapel.
Introduction Name Company Affiliation Title/Function
Darema Dr. Frederica Darema NSF Dynamic Data Driven Application Systems (Symbiotic Measurement&Simulation Systems) “A new paradigm for application simulations.
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
Open Source Grid Computing in the Finance Industry Alex Efimov STFC Kite Club Knowledge Exchange Advisor UK CERN Technology Transfer Officer
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
Sept 29-30, 2005 Cambridge, MA 1 Grand Challenges Workshop for Computer Systems Software Brett D. Fleisch Program Director National Science Foundation.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
The STScI Advanced Computing and Testing Laboratory.
MIS3300_Team8 Service Aron Allen Angela Chong Cameron Sutherland Edment Thai Nakyung Kim.
Cloud Computing in NASA Missions Dan Whorton CTO, Stinger Ghaffarian Technologies June 25, 2010 All material in RED will be updated.
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
Part II - Microsoft ® Project 2000 Enterprise Deployment Templates.
Project 2003 Presentation Ben Howard 15 th July 2003.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
AITLAB 1 Ewusi-Mensah, Seal, Abraham Developing a Collaborative Learning Facility to Support Advanced Information Systems Courses: The LMU Experience Kweku.
Instrumentation of the SAM-Grid Gabriele Garzoglio CSC 426 Research Proposal.
Built on the Powerful Microsoft Azure Platform, Media Sonar Brings Social Media Investigation to the Public Cloud MICROSOFT AZURE ISV PROFILE: MEDIA SONAR.
Congress created the NSF in 1950 as an independent federal agency. Budget ~$7.0 billion (2012) Funding for basic research.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
The Swiss Grid Initiative Context and Initiation Work by CSCS Peter Kunszt, CSCS.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Windows Role-Based Access Control Longhorn Update
Securely Synchronize and Share Enterprise Files across Desktops, Web, and Mobile with EasiShare on the Powerful Microsoft Azure Cloud Platform MICROSOFT.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Internet2 AdvCollab Apps 1 Access Grid Vision To create virtual spaces where distributed people can work together. Challenges:
1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.
Barriers to Industry HPC Use or “Blue Collar” HPC as a Solution Presented by Stan Ahalt OSC Executive Director Presented to HPC Users Conference July 13,
Managing and Monitoring the Microsoft Application Platform Damir Bersinic Ruth Morton IT Pro Advisor Microsoft Canada
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
1 Cyber-Enabled Discovery and Innovation Michael Foster May 11, 2007.
1 LSST Town Hall 227 th meeting of the AAS 1/7/2016 Pat Eliason, LSSTC Executive Office Pat Osmer, LSSTC Senior Advisor.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.
High Risk 1. Ensure productive use of GRID computing through participation of biologists to shape the development of the GRID. 2. Develop user-friendly.
©2008 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED,
Windows Server 2012 Certification and Training
CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Tools and Services Workshop
Joslynn Lee – Data Science Educator
Dynamic Data Driven Application Systems
Dynamic Data Driven Application Systems
Windows Helps Enable Reliable Projections of Aircraft’s Technical & Operational Performance “Windows has enabled us to adapt our back office software for.
Cornell Theory Center Cornell Theory Center (CTC) is a high-performance computing and interdisciplinary research center at Cornell.
Cyberinfrastructure for the Life Sciences
GENI Global Environment for Network Innovation
Building and running HPC apps in Windows Azure
Administrative Software in Microsoft Azure Lets Companies Increase Productivity and Control “After conducting analysis and research for the best offer.
Defining the Grid Fabrizio Gagliardi EMEA Director Technical Computing
Presentation transcript:

David A. Lifka Chief Technical Officer Cornell Theory Center Cornell Theory Center Windows High Performance Computing Solutions Center A Center of Excellence in High Performance Computing and Interdisciplinary Research located at Cornell University CTC Manahattan A Globally Accessible Center Providing High Performance Computing Solutions to Today’s Business and Finance Problems located in the heart of the Financial District. Supporting World Class Computational Science Worlds First, and Largest, All Windows Production HPC Facility Corporate Program

David A. Lifka Chief Technical Officer Cornell Theory Center Microsoft Windows High Performance Computing Supporting over 100 Diverse Areas of Research at Cornell Computational Materials Institute Cornell Institute for Social and Economic Research Computational Biology Service Unit Computational Genomics Computational Finance

David A. Lifka Chief Technical Officer Cornell Theory Center

David A. Lifka Chief Technical Officer Cornell Theory Center CTC Clusters ClusterNodesProcsServerProcessorMemoryDiskNet CTCDN3264Dell 2450PIII 900 MHz2GB50GB-RAID5100BT MANDN48Dell 1650PIII 1.4GHz1GB30GB-RAID5100BT Total367272GB1.73TB ClusterNodesProcsServerProcessorMemoryDiskNet Velocity Dell 6350PIII Xeon 500 MHz 4GB50GB-RAID0Giganet + 100BT Velocity 1 Plus64128Dell 2450PIII 733 MHz2GB50GB-RAID0Giganet + 100BT CMI64128Dell 1550PIII 1GHz2GB50GB-RAID0Giganet + 100BT Development816Dell 1550PIII 800MHz2GB50GB-RAID0Giganet + 100BT Serial18 Dell 2450PIII 800MHz1GB50GB-RAID0100BT Long17 Dell 2450PIII 600MHz1GB50GB-RAID0100BT CBSU192384Dell 2650Xeon 2.4GHz2GB50GB-RAID0100BT CBWeb64128Dell 1550PIII 1GHz2GB50GB-RAID0Giganet + 100BT Velocity Dell 2650Xeon 2.4GHz2GB50GB-RAID01000BT Manhattan1632Dell 2650Xeon 2.4GHz2GB50GB-RAID01000BT Total5751, TB28.75TB

David A. Lifka Chief Technical Officer Cornell Theory Center David Lifka CTO Resa Alvord Systems Manager Lynn Baird Brenda Lapp Will Law Laurie McEvoy Ruth Mitchell Mike Padula Don Skillings Susan Mehringer Consulting Manager Linda Buttel Pat Colasurdo Susan Martin Daniel Sverdlik John Zollweg Slava Zaloj Lucy Walle R&D Manager Lee Grant Drew Dolgert Ken Ridley Hardik Shukla

David A. Lifka Chief Technical Officer Cornell Theory Center Data Intensive Computing Seamless Open Interfaces to Data Sources Arecibo - World’s largest Radiotelescope Johannes Gehrke, Jim Cordes, David Lifka, Jim Gray Serving Astronomy Data via SQL Server and Web Services Computational Materials Institute Tony Ingraffea, Keshav Pingali Serving Finite Element Models via SQL Server and Web Services Physically Accurate Imagery Steve Marschner The Structure and Evolution of the Web William Arms

David A. Lifka Chief Technical Officer Cornell Theory Center What makes one Job Scheduler better than another? Job Schedulers match resource requests to resources Job Schedulers provide mechanisms to implement policies Job Schedulers should be integrated with Resource Management Ease of Use & Administration Let the Database do the work Designed to perform tasks like resource matching Implementing Scheduling Algorithms and Policies is straight forward Ideal tool for Scalable Resource Management Don’t Reinvent what the Platform Provides Windows Server 2003 – Delegation & Impersonation Active Directory SQL Server Windows Management & Instrumentation Microsoft Message Queues Performance Alerts Identify “poison nodes” Node changes The Velocity Scheduler Motivation

David A. Lifka Chief Technical Officer Cornell Theory Center Connecting to the Grid with Standard Windows Components Certificate Server Web Server (IIS 6.0) Security Token Server SQL Certificate Database Domain Controller ClustersWorkstations SQL HPC Data Sources Local Job Scheduling & Resource Management RequestManager submit cancel restart submit JobScheduler RequestManager submit cancel restart submit JobScheduler RequestManager submit cancel restart submit JobScheduler RequestManager submit cancel restart submit JobScheduler RequestManager submit cancel restart submit JobScheduler

David A. Lifka Chief Technical Officer Cornell Theory Center Gordon Bell, senior researcher at Microsoft's Bay Area Research Center, concurs. "This project demonstrates the potential of a new way to build applications and the potential for a new software industry structure based on delivering results," he said. "Users don't have to buy apps programs and maintain a more complex software environment; they simply call a program or database. This is one of the few projects that I would call a Web Service, and it is well beyond what is running on today's experimental Grid.“ Frederica Darema, Senior Science and Technology Advisor in the CISE Directorate at NSF, is the cognizant NSF official for the ASP project. "It is to the credit of the scientists working on this project that they have developed such a cohesive collaboration," she said. "I am pushing for a new paradigm in application simulation and measurement capabilities called Dynamic Data Driven Application Systems, and the ASP model of multidisciplinary collaboration, together with the technology advances made by the project, are essential for enabling this new paradigm. I am very pleased with the outcomes of this project and its broader impact."

David A. Lifka Chief Technical Officer Cornell Theory Center Visualization CTC Visualization Information Innovative use of Windows based Virtual Reality and Visualization Using the CAVE to explore the three-dimensional structures of proteins OpenDX VTK for CAVE Animations

David A. Lifka Chief Technical Officer Cornell Theory Center Summary The CTC ApproachWindows HPC Community ServedCornell Research Community and Collaborators WhyTCO, Usability, Integrated Security, Development Environment, Innovation CostsHardware, Software, People Allocation IssuesPier Reviewed based on Academic Merit Cost RecoveryIndustry Clients & Partnerships, State & Federal Funding Agencies Proud of CTC making the Windows HPC vision a reality. GotchasNever get too Comfortable with a Solution. - expect more - always look to the future