Click to Edit Master Subtitle Style HPC USER FORUM I/O PANEL April 2009 Roanoke, VA Panel questions: 1 response per question Limit length to 1 slide.

Slides:



Advertisements
Similar presentations
1 Building a Dynamic Datacenter with Oracle over NFS and NetApp Blackboard Managed Hosting (sm) Peter Waterman Senior Manager of Technology and Innovation.
Advertisements

The Internet2 NET+ Services Program Jerry Grochow Interim Vice President CSG January, 2012.
“We recently turned to Tech Data to perform some standard configurations for a project that included fourteen 4510 switches. As a Gold partner we have.
By Adam Balla & Wachiu Siu
Cloud Computing to Satisfy Peak Capacity Needs Case Study.
1 Vladimir Knežević Microsoft Software d.o.o.. 80% Održavanje 80% Održavanje 20% New Cost Reduction Keep Business Up & Running End User Productivity End.
HPC USER FORUM I/O PANEL April 2009 Roanoke, VA Panel questions: 1 response per question Limit length to 1 slide.
VoipNow Core Solution capabilities and business value.
Cache Coherent Distributed Shared Memory. Motivations Small processor count –SMP machines –Single shared memory with multiple processors interconnected.
The Triumph of Hope over Experience * ? Bill Gropp *Samuel Johnson.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP StoreOnce How to win.
Antony Jo The University of Montana. Virtualization  The process of abstraction; making something more abstract  Many types: Server Desktop Application.
We all know the world is changing… Upgrades may break apps We need sufficient time to test Our key software vendors need time to test & issue statements.
Asper School of Business University of Manitoba Systems Analysis & Design Instructor: Bob Travica System architectures Updated: November 2014.
Semester 4 - Chapter 3 – WAN Design Routers within WANs are connection points of a network. Routers determine the most appropriate route or path through.
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
The Strategy of International Business
Microsoft ® Application Virtualization 4.5 Infrastructure Planning and Design Series.
Microsoft ® Application Virtualization 4.6 Infrastructure Planning and Design Published: September 2008 Updated: February 2010.
Banking Clouds V International Youth Banking Forum.
Constellation Technologies Providing a support service to commercial users of gLite Nick Trigg.
VAP What is a Virtual Application ? A virtual application is an application that has been optimized to run on virtual infrastructure. The application software.
Design Windows Media Services Infrastructure. Module 7: Design Windows Media Services Infrastructure Design Windows Media Services for live streaming.
SGI Proprietary SGI Update IDC HPC User Forum September, 2008.
Microsoft ® Application Virtualization 4.6 Infrastructure Planning and Design Published: September 2008 Updated: November 2011.
1 Advanced Storage Technologies for High Performance Computing Sorin, Faibish EMC NAS Senior Technologist IDC HPC User Forum, April 14-16, Norfolk, VA.
Meeting the Data Protection Demands of a 24x7 Economy Steve Morihiro VP, Programs & Technology Quantum Storage Solutions Group
System Management for Virtualization and Automation in a Dynamic Data Center SVM’08 Munich Karsten Beins, Sen. Director Infrastructure Technology.
HPC USER FORUM I/O PANEL April 2009 Roanoke, VA Panel questions: 1 response per question Limit length to 1 slide.
LOGO Service and network administration Storage Virtualization.
Storage Systems Market Analysis Dec 04. Storage Market & Technologies.
Tag line, tag line NetApp HPC Update 28 th HPC User Forum April 2008 Norfolk, Virginia.
Server Virtualization
Eric Burgener VP, Product Management A New Approach to Storage in Virtual Environments March 2012.
Actualog Social PIM Helps Companies to Manage and Share Product Information Using Secure, Scalable Ease of Microsoft Azure MICROSOFT AZURE ISV PROFILE:
Bizfss File Sync and Sharing Solution, Built on Microsoft Azure, Allows Businesses to Sync, Share, Back Up Using Their Own Cloud Storage MICROSOFT AZURE.
Securely Synchronize and Share Enterprise Files across Desktops, Web, and Mobile with EasiShare on the Powerful Microsoft Azure Cloud Platform MICROSOFT.
Built on Azure, Moodle Helps Educators Create Proprietary Private Web Sites Filled with Dynamic Courses that Extend Learning Anytime, Anywhere MICROSOFT.
Solvoyo Answers the Weaknesses of Existing Supply Chain Planning Systems and Elevates Performance, with Help from the Powerful Microsoft Azure Cloud MICROSOFT.
1 Recommendations Now that 40 GbE has been adopted as part of the 802.3ba Task Force, there is a need to consider inter-switch links applications at 40.
Company small business cloud solution Client UNIVERSITY OF BEDFORDSHIRE.
Discover the Newest Solution from Expertime: Magento + PimCore Running on Microsoft Azure MICROSOFT AZURE ISV PROFILE: EXPERTIME Expertime works with clients.
Enterprise Cloud Computing
Highest performance parallel storage for HPC environments Garth Gibson CTO & Founder IDC HPC User Forum, I/O and Storage Panel April 21, 2009.
Gaining Unprecedented Visibility into Microsoft Dynamics CRM with Halo’s Pipeline Advisor, Powered by the Microsoft Azure Cloud Platform MICROSOFT AZURE.
MidVision Enables Clients to Rent IBM WebSphere for Development, Test, and Peak Production Workloads in the Cloud on Microsoft Azure MICROSOFT AZURE ISV.
Simplifying Cloud Connectivity for Your Clients Presenter: Tom SharkeyTom Sharkey December 8,
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
Information Systems in Organizations 5.2 Cloud Computing.
Flight is a SaaS Solution that Accelerates the Secure Transfer of Large Files and Data Sets Into and Out of Microsoft Azure Blob Storage MICROSOFT AZURE.
STORAGE ARCHITECTURE/ MASTER): Where IP and FC Storage Fit in Your Enterprise Randy Kerns Senior Partner The Evaluator Group.
Axis AI Solves Challenges of Complex Data Extraction and Document Classification through Advanced Natural Language Processing and Machine Learning MICROSOFT.
1 TCS Confidential. 2 Objective : In this session we will be able to learn:  What is Cloud Computing?  Characteristics  Cloud Flavors  Cloud Deployment.
Tackling I/O Issues 1 David Race 16 March 2010.
Amazon Web Services. Amazon Web Services (AWS) - robust, scalable and affordable infrastructure for cloud computing. This session is about:
Azure-Powered Solution to Monitor, Manage and Backup Servers and Websites Lets Users Keep Control of IT Infrastructure and Prevent Downtime MICROSOFT AZURE.
PHD Virtual Technologies “Reader’s Choice” Preferred product.
Axway MailGate Unifies “Safe-for-Work” Solutions to Keep Your Enterprise as Secure as Possible in the Azure Cloud and/or Any Hybrid Environment MICROSOFT.
SuperComputing 2003 “The Great Academia / Industry Grid Debate” ?
Semester 4 - Chapter 3 – WAN Design
Free Cloud Management Portal for Microsoft Azure Empowers Enterprise Users to Govern Their Cloud Spending and Optimize Cloud Usage and Planning MICROSOFT.
Firefish Software for Professional Recruiters Stays Available Around the Clock from Any Device and Anywhere by Using the Microsoft Azure Platform Partner.
Introduction to Data Management in EGI
Upgrading to Microsoft SQL Server 2014
Excelian Grid as a Service Offers Compute Power for a Variety of Scenarios, with Infrastructure on Microsoft Azure and Costs Aligned to Actual Use MICROSOFT.
One-Stop Shop Manages All Technical Vendor Data and Documentation and is Globally Deployed Using Microsoft Azure to Support Asset Owners/Operators MICROSOFT.
XtremeData on the Microsoft Azure Cloud Platform:
HPC USER FORUM I/O PANEL April 2009 Roanoke, VA
Last.Backend is a Continuous Delivery Platform for Developers and Dev Teams, Allowing Them to Manage and Deploy Applications Easier and Faster MICROSOFT.
Factors Driving Enterprise NVMeTM Growth
Presentation transcript:

Click to Edit Master Subtitle Style HPC USER FORUM I/O PANEL April 2009 Roanoke, VA Panel questions: 1 response per question Limit length to 1 slide

Click to Edit Master Subtitle Style Q1: With the formalization of Parallel NFS as a standard - what steps are being provided to enable this to be hosted on current (and future) platform choices? Q2: What tools are available to help optimize this (from application layer level all the way to archival stage)? What is missing and who should provide it? Q3: We all are facing complexity and cost issues. With IB or 10 GbE (40/100 GbE) : where should the HPC community should focus its resources on - for all I/O? Q4: Too many standards. interconnects, media layers are issues today. iSCSI/FCOE/FcoCEE/FCoIB have all been touted as the solution(s). Is it even relevant in the HPC arena? Is fragmentation the only choice? Q5: What do you consider to be the top 3 main (technical or human) issues in HPC I/O?

Q1. Parallel NFS finally is here! Current platforms are likely to be folded in with non-parallel servers and updated with clients as parallel resources become of interest. Future general and capacity HPC systems will likely be sought with pNFS capabilities Allowing for decoupling of storage and compute system purchase cycles and potentially for more organic growth of the former. Future capability machines still warrant coupled storage capabilities Scale of compute and storage need follow technology trends such that buying storage today sufficient for a big system next year isn’t an efficient investment Similarly the working storage for last year’s system be sufficient for today’s. The lure of squeezing out “10% more” performance by using an accelerated access method is still strong for the core system, but the “out of the box” availability of parallel clients will better enable the data-center ecosystem (post processing, data transfer, archiving, front-end & other systems)

Q2. Parallel NFS – implementation details… The need to abstract some of the complication allows for faster adoption and easier usage, but tools for administrators to observe and analyze operations are likely to be crucial to realizing full potential. Tools for this purpose will necessarily come from some pNFS vendors, though development or contribution to the open community should help further adoption. Having a decent DIY option speeds adoption, though likely still leaves plenty of room for differentiated vendor offering for those who need more/better. Exposure of advanced controls for advanced users should also be present in the clients. Sane defaults set by administrators help, but “one size fits all” settings can be troublesome for a diverse application base.

Q3. Physical media interconnects …  Given enough time, Ethernet wins most battles. Datacenter heterogeneity and cost-effective 10GigE LOM likely to command volume for clients at large. Focus on backward compatibility and cost compromises may not serve the higher bandwidth needs.  IB bandwidth cost-effectiveness and density are still hard to beat. Current lead and narrower focus may allow IB to continue to be differentiated and attractive to the HPC [storage] market. Renewed ASIC competition should lead to better and/or cheaper options. LOMs already addressing host cost. Tiered/hybrid access (native IB clients vs. 10GigE Clients via gateways) fits with the needs of capability systems For HPC systems, meeting goals within budget is challenging and semi-commodity interconnects (IB) may still warrant their premium & effort.

Q4. Layer protocols above the interconnects HPC sites are often early adopters and become accustomed to working with technology selections for project durations even if the market shifts trends toward competing technology. Tolerance for less standardized technology is reasonably high, if the comparative advantages over more mainstream options are worthwhile. Use of locally attached storage, which is shared at the file or object level isolates many HPC installations from the pain of fragmentation. Convergence that leads to reduced costs and great choice through interoperability is a benefit to the HPC arena.

Q5. I/O issues not yet addressed?  Dealing with increased client count  File systems: Increasing core counts increase metadata load (not uncommon for file count increasing proportional to # compute cores)  Too much concurrency of sequential [user] streams may look random to the storage. (some relief via middleware such as PSC Zest, LANL PLFS)  Relaxing (suspending/breaking) POSIX compliance may help.  Increasing demand for database access as a means for coping with large data sets imposes IOPS demand orthogonal to aggressive bandwidth demands—can/should/must a common capability satisfy both?  Cost of storage media bandwidth is straining budgets to try to chase computational advances.  Newer technologies providing more options for IOPs or bandwidth, but not capacity—so disk (and tape) still in the picture and are not fully isolated from performance struggle.