Presentation is loading. Please wait.

Presentation is loading. Please wait.

Solid State Disks Testing with PROOF

Published byLesley Montgomery Modified over 6 years ago

Similar presentations

Presentation on theme: "Solid State Disks Testing with PROOF"— Presentation transcript:

1 Solid State Disks Testing with PROOF
Sergey Panitkin, Robert Petkus, Ofer Rind BNL

2 Current BNL PROOF Farm Configuration
“Old farm”-Production 10 nodes – 4 GB RAM each 40 cores: 1.8 GHz Opterons 20 TB of HDD space (10x4x500 GB) “New Farm” – test site 10 nodes GB RAM each 80 cores: 2.0 GHz Kentsfields 5 TB of HDD space (10x500 GB) 640 GB SSD space (10x64 GB) + Sergey Panitkin

3 New Solid State Disks@ BNL
Model: Mtron MSP-SATA Capacity 64 GB Average access time ~0.1 ms (typical HD ~10ms) Sustained read ~120MB/s Sustained write ~80 MB/s IOPS (Sequential/ Random)  81,000/18,000 Write endurance  >140 50GB write per day MTBF  1,000,000 hours 7-bit Error Correction Code Sergey Panitkin

4 Test configuration 1+1 or 1+8 nodes PROOF farm configurations
2x4 core Kentsfield CPUs per node, 16 GB RAM per node All default settings in software and OS Different configuration of SSD and HDD hardware depending on tests Root – latest production version “PROOF Bench” suit of benchmark scripts to simulate analysis in root. Part of root distribution. Data simulate HEP events ~1k per event Single ~3+ GB file per PROOF worker in this tests Reboot before every test to avoid memory caching effects This set of tests emulates interactive, command prompt root session Plot one variable, scan ~10E7 events, ala D3PD analysis Looking at read performance of I/O subsystem Sergey Panitkin

5 SSD Tests Typical test session in root Sergey Panitkin

6 SSD vs HDD CPU limited SSD holds clear speed advantage
~ 10 times faster in concurrent read scenario Sergey Panitkin

7 SSD vs HDD With 1 worker : M events, MB read out of ~3 GB of data on disk With 8 workers: 42.5M events, MB read out of ~24 GB of data Sergey Panitkin

8 SSD: single disk vs RAID
Sergey Panitkin

9 SSD vs HDD. 8 node farm Aggregate (8 node farm) analysis rate as a function of number of workers per node Almost linear scaling with number of nodes Sergey Panitkin

10 Summary SSD offer significant performance advantage in concurrent analysis environment ~x10 better read performance than HD in our test More results will be shown tomorrow More tests are planned ARA on AODs and DPDs Different hardware configurations Sergey Panitkin

Download ppt "Solid State Disks Testing with PROOF"

Similar presentations

Concurrent programming: From theory to practice Concurrent Algorithms 2014 Vasileios Trigonakis Georgios Chatzopoulos.

Concurrent programming: From theory to practice Concurrent Algorithms 2014 Vasileios Trigonakis Georgios Chatzopoulos.
VSphere vs. Hyper-V Metron Performance Showdown. Objectives Architecture Available metrics Challenges in virtual environments Test environment and methods.

VSphere vs. Hyper-V Metron Performance Showdown. Objectives Architecture Available metrics Challenges in virtual environments Test environment and methods.
Shimin Chen Big Data Reading Group.  Energy efficiency of: ◦ Single-machine instance of DBMS ◦ Standard server-grade hardware components ◦ A wide spectrum.

Shimin Chen Big Data Reading Group.  Energy efficiency of: ◦ Single-machine instance of DBMS ◦ Standard server-grade hardware components ◦ A wide spectrum.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.

K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
Ji-Yong Shin Cornell University In collaboration with Mahesh Balakrishnan (MSR SVC), Tudor Marian (Google), and Hakim Weatherspoon (Cornell) Gecko: Contention-Oblivious.

Ji-Yong Shin Cornell University In collaboration with Mahesh Balakrishnan (MSR SVC), Tudor Marian (Google), and Hakim Weatherspoon (Cornell) Gecko: Contention-Oblivious.
SQL Server 2008 & Solid State Drives Jon Reade SQL Server Consultant SQL Server 2008 MCITP, MCTS Co-founder SQLServerClub.com, SSC

SQL Server 2008 & Solid State Drives Jon Reade SQL Server Consultant SQL Server 2008 MCITP, MCTS Co-founder SQLServerClub.com, SSC
Buying a Laptop. 3 Main Components The 3 main components to consider when buying a laptop or computer are Processor – The Bigger the Ghz the faster the.

Buying a Laptop. 3 Main Components The 3 main components to consider when buying a laptop or computer are Processor – The Bigger the Ghz the faster the.
Evaluation of Windows 7 RC Build 7100 By Muswera Walter Supervisor: Mr John Ebden Consultants: Billy Morgan and Jill Japp.

Evaluation of Windows 7 RC Build 7100 By Muswera Walter Supervisor: Mr John Ebden Consultants: Billy Morgan and Jill Japp.
1 Some Context for This Session…  Performance historically a concern for virtualized applications  By 2009, VMware (through vSphere) and hardware vendors.

1 Some Context for This Session…  Performance historically a concern for virtualized applications  By 2009, VMware (through vSphere) and hardware vendors.
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.

Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
Introduction to HP LoadRunner Getting Familiar with LoadRunner >>>>>>>>>>>>>>>>>>>>>> www.softwaretestinggenius.com

Introduction to HP LoadRunner Getting Familiar with LoadRunner >>>>>>>>>>>>>>>>>>>>>>
UTA Site Report Jae Yu UTA Site Report 4 th DOSAR Workshop Iowa State University Apr. 5 – 6, 2007 Jae Yu Univ. of Texas, Arlington.

UTA Site Report Jae Yu UTA Site Report 4 th DOSAR Workshop Iowa State University Apr. 5 – 6, 2007 Jae Yu Univ. of Texas, Arlington.
Hardware Trends. Contents Memory Hard Disks Processors Network Accessories Future.

Hardware Trends. Contents Memory Hard Disks Processors Network Accessories Future.
 Optimization and usage of D3PD Ilija Vukotic CAF - PAF 19 April 2011 Lyon.

 Optimization and usage of D3PD Ilija Vukotic CAF - PAF 19 April 2011 Lyon.
Experience with the Thumper Wei Yang Stanford Linear Accelerator Center May 27-28, 2008 US ATLAS Tier 2/3 workshop University of Michigan, Ann Arbor.

Experience with the Thumper Wei Yang Stanford Linear Accelerator Center May 27-28, 2008 US ATLAS Tier 2/3 workshop University of Michigan, Ann Arbor.
+ CS 325: CS Hardware and Software Organization and Architecture Memory Organization.

+ CS 325: CS Hardware and Software Organization and Architecture Memory Organization.
Price Performance Metrics CS3353. CPU Price Performance Ratio Given – Average of 6 clock cycles per instruction – Clock rating for the cpu – Number of.

Price Performance Metrics CS3353. CPU Price Performance Ratio Given – Average of 6 clock cycles per instruction – Clock rating for the cpu – Number of.
Resource Predictors in HEP Applications John Huth, Harvard Sebastian Grinstein, Harvard Peter Hurst, Harvard Jennifer M. Schopf, ANL/NeSC.

Resource Predictors in HEP Applications John Huth, Harvard Sebastian Grinstein, Harvard Peter Hurst, Harvard Jennifer M. Schopf, ANL/NeSC.
CS 360 Lecture 11.  In most computer systems:  The cost of people (development) is much greater than the cost of hardware  Yet, performance is important.

CS 360 Lecture 11.  In most computer systems:  The cost of people (development) is much greater than the cost of hardware  Yet, performance is important.
5/8/09 Titanium Performance Update 2 Dot Hill Confidential.

5/8/09 Titanium Performance Update 2 Dot Hill Confidential.

Similar presentations

Ads by Google