Speeding up the development cycle: Stash your files on a Solid State Drive Harald Søvik Fagleder Computas.

Slides:



Advertisements
Similar presentations
Solid State Drive. Advantages Reliability in portable environments and no noise No moving parts Faster start up Does not need spin up Extremely low.
Advertisements

 Storage Capacity:3.75 MB  Physical Size:87.9 ft 3  Price for storage:15,000$/MB  Seek Time:600 ms  Rotational Speed:1200 RPM.
Query Processing and Optimizing on SSDs Flash Group Qingling Cao
EN-KO Elektronik Kontrol Sistemleri Network Structure Server Structure Server Specifications Security and Firewall Operating Systems Future Plans.
SYSTOR2010, Haifa Israel Optimization of LFS with Slack Space Recycling and Lazy Indirect Block Update Yongseok Oh The 3rd Annual Haifa Experimental Systems.
VSphere vs. Hyper-V Metron Performance Showdown. Objectives Architecture Available metrics Challenges in virtual environments Test environment and methods.
CS4432: Database Systems II Data Storage - Lecture 2 (Sections 13.1 – 13.3) Elke A. Rundensteiner.
IELM 230: File Storage and Indexes Agenda: - Physical storage of data in Relational DB’s - Indexes and other means to speed Data access - Defining indexes.
Hybrid Hard Disk Drive Radhika Patel. Basic Terms  HDD (Hard Disk Drive): storage center for data  SSD (Solid State Drive): same thing as a hard drive,
1 CS143: Disks and Files. 2 System Architecture CPU Main Memory Disk Controller... Disk Word (1B – 64B) ~ x GB/sec Block (512B – 50KB) ~ x MB/sec System.
CS4432: Database Systems II Lecture 2 Timothy Sutherland.
SSD (Flash-Based) Anthony Bonomi. SSD (Solid State Drive) Commercially available for only a few years Big use in laptops Released the first 512GB last.
MasterDrive MX SSD Solid State Drive The Ultimate Consumer SSD Low Power Consumption Built-to-last Reliability Lightweight Impressive Performance Drop.
Iometer: Why, What, Where, and How? Presented By Sohail Sarwar Supervisor Dr. Raihan Ur Rasool 1.
1 CS : Technology Trends Ion Stoica ( September 12, 2011.
SQL Server 2008 & Solid State Drives Jon Reade SQL Server Consultant SQL Server 2008 MCITP, MCTS Co-founder SQLServerClub.com, SSC
 A basic overview  Presented by:  Steve Jones, Gran-IT Consulting, Inc.
Buying a Laptop. 3 Main Components The 3 main components to consider when buying a laptop or computer are Processor – The Bigger the Ghz the faster the.
Slide 1 Windows PC Accelerators Reporter :吳柏良. Slide 2 Outline l Introduction l Windows SuperFetch l Windows ReadyBoost l Windows ReadyDrive l Conclusion.
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
Disk Fragmentation Refers to the condition of a disk in which files are divided into pieces scattered around the disk. Occurs naturally when frequently.
MySQL and SSD: Usage Patterns MySQL Conference & Expo Apr-2011 Vadim Tkachenko Co-founder, CTO, Percona Inc Date, time, place: Reporter:
CMPTR Chapter 2 – Part 2 (Storage). Storage – Punch Cards Player Piano Roll Punch Cards were used before disk drives.
On Windows File Access Modes : A Performance Study Jalil Boukhobza & Claude Timsit laboratory Versailles Saint Quentin University.
Improving Disk Latency and Throughput with VMware Presented by Raxco Software, Inc. March 11, 2011.
Hardware Trends. Contents Memory Hard Disks Processors Network Accessories Future.
Strata IT Training Chapter 10 Advanced Storage Topics.
A Case for Flash Memory SSD in Enterprise Database Applications Authors: Sang-Won Lee, Bongki Moon, Chanik Park, Jae-Myung Kim, Sang-Woo Kim Published.
Sys Admin Course Physical Storage and File Systems Fourie Joubert.
Describing Storage Devices  Storage terms  Media is the material storing data  Storage devices manage the media  Magnetic devices use a magnet  Optical.
Price Performance Metrics CS3353. CPU Price Performance Ratio Given – Average of 6 clock cycles per instruction – Clock rating for the cpu – Number of.
August 2008 WD VelociRaptor 10K RPM 2.5” and 3.5” Enterprise SATA.
12/18/20151 Operating Systems Design (CS 423) Elsa L Gunter 2112 SC, UIUC Based on slides by Roy Campbell, Sam.
Checking the “quiz”. Lesson Objectives 0 By the ened of the class you should be able to: 0 Compare the three kinds of primary storage devices. 0 Determine.
FAT File Allocation Table
Google Chrome OS: A New Frontier in the World of OS.
PROOF tests at BNL Sergey Panitkin, Robert Petkus, Ofer Rind BNL May 28, 2008 Ann Arbor, MI.
Explain one advantage and one disadvantage of solid sate storage over magnetic storage? By Liverpool and Southampton.
HARD DISK Prabhavati M. (985450) Kamal Gidwani (962841) Sharvari Joshi (962281) Poonam Rode (985500) Rajesh S. (962206) )
 System Requirements are the prerequisites needed in order for a software or any other resources to execute efficiently.  Most software defines two.
Jérôme Jaussaud, Senior Product Manager
1 WD Caviar Green ™ Cooler, Quieter, More Eco-Friendly WD10EARS WD Caviar Green 1 TB, 64 MB WD Caviar Green ™ Cooler, Quieter, More Eco-Friendly WD10EARS.
Programmer’s View of Files Logical view of files: –An a array of bytes. –A file pointer marks the current position. Three fundamental operations: –Read.
Product Manager Jason Hsu 2016 Feb. 24
Andrew Hanushevsky: File System I/O First INFN International School on Architectures, tools and methodologies for developing efficient large scale scientific.
SQL Server Internals 101 AYMAN SENIOR MICROSOFT.
Advanced Office Desktop. The Chassis CoolerMaster CM690 II Advanced.
CS422 Principles of Database Systems Disk Access Chengyu Sun California State University, Los Angeles.
Ayman El-Ghazali Senior Microsoft.
Indexing strategies and good physical designs for performance tuning Kenneth Ureña /SpanishPASSVC.
SSD Vs HDD (Solid State Drive Versus Hard Disk Drive) By Matthew Nicholls Pilbeam
Starter You have 2 minutes to find out: 1.What is the fastest type of computer memory? 2.Where would you normally find it?
Requirements & Migration
Join Processing for Flash SSDs: Remembering Past Lessons
Solid State Disks Testing with PROOF
Jenny Pange University of Ioannina
The (Solid) State Of Drive Technology
Introduction To Computers
Introduction to Computers
Join Processing for Flash SSDs: Remembering Past Lessons
File Processing : Storage Media
VNX Storage Report Project: Sample VNX Report Project ID:
Unity Storage Array Profile
File Processing : Storage Media
Barracuda® 3.5’’ Hard Drives
Seagate Hard Disk Drives New Lower Prices
Monitor Producer Consumer.
DataOptimizer Transparent File Tiering for NetApp Storage Robert Graf
Introduction to Operating Systems
The Design and Implementation of a Log-Structured File System
Presentation transcript:

Speeding up the development cycle: Stash your files on a Solid State Drive Harald Søvik Fagleder Computas

Agenda Thesis: Thesis: Put your build system on a solid state drive Put your build system on a solid state drive Reduce build time by 50% Reduce build time by 50%

Disk I/O (write req / sec) write intensive : write intensive : delete directories delete directories copy resources copy resources compile source compile source install install

Disk I/O (read req / sec) read intensive: read intensive: copy resources copy resources compile compile copy artifacts copy artifacts expand artifacts expand artifacts average case: average case: 1000 req/sec 1000 req/sec 4.2 ms / req 4.2 ms / req 4.2 s/s 4.2 s/s

Solid State Drive available to consumers at budget prices available to consumers at budget prices better overall search time better overall search time <0.1ms vs ~4.2ms <0.1ms vs ~4.2ms

Build experiment 2 storage technologies 2 storage technologies HDD HDD Barracuda SATA2 3.0Gb/s 500GB Barracuda SATA2 3.0Gb/s 500GB 16MB cache, seek ~4.2ms 16MB cache, seek ~4.2ms SDD SDD OCZ Vertex 1275 SDD SATA2 60GB OCZ Vertex 1275 SDD SATA2 60GB 64MB cache, seek <0.1ms 64MB cache, seek <0.1ms 2 file systems 2 file systems Windows (NTFS) Windows (NTFS) Linux (ext3) Linux (ext3) 100 builds each 100 builds each no tests no tests no pmd no pmd offline offline

Build results

Results 10 builds / day 10 builds / day worst case: 3380 sec = 56m 20s worst case: 3380 sec = 56m 20s best case: 1440 sec = 24m best case: 1440 sec = 24m no tests/pmd no tests/pmd Δ 32 min / day Δ 32 min / day return time ~1 week return time ~1 week

Roll out: with tests/pmd Avg net gain: 4,0 min / dev / build

Roll out: no tests/pmd Avg net gain: 4,2 min / dev / build

After 3 months (with test/pmd)

After 3 months (no test/pmd)

Avg build times

Conclusion Stuck on windows ? Stuck on windows ? ssd is good for you ssd is good for you Avg gain Avg gain ~4 min / build ~4 min / build mileage may vary mileage may vary Side effects Side effects faster svn faster svn faster, more responsive ide faster, more responsive ide

The End