CSE 542: Operating Systems

Slides:



Advertisements
Similar presentations
NetApp Confidential - Limited Use
Advertisements

Chapter 4 Threads Patricia Roy Manatee Community College, Venice, FL ©2008, Prentice Hall Operating Systems: Internals and Design Principles, 6/E William.
Chapter 16: Recovery System
Memory Protection: Kernel and User Address Spaces  Background  Address binding  How memory protection is achieved.
Department of Computer Science and Engineering University of Washington Brian N. Bershad, Stefan Savage, Przemyslaw Pardyak, Emin Gun Sirer, Marc E. Fiuczynski,
EXTENSIBILITY, SAFETY AND PERFORMANCE IN THE SPIN OPERATING SYSTEM B. Bershad, S. Savage, P. Pardyak, E. G. Sirer, D. Becker, M. Fiuczynski, C. Chambers,
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
1 Storage Today Victor Hatridge – CIO Nashville Electric Service (615)
Extensibility, Safety and Performance in the SPIN Operating System Brian Bershad, Stefan Savage, Przemyslaw Pardyak, Emin Gun Sirer, David Becker, Marc.
Background Computer System Architectures Computer System Software.
Extensibility, Safety and Performance in the SPIN Operating System Department of Computer Science and Engineering, University of Washington Brian N. Bershad,
Chapter 11: File System Implementation
Extensible Kernels Edgar Velázquez-Armendáriz September 24 th 2009.
Operating Systems CS451 Brian Bershad
G Robert Grimm New York University Extensibility: SPIN and exokernels.
Extensibility, Safety and Performance in the SPIN Operating System B. N. Bershad, S. Savage, P. Pardyak, E. G. Sirer, M. E. Fiuczyski, D. Becker, C. Chambers,
Extensibility, Safety and Performance in the SPIN Operating System Brian Bershad, Stefan Savage, Przemyslaw Pardyak, Emin Gun Sirer, Marc E. Fiuczynski,
Reliability Week 11 - Lecture 2. What do we mean by reliability? Correctness – system/application does what it has to do correctly. Availability – Be.
Extensibility, Safety and Performance in the SPIN Operating System Bershad et al Presentation by norm Slides shamelessly “borrowed” from Stefan Savage’s.
G Robert Grimm New York University Extensibility: SPIN and exokernels.
Extensibility, Safety and Performance in the SPIN Operating System Brian Bershad, Stefan Savage, Przemyslaw Pardyak, Emin Gun Sirer, Marc E. Fiuczynski,
Extensibility, Safety and Performance in the SPIN Operating System Dave Camarillo.
EEC-681/781 Distributed Computing Systems Lecture 3 Wenbing Zhao Department of Electrical and Computer Engineering Cleveland State University
Presentation of Extensibility, Safety and Performance in the SPIN Operating System Brain N. BershadStefan SavagePrzemyslaw Emin Gun Sirer Marc E.FiuczynskiDavid.
Extensible Kernels Mingsheng Hong. OS Kernel Types Monolithic Kernels Microkernels – Flexible (?) – Module Design – Reliable – Secure Extensible Kernels.
Servers Redundant Array of Inexpensive Disks (RAID) –A group of hard disks is called a disk array FIGURE Server with redundant NICs.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
LAN / WAN Business Proposal. What is a LAN or WAN? A LAN is a Local Area Network it usually connects all computers in one building or several building.
Disk Access. DISK STRUCTURE Sector: Smallest unit of data transfer from/to disk; 512B 2/4/8 adjacent sectors transferred together: Blocks Read/write heads.
Guide to Linux Installation and Administration, 2e 1 Chapter 9 Preparing for Emergencies.
1 Lecture 4: Threads Operating System Fall Contents Overview: Processes & Threads Benefits of Threads Thread State and Operations User Thread.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 11: File System Implementation.
UNIX File and Directory Caching How UNIX Optimizes File System Performance and Presents Data to User Processes Using a Virtual File System.
Component Technology. Challenges Facing the Software Industry Today’s applications are large & complex – time consuming to develop, difficult and costly.
Introduction to DFS. Distributed File Systems A file system whose clients, servers and storage devices are dispersed among the machines of a distributed.
EXTENSIBILITY, SAFETY AND PERFORMANCE IN THE SPIN OPERATING SYSTEM
Lecture 8 Page 1 CS 111 Online Other Important Synchronization Primitives Semaphores Mutexes Monitors.
Chapter 11: File System Implementation Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 11: File System Implementation Chapter.
Solutions for the First Quiz COSC 6360 Spring 2014.
The Mach System Silberschatz et al Presented By Anjana Venkat.
CS533 Concepts of Operating Systems Jonathan Walpole.
DISASTER RECOVERY PLAN By: Matthew Morrow. WHAT HAPPENS WHEN A DISASTER OCCURS  What happens to a business during a disaster?  What steps does a business.
Oracle Database High Availability
Integrating Disk into Backup for Faster Restores
Business Continuity & Disaster Recovery
Chapter 11: File System Implementation
I/O System Chapter 5 Designed by .VAS.
Extensible OSes Exokernel and SPIN (Lecture 9, cs262a)
Outline Other synchronization primitives
Presentation by Omar Abu-Azzah
File System Implementation
Other Important Synchronization Primitives
Operating System I/O System Monday, August 11, 2008.
Oracle Database High Availability
KERNEL ARCHITECTURE.
Page Replacement.
Business Contingency Planning
Overview Continuation from Monday (File system implementation)
Research Opportunities in IP Wide Area Storage
UNIT IV RAID.
Overview: File system implementation (cont)
Chapter 2: Operating-System Structures
Operating Systems CS451 Spring 1998
OS Components and Structure
Co-designed Virtual Machines for Reliable Computer Systems
File System Implementation
Chapter 2: Operating-System Structures
CSE 542: Operating Systems
CSE 60641: Operating Systems
Improving performance
Presentation transcript:

CSE 542: Operating Systems 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems Outline Extensibility, Safety and Performance in the SPIN Operating System Brian Bershad, Stefan Savage, Przemyslaw Pardyak, Emin Gun Sirer, Marc E. Fiuczynski, David Becker, Craig Chambers, Susan Eggers MSDOS: Extensibility and Performance Mach: Extensibility and Safety UNIX: Safety and Performance Goal: SPIN should have all three 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems Extensibility Applications can dynamically extend system to provide specialized services Put extension code in the kernel Communication cost is cheap SPIN implements minimal services: Processor execution state, MMU, IO/DMA, Dynamic linker Compare with Micro-kernels: Cost to cross protection boundaries Library based: Offers minimal protection boundaries 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems Safety Kernel is protected from actions of extension Use language protection features Static safety Modula3 Memory safe Interfaces for hiding resources Cheap capabilities Restrict access to interfaces at dynamic link-time 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems Performance Extensibility and safety have low cost Extensions provide specialized service Customized for the specific task with no extraneous code Extensions close to kernel service Invocations cheap Low latency response to interrupts 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems Outline SnapMirror: File System based asynchronous Mirroring for disaster recovery Trends: Persistent and reliable data is crucial for businesses Disks are getting cheaper and bigger, backup technologies are not keeping up RAID to guard against disk failures Hybrid levels (level 50) can provide redundancy and performance Disaster recovery Create off-site online backups to guard against disasters 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems Challenges Backup restore from tapes are cheap but slow Tapes can achieve around 60 GB/hour for restore Terabyte data stores can take a long time to restore Online remote backup Expensive (network bandwidth requirements) Performance slow because transaction cannot complete till WAN update finishes Asynchronous backups Backup at regular intervals If backup goes to multiple devices, then the event ordering can create inconsistent backups We want cheaper, faster restore capable mechanism 9-Sep-19 CSE 542: Operating Systems

Remote mirrors for disaster recovery Courtesy: NetApp 9-Sep-19 CSE 542: Operating Systems

CSE 542/498J: Operating Systems Monday, September 09, 2019 Snapshot Internals (1) A B C Active File System File: NETAPP.DAT Disk blocks Data actually resided in block C on disk 9-Sep-19 CSE 542: Operating Systems

CSE 542/498J: Operating Systems Monday, September 09, 2019 Snapshot Internals (2) A B C Active File System File: NETAPP.DAT Disk blocks Snapshot.0 File: NETAPP.DAT - Makes copy of root inode - Updates Block Map File Data actually resided in block C on disk 9-Sep-19 CSE 542: Operating Systems

CSE 542/498J: Operating Systems Monday, September 09, 2019 Snapshot Internals (3) A B C Active File System File: NETAPP.DAT Disk blocks Snapshot.0 File: NETAPP.DAT C’ WAFL writes modified data block to new location on disk (C’) Client modifies data at end of file Data actually resided in block C on disk 9-Sep-19 CSE 542: Operating Systems

CSE 542/498J: Operating Systems Monday, September 09, 2019 Snapshot Internals (4) Snapshot.0 File: NETAPP.DAT Active File System File: NETAPP.DAT A B C C’ Disk blocks Active file system version of NETAPP.DAT is now composed of disk blocks A, B & C’. Snapshot.0 file system version of NETAPP.DAT is still composed of blocks A, B & C 9-Sep-19 CSE 542: Operating Systems

CSE 542/498J: Operating Systems Monday, September 09, 2019 Snapshot Internals (5) Active File System Snapshot.0 File: NETAPP.DAT File: NETAPP.DAT Snapshot.1 File: NETAPP.DAT A B C C’ Disk blocks Snapshot.1 file system version of NETAPP.DAT is composed of blocks A, B & C’ 9-Sep-19 CSE 542: Operating Systems

CSE 542: Operating Systems SnapMirror Can use this mechanism to mirror data across WAN Can reduce data storage requirements by not backing up deleted/updated data Identifying dirty blocks are easier than logical, file system aware mechanisms 9-Sep-19 CSE 542: Operating Systems