User-level Distributed Shared Memory

Slides:



Advertisements
Similar presentations
Relaxed Consistency Models. Outline Lazy Release Consistency TreadMarks DSM system.
Advertisements

MACHINE-INDEPENDENT VIRTUAL MEMORY MANAGEMENT FOR PAGED UNIPROCESSOR AND MULTIPROCESSOR ARCHITECTURES R. Rashid, A. Tevanian, M. Young, D. Golub, R. Baron,
Distributed Shared Memory
November 1, 2005Sebastian Niezgoda TreadMarks Sebastian Niezgoda.
Distributed Operating Systems CS551 Colorado State University at Lockheed-Martin Lecture 4 -- Spring 2001.
Slides for Parallel Programming Techniques & Applications Using Networked Workstations & Parallel Computers 2nd ed., by B. Wilkinson & M
UNIVERSITY OF JYVÄSKYLÄ Peer-to-Peer Studio Server User Interface Chedar node Chedar node Chedar node Chedar node Peer-to-Peer Studio.
1 Multiprocessors. 2 Idea: create powerful computers by connecting many smaller ones good news: works for timesharing (better than supercomputer) bad.
Multiprocessors Andreas Klappenecker CPSC321 Computer Architecture.
Low Cost, High Performance, and Scalability: A New Approach to User-Level Distributed Shared Memory Patrick Anthony La Fratta WORTS December 2005.
CSCS: A Concise Implementation of User-Level Distributed Shared Memory Zhi Zhai Feng Shen Computer Science and Engineering University of Notre Dame Dec.
Distributed Resource Management: Distributed Shared Memory
Multiprocessors CSE 471 Aut 011 Multiprocessors - Flynn’s Taxonomy (1966) Single Instruction stream, Single Data stream (SISD) –Conventional uniprocessor.
COM S 614 Advanced Systems Novel Communications U-Net and Active Messages.
Dr. Kalpakis CMSC 621, Advanced Operating Systems. Fall 2003 URL: Distributed Shared Memory.
MapReduce : Simplified Data Processing on Large Clusters Hongwei Wang & Sihuizi Jin & Yajing Zhang
Massively Distributed Database Systems Spring 2014 Ki-Joune Li Pusan National University.
Lecture 6: Introduction to Distributed Computing.
Distributed Shared Memory Systems and Programming
2008 dce Distributed Shared Memory Pham Quoc Cuong & Phan Dinh Khoi Use some slides of James Deak - NJIT.
1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.
A Virtual Machine Monitor for Utilizing Non-dedicated Clusters Kenji Kaneda Yoshihiro Oyama Akinori Yonezawa (University of Tokyo)
B. Prabhakaran 1 Distributed Shared Memory DSM provides a virtual address space that is shared among all nodes in the distributed system. Programs access.
Memory Coherence in Shared Virtual Memory System ACM Transactions on Computer Science(TOCS), 1989 KAI LI Princeton University PAUL HUDAK Yale University.
A Performance Comparison of DSM, PVM, and MPI Paul Werstein Mark Pethick Zhiyi Huang.
Ch 10 Shared memory via message passing Problems –Explicit user action needed –Address spaces are distinct –Small Granularity of Transfer Distributed Shared.
Distributed Shared Memory Based on Reference paper: Distributed Shared Memory, Concepts and Systems.
Cache Coherence Protocols 1 Cache Coherence Protocols in Shared Memory Multiprocessors Mehmet Şenvar.
Distributed Shared Memory Presentation by Deepthi Reddy.
Distributed Shared Memory (part 1). Distributed Shared Memory (DSM) mem0 proc0 mem1 proc1 mem2 proc2 memN procN network... shared memory.
Page 1 Distributed Shared Memory Paul Krzyzanowski Distributed Systems Except as otherwise noted, the content of this presentation.
A Design of User-Level Distributed Shared Memory Zhi Zhai Feng Shen Computer Science and Engineering University of Notre Dame Oct. 27, 2009 Progress Report.
NTU Cloud 2010/05/30. System Diagram Architecture Gluster File System – Provide a distributed shared file system for migration NFS – A Prototype Image.
Memory Coherence in Shared Virtual Memory Systems Yeong Ouk Kim, Hyun Gi Ahn.
Memory Coherence in Shared Virtual Memory System ACM Transactions on Computer Science(TOCS), 1989 KAI LI Princeton University PAUL HUDAK Yale University.
1 Distributed Processing Chapter 1 : Introduction.
Region-Based Software Distributed Shared Memory Song Li, Yu Lin, and Michael Walker CS Operating Systems May 1, 2000.
A Parallel Communication Infrastructure for STAPL
Distributed Operating Systems Spring 2004
vNUMA: Virtual Multiprocessors on Clusters of Workstations
Distributed Shared Memory
Distributed Operating Systems
Definition of Distributed System
Reactive NUMA: A Design for Unifying S-COMA and CC-NUMA
Multiprocessor Cache Coherency
NGS computation services: APIs and Parallel Jobs
Ivy Eva Wu.
XenFS Sharing data in a virtualised environment
University of Technology
Parallel Programming in C with MPI and OpenMP
Replication Middleware for Cloud Based Storage Service
Introduction to Operating Systems
Advanced Operating Systems
Distributed Shared Memory
Distributed Garbage Collection
Lecture 7: Introduction to Distributed Computing.
Guoliang Chen Parallel Computing Guoliang Chen
Page Replacement.
Outline Midterm results summary Distributed file systems – continued
Distributed Shared Memory
CSS490 Distributed Shared Memory
Exercises for Chapter 16: Distributed Shared Memory
Database System Architectures
Distributed Resource Management: Distributed Shared Memory
CS533 Concepts of Operating Systems Class 14
A Virtual Machine Monitor for Utilizing Non-dedicated Clusters
CSE 486/586 Distributed Systems Distributed Shared Memory
The Gamma Database Machine Project
MapReduce: Simplified Data Processing on Large Clusters
An Implementation of User-level Distributed Shared Memory
Presentation transcript:

User-level Distributed Shared Memory Wei Zhang & Shu Liu

DSM: Shared Memory + Distributed Memory 2019/1/16 Progress Report

Problems & Solutions Problems Solutions Granularity Use 4-Kbyte Page as the unit of sharing Data location/Mapping Centralized server Communication MPI (Message Passing Interface) 2019/1/16 Progress Report

Cont. Problems Solutions Memory Coherence in parallelism a: each page has one dynamic owner b: multi readers (make copies) c: single writer (only owner can write the page) d: lock (synchronize page operation) 2019/1/16 Progress Report

Design Overview 2019/1/16 Progress Report

For a read 2019/1/16 Progress Report

For a write 2019/1/16 Progress Report

Initial results User Level Virtual memory 2019/1/16 Progress Report

Cont. Memory Mapping and Page fault generation (same with VM) Main DSM Data structure pageinfo on server page table on nodes Communication Functions network needs more time than disk time of sending a page is more or the less than send a byte Part of Memory Coherence Model Algorithm 2019/1/16 Progress Report

Following Steps Finish coding (mostly coherence model ) Evaluation Benchmarks (good and bad results) Analyze the results Good performance Poor performance 2019/1/16 Progress Report