Presentation is loading. Please wait.

Presentation is loading. Please wait.

Implement Prefetching Technique Using Supply Chain Theory Lixiong Chen.

Similar presentations


Presentation on theme: "Implement Prefetching Technique Using Supply Chain Theory Lixiong Chen."— Presentation transcript:

1 Implement Prefetching Technique Using Supply Chain Theory Lixiong Chen

2 Why Prefetching Disk I/O is extremely slow compared with direct data transfer within memory system Frequent exposure of disk operation to users can degrade their user experiences This can be avoided if data to be used is cached in memory before its actual request is issued from the users

3 Important Concerns What to fetch --- Choose data according to anticipation. Not an issue if fetching sequentially: Correlated data is always stored sequentially. When to fetch --- Remains a an issue for systems designed using queuing theory.

4 Correspondingly, associated with these two concerns are two terms: Prefetch degree: how much data is to be fetched upon a request Prefetch distance: how early to issue the next prefetch request

5 Existing prefetching technique may become troublesome when: Multiple data requests are issued concurrently, but with different frequency Each request is treated with equal importance Result: frequent data requests may end up with exhausted cached data while less frequent ones still have unconsumed resources

6 Supply Chain Model Supply chain model features: Multiple request-retrieve operations alone a single process Customer demands are desired to be serviced timely Resource allocation among different types of requests is managed

7

8 Problem Mapping Requests = Demand (normally distribution over data volume) Access time = Lead time (Trequest – Tretrieve, assumed to be i.i.d) Batched prefetching = Batched replenishment Multilevel prefetching = Multi-echelon inventory control

9

10 The key to the problem mapping is how to determine the “reorder point” and “safety inventory level”. In SCM, there are two types of basic algorithms: Equal Time Supplies (ETS) Equal Safety Factors (ESF)

11

12 ETS Applied if total inventory safety level is determined Individual safety inventory level is set proportional to demand rates

13 EFS Considers the demand uncertainties of demand streams (no longer stable) Highest uncertainty in demand deserves highest safety inventory level

14 Testbed Linux - trigger distance - prefetching degree Synthetic Benchmarks Real Linux Applications HTTP, VOD server simulation

15 Performance (benchmark)

16 Synthetic Benchmark

17 Real Linux Application

18 Server Benchmark (HTTP)

19 Server Benchmark (VOD)

20 Bullwhip Effect Variations of demand alone supply chain are amplified as orders are placed further away from customer In multi-level memory system, data demands become less stable as requests are issued further away from end users

21 Multi-level Distortion


Download ppt "Implement Prefetching Technique Using Supply Chain Theory Lixiong Chen."

Similar presentations


Ads by Google