1. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter 9 Memory Organization

2. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Chapter Outline Hierarchical Memory SystemsHierarchical Memory Systems Cache MemoryCache Memory Virtual MemoryVirtual Memory Pentium/Windows Memory SystemPentium/Windows Memory System

3. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Memory Hierarchy

4. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Associative Memory Data RegisterData Register

5. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Associative Memory Data RegisterData Register Mask RegisterMask Register

6. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Associative Memory Data RegisterData Register Mask RegisterMask Register Match RegisterMatch Register

7. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Associative Memory

8. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Associative Cache

9. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Data Lines/Blocks Multiple consecutive words form a lineMultiple consecutive words form a line

10. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Data Lines/Blocks Multiple consecutive words form a lineMultiple consecutive words form a line All data in a line is moved togetherAll data in a line is moved together

11. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Data Lines/Blocks Multiple consecutive words form a lineMultiple consecutive words form a line All data in a line is moved togetherAll data in a line is moved together Takes advantage of locality of referenceTakes advantage of locality of reference

12. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Associative Cache with a Line Size of 4 Bytes

13. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Direct Mapped Cache

14. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Direct Mapped Cache with a Line Size of 4 Bytes

15. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Drawbacks of Direct Mapped Cache 0000 0000 0000 0000: JUMP 1000H 0001 0000 0000 0000: JUMP 0000H

16. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Set-Associative Cache

17. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Set-Associative Cache with a Line Size of 4 Bytes

18. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Data Replacement Policies FIFOFIFO

19. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Data Replacement Policies FIFOFIFO LRULRU

20. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Data Replacement Policies FIFOFIFO LRULRU RandomRandom

21. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Example

22. Example

23. Example

24. Example

25. Writing Data to Cache Write backWrite back Write throughWrite through Write allocateWrite allocate Write no-allocateWrite no-allocate

26. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Performance Hits and missesHits and misses

27. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Performance Hits and missesHits and misses Hit ratioHit ratio

28. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Performance Hits and missesHits and misses Hit ratioHit ratio Average memory access timeAverage memory access time

29. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Activity - Associative Cache

30. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Activity - Associative Cache

31. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Activity - Direct Mapped Cache

32. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Activity - Direct Mapped Cache

33. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Activity - 2-Way Set- Associative Cache

34. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Cache Activity - 2-Way Set- Associative Cache

35. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 2-Way Set-Associative Cache with a Line Size of 2

36. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 2-Way Set-Associative Cache with a Line Size of 2

37. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Virtual Memory Memory Management Unit (MMU)Memory Management Unit (MMU)

38. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Virtual Memory Memory Management Unit (MMU)Memory Management Unit (MMU) Swap disk/fileSwap disk/file

39. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Virtual Memory Memory Management Unit (MMU)Memory Management Unit (MMU) Swap disk/fileSwap disk/file Logical addressLogical address

40. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Virtual Memory Memory Management Unit (MMU)Memory Management Unit (MMU) Swap disk/fileSwap disk/file Logical addressLogical address Physical addressPhysical address

41. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Paging - Pages and Frames

42. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 MMU Configuration

43. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Page Table

44. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Address Conversion

45. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Translation Lookaside Buffer

46. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Example

47. Example

48. Segmentation

49. Fragmentation Internal fragmentationInternal fragmentation

50. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Fragmentation Internal fragmentationInternal fragmentation External fragmentationExternal fragmentation

51. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Fragmentation Internal fragmentationInternal fragmentation External fragmentationExternal fragmentation

52. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Beyond the Basics Split cacheSplit cache

53. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Beyond the Basics Split cacheSplit cache Multilevel page tableMultilevel page table

54. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Multilevel Page Table

55. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Pentium/Windows NT Memory Management 8 KB

56. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Pentium/Windows NT Cache Memory Management 16KB L1 split cache16KB L1 split cache –2-way set-associative –Line size of 32 bytes TLB used for cache and virtual memoryTLB used for cache and virtual memory Pseudo-LRU replacement policyPseudo-LRU replacement policy 256K L2 unified cache256K L2 unified cache –4-way set-associative

57. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Pentium/Windows NT Virtual Memory Management 4 GB address space4 GB address space –Low-order 2 GB for individual processes –High-order 2 GB for Windows NT components Uses paging, not segmentationUses paging, not segmentation 10-bit page directory pointer + 10-bit offset10-bit page directory pointer + 10-bit offset Uses the same TLBs as cache memoryUses the same TLBs as cache memory

58. Images courtesy of Addison Wesley Longman, Inc. Copyright © 2001 Summary Hierarchical Memory SystemsHierarchical Memory Systems Cache MemoryCache Memory Virtual MemoryVirtual Memory Pentium/Windows Memory SystemPentium/Windows Memory System