Memory Hierarchy
Many programs have a high degree of locality in their accesses
- spatial locality: accessing things nearby previous accesses
- temporal locality: reusing an item that was previously accessed
Second/Third level cache (SRAM)
Remote memory / Secondary storage (Disk)
Speed (ns): 1s 10s 100s 10s ms 10s sec
Size (bytes): 100s Ks Ms Gs Ts