The Power of Two: How Random Choices Are Upending Cache Eviction Wisdom
New research reveals that a '2-random' cache eviction policy—selecting the least recently used of two randomly chosen lines—often outperforms traditional LRU in larger caches, with significant implications for hardware efficiency. This counterintuitive approach, inspired by mathematical load-balancing theories, offers near-optimal performance at lower implementation costs. The findings could reshape how developers and architects design high-performance systems.