Cache Systems

2024 Sep 23

LRU vs FIFO (with Lazy Promotion and Quick Demotion)

Sprinkling some lazy promotion and quick demotion on FIFO

2024 Sep 22

Notes on 'A large scale analysis of hundreds of in-memory cache clusters at Twitter'

TTLs are prevalent, object sizes are small, metadata overhead can be large, object sizes change, FIFO is better than LRU, you’ve got to address memory fragmentation