BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores

Abstract

BlowFish is a distributed data store that provides a smooth tradeoff between storage and point-query performance and can move along that curve at fine time scales with little computational overhead. This capability supports practical uses including failure recovery and time-varying, spatially skewed workloads. On production-cluster scenarios, BlowFish uses 5.4 times less bandwidth and 2.5 times less repair time than state-of-the-art erasure codes while reducing the storage cost of replication from 3 times to 1.9 times. Dynamically navigating the tradeoff also achieves higher system-wide utility than selectively caching hot objects.

BibTeX

@inproceedings{blowfish,
  title = {{BlowFish: Dynamic Storage-Performance Tradeoff in Data Stores}},
  author = {Khandelwal, Anurag and Agarwal, Rachit and Stoica, Ion},
  booktitle = {USENIX NSDI},
  month = mar,
  year = {2016}
}