Fast and Accurate Load Balancing for Geo-Distributed Storage Systems
Name:
p386-Bogdanov.pdf
Size:
1.095Mb
Format:
PDF
Description:
Open Access Conference Paper
Type
Conference PaperKAUST Department
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) DivisionComputer Science Program
Date
2018-09-28Online Publication Date
2018-09-28Print Publication Date
2018Permanent link to this record
http://hdl.handle.net/10754/630817
Metadata
Show full item recordAbstract
The increasing density of globally distributed datacenters reduces the network latency between neighboring datacenters and allows replicated services deployed across neighboring locations to share workload when necessary, without violating strict Service Level Objectives (SLOs). We present Kurma, a practical implementation of a fast and accurate load balancer for geo-distributed storage systems. At run-time, Kurma integrates network latency and service time distributions to accurately estimate the rate of SLO violations for requests redirected across geo-distributed datacenters. Using these estimates, Kurma solves a decentralized rate-based performance model enabling fast load balancing (in the order of seconds) while taming global SLO violations. We integrate Kurma with Cassandra, a popular storage system. Using real-world traces along with a geo-distributed deployment across Amazon EC2, we demonstrate Kurma’s ability to effectively share load among datacenters while reducing SLO violations by up to a factor of 3 in high load settings or reducing the cost of running the service by up to 17%.Citation
Bogdanov, K. L., Reda, W., Maguire, G. Q., Kostić, D., & Canini, M. (2018). Fast and Accurate Load Balancing for Geo-Distributed Storage Systems. Proceedings of the ACM Symposium on Cloud Computing. doi:10.1145/3267809.3267820ISBN
9781450360111ae974a485f413a2113503eed53cd6c53
10.1145/3267809.3267820