Fast and Accurate Load Balancing for Geo-Distributed Storage Systems

Bogdanov, Kirill L.; Reda, Waleed; Maguire, Gerald Q.; Kostić, Dejan; Canini, Marco

Fast and Accurate Load Balancing for Geo-Distributed Storage Systems

Files

p386-Bogdanov.pdf (1.1 MB)

Type

Conference Paper

Authors

Bogdanov, Kirill L.
Reda, Waleed
Maguire, Gerald Q.
Kostić, Dejan
Canini, Marco

KAUST Department

Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Computer Science Program

Online Publication Date

2018-09-28

Print Publication Date

2018

Date

2018-09-28

Abstract

The increasing density of globally distributed datacenters reduces the network latency between neighboring datacenters and allows replicated services deployed across neighboring locations to share workload when necessary, without violating strict Service Level Objectives (SLOs). We present Kurma, a practical implementation of a fast and accurate load balancer for geo-distributed storage systems. At run-time, Kurma integrates network latency and service time distributions to accurately estimate the rate of SLO violations for requests redirected across geo-distributed datacenters. Using these estimates, Kurma solves a decentralized rate-based performance model enabling fast load balancing (in the order of seconds) while taming global SLO violations. We integrate Kurma with Cassandra, a popular storage system. Using real-world traces along with a geo-distributed deployment across Amazon EC2, we demonstrate Kurma’s ability to effectively share load among datacenters while reducing SLO violations by up to a factor of 3 in high load settings or reducing the cost of running the service by up to 17%.

Citation

Bogdanov, K. L., Reda, W., Maguire, G. Q., Kostić, D., & Canini, M. (2018). Fast and Accurate Load Balancing for Geo-Distributed Storage Systems. Proceedings of the ACM Symposium on Cloud Computing. doi:10.1145/3267809.3267820