Do the best cloud configurations grow on trees? An experimental evaluation of black box algorithms for optimizing cloud workloads

Abstract
Cloud configuration optimization is the procedure to determine the number and the type of instances to use when deploying an application in cloud environments, given a cost or performance objective. In the absence of a performance model for the distributed application, black-box optimization can be used to perform automatic cloud configuration. Numerous black-box optimization algorithms have been developed; however, their comparative evaluation has so far been limited to the hyper-parameter optimization setting, which differs significantly from the cloud configuration problem. In this paper, we evaluate 8 commonly used black-box optimization algorithms to determine their applicability for the cloud configuration problem. Our evaluation, using 23 different workloads, shows that in several cases Bayesian optimization with Gradient boosted regression trees performs better than methods chosen by prior work.

Citation
Bilal, M., Serafini, M., Canini, M., & Rodrigues, R. (2020). Do the best cloud configurations grow on trees? Proceedings of the VLDB Endowment, 13(12), 2563–2575. doi:10.14778/3407790.3407845

Acknowledgements
Muhammad Bilal was supported by a fellowship from the Erasmus Mundus Joint Doctorate in Distributed Computing (EMJD-DC) program funded by the European Commission (EACEA) (FPA2012-0030). Work done in part while author was interning at KAUST. This research was supported by Fundac ̧ ̃ao para a Ciˆen-cia e a Tecnologia (FCT), under projects UIDB/50021/2020 andCMUP-ERI/TIC/0046/2014.

Publisher
VLDB Endowment

Journal
Proceedings of the VLDB Endowment

DOI
10.14778/3407790.3407845

Additional Links
https://dl.acm.org/doi/10.14778/3407790.3407845

Permanent link to this record