Autoscaling Scientific Workflows on the Cloud by Combining On-demand and Spot Instances [JCR]

DAVID MONGE; YISEL GARÍ; CRISTIAN MATEOS; CARLOS GARCÍA GARINO

COMPUTER SYSTEMS SCIENCE AND ENGINEERING

C R L PUBLISHING LTD

Lugar: Leicester; Año: 2017

0267-6192

Autoscaling strategies achieve efficient and cheap executions of scientific workflows running in the cloud by determining appropriate type and amount of virtual machine instances to use while scheduling the tasks/data intelligently. Actual strategies only consider on-demand instances ignoring the advantages of a mixed cloud infrastructure comprising also spot instances. Although the latter instances are subject to failures and therefore provide an unreliable infrastructure, they potentially offer significant cost and time improvements if used wisely. This paper discusses a novel autoscaling strategy with two features. First, it combines both type of instances to acquire a better cost-performance infrastructure. And second, it uses heuristic scheduling to deal with the unreliability of spot instances. Simulated experiments based on 4 scientific workflows showed substantial makespan and cost reductions of our strategy when compared with a reference strategy from the state of the art entitled Scaling First. These promising results represent a step towards new and better strategies for workflow autoscaling.