A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds

[EN] Bag-of-Tasks (BoT) workflows are widespread in many big data analysis fields. However, there are very few cloud resource provisioning and scheduling algorithms tailored for BoT workflows. Furthermore, existing algorithms fail to consider the stochastic task execution times of BoT workflows whic...

ver descrição completa

Detalhes bibliográficos
Autores: Cai, Zhicheng, Li, Xiaoping, Ruiz García, Rubén, Li, Qianmu
Formato: artículo
Fecha de publicación:2017
País:España
Recursos:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/151092
Acesso em linha:https://riunet.upv.es/handle/10251/151092
Access Level:acceso abierto
Palavra-chave:Cloud computing
Scheduling
Workflow
Bag of tasks
Stochastic
ESTADISTICA E INVESTIGACION OPERATIVA
id ES_e36dda5c7aa090a96ce6f44fc44cde05
oai_identifier_str oai:riunet.upv.es:10251/151092
network_acronym_str ES
network_name_str España
repository_id_str
spelling A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in cloudsCai, ZhichengLi, XiaopingRuiz García, RubénLi, QianmuCloud computingSchedulingWorkflowBag of tasksStochasticESTADISTICA E INVESTIGACION OPERATIVA[EN] Bag-of-Tasks (BoT) workflows are widespread in many big data analysis fields. However, there are very few cloud resource provisioning and scheduling algorithms tailored for BoT workflows. Furthermore, existing algorithms fail to consider the stochastic task execution times of BoT workflows which leads to deadline violations and increased resource renting costs. In this paper, we propose a dynamic cloud resource provisioning and scheduling algorithm which aims to fulfill the workflow deadline by using the sum of task execution time expectation and standard deviation to estimate real task execution times. A bag-based delay scheduling strategy and a single-type based virtual machine interval renting method are presented to decrease the resource renting cost. The proposed algorithm is evaluated using a cloud simulator ElasticSim which is extended from CloudSim. The results show that the dynamic algorithm decreases the resource renting cost while guaranteeing the workflow deadline compared to the existing algorithms. (C) 2017 Elsevier B.V. All rights reserved.The authors would like to thank the reviewers for their constructive and useful comments. This work is supported by the National Natural Science Foundation of China (Grant No. 61602243 and 61572127), the Natural Science Foundation ofJiangsu Province (Grant No. BK20160846), Jiangsu Key Laboratory of Image and Video Understanding for Social Safety (Nanjing University of Science and Technology, Grant No. 30916014107), the Fundamental Research Funds for the Central University (Grant No. 30916015104). Ruben Ruiz is partially supported by the Spanish Ministry of Economy and Competitiveness, under the project "SCHEYARD" (No. DP12015-65895-R) co-financed by FEDER funds.ElsevierEuropean Regional Development FundMinisterio de Economía y CompetitividadNational Natural Science Foundation of ChinaNatural Science Foundation of Jiangsu ProvinceFundamental Research Funds for the Central UniversitiesJiangsu Key Laboratory of Image and Video Understanding for Social Safety, ChinaRepositorio Institucional de la Universitat Politècnica de València Riunet20172017-06-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/151092reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengNational Natural Science Foundation of China https://doi.org/10.13039/501100001809 61572127Natural Science Foundation of Jiangsu Province Natural Science Foundation of Jiangsu Province BK20160846Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Jiangsu Key Laboratory of Image and Video Understanding for Social Safety 30916014107Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 DPI2015-65895-R OPTIMIZATION OF SCHEDULING PROBLEMS IN CONTAINER YARDSNational Natural Science Foundation of China https://doi.org/10.13039/501100001809 61602243Fundamental Research Funds for the Central Universities Fundamental Research Funds for the Central Universities 30916015104open accesshttp://purl.org/coar/access_right/c_abf2Reconocimiento - No comercial - Sin obra derivada (by-nc-nd) http://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/1510922026-06-13T07:49:27Z
dc.title.none.fl_str_mv A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
title A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
spellingShingle A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
Cai, Zhicheng
Cloud computing
Scheduling
Workflow
Bag of tasks
Stochastic
ESTADISTICA E INVESTIGACION OPERATIVA
title_short A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
title_full A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
title_fullStr A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
title_full_unstemmed A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
title_sort A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds
dc.creator.none.fl_str_mv Cai, Zhicheng
Li, Xiaoping
Ruiz García, Rubén
Li, Qianmu
author Cai, Zhicheng
author_facet Cai, Zhicheng
Li, Xiaoping
Ruiz García, Rubén
Li, Qianmu
author_role author
author2 Li, Xiaoping
Ruiz García, Rubén
Li, Qianmu
author2_role author
author
author
dc.contributor.none.fl_str_mv European Regional Development Fund
Ministerio de Economía y Competitividad
National Natural Science Foundation of China
Natural Science Foundation of Jiangsu Province
Fundamental Research Funds for the Central Universities
Jiangsu Key Laboratory of Image and Video Understanding for Social Safety, China
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Cloud computing
Scheduling
Workflow
Bag of tasks
Stochastic
ESTADISTICA E INVESTIGACION OPERATIVA
topic Cloud computing
Scheduling
Workflow
Bag of tasks
Stochastic
ESTADISTICA E INVESTIGACION OPERATIVA
description [EN] Bag-of-Tasks (BoT) workflows are widespread in many big data analysis fields. However, there are very few cloud resource provisioning and scheduling algorithms tailored for BoT workflows. Furthermore, existing algorithms fail to consider the stochastic task execution times of BoT workflows which leads to deadline violations and increased resource renting costs. In this paper, we propose a dynamic cloud resource provisioning and scheduling algorithm which aims to fulfill the workflow deadline by using the sum of task execution time expectation and standard deviation to estimate real task execution times. A bag-based delay scheduling strategy and a single-type based virtual machine interval renting method are presented to decrease the resource renting cost. The proposed algorithm is evaluated using a cloud simulator ElasticSim which is extended from CloudSim. The results show that the dynamic algorithm decreases the resource renting cost while guaranteeing the workflow deadline compared to the existing algorithms. (C) 2017 Elsevier B.V. All rights reserved.
publishDate 2017
dc.date.none.fl_str_mv 2017
2017-06-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/151092
url https://riunet.upv.es/handle/10251/151092
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv National Natural Science Foundation of China https://doi.org/10.13039/501100001809 61572127
Natural Science Foundation of Jiangsu Province Natural Science Foundation of Jiangsu Province BK20160846
Jiangsu Key Laboratory of Image and Video Understanding for Social Safety Jiangsu Key Laboratory of Image and Video Understanding for Social Safety 30916014107
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 DPI2015-65895-R OPTIMIZATION OF SCHEDULING PROBLEMS IN CONTAINER YARDS
National Natural Science Foundation of China https://doi.org/10.13039/501100001809 61602243
Fundamental Research Funds for the Central Universities Fundamental Research Funds for the Central Universities 30916015104
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento - No comercial - Sin obra derivada (by-nc-nd)
http://creativecommons.org/licenses/by-nc-nd/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reconocimiento - No comercial - Sin obra derivada (by-nc-nd)
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869422500599824384
score 15,301629

Registos relacionados