01whole.pdf (728.59 kB)
Download file

A data placement approach for scientific workflow execution in hybrid clouds

Download (728.59 kB)
thesis
posted on 28.03.2022, 23:44 by Amirmohammad Pasdar
Cloud computing has been widely adopted by industry practitioners and researchers. Recently, applications in science and engineering such as scientific workflows have also been increasingly deployed in clouds. As these applications are becoming resource intensive in both data and computing, private clouds struggle to cope with their resource requirements. Public clouds claim to overcome many shortcomings of private clouds. However, the complete offloading of workflow execution to public clouds may introduce excessive data transfer and privacy/governance concerns. In this thesis, we propose a hybrid cloud solution for workflow scheduling explicitly considering data placement. To this end, we present Hybrid Scheduling for Hybrid Clouds (HSHC), which schedules scientific workflows across private and public clouds incorporating a novel dynamic data placement policy. HSHC consists of two phases: static and dynamic. The former uses an extended genetic algorithm to solve the problem of workflow scheduling with static information of workflows and cloud resources. The latter adjusts scheduling and data placement decisions reflecting changing conditions of workflow execution in the hybrid cloud. We evaluate HSHC with both real-world scientific applications and random workflows in performance and cost. Experimental results demonstrate HSHC’s two-phase approach effectively deals with the dynamic nature of the hybrid cloud.

History

Table of Contents

1. Introduction -- 2. Literature review -- 3. Problem statement -- 4. Hybrid scheduling for hybrid clouds -- 5. Evaluation -- 6. Conclusion -- List of symbols -- References.

Notes

Empirical thesis. Bibliography: pages 47-52

Awarding Institution

Macquarie University

Degree Type

Thesis PhD

Degree

MRes, Macquarie University, Faculty of Science and Engineering, Department of Computing

Department, Centre or School

Department of Computing

Year of Award

2018

Principal Supervisor

Young Choon Lee

Rights

Copyright Amirmohammad Pasdar 2018. Copyright disclaimer: http://mq.edu.au/library/copyright

Language

English

Extent

1 online resource (x, 52 pages) diagrams, graphs

Former Identifiers

mq:70503 http://hdl.handle.net/1959.14/1264909