LOGOS: Enabling Local Resource Managers for the Efficient Support of Data-Intensive Workflows within Grid Sites
David A. Monge; ITIC Research Institute, Universidad Nacional de Cuyo, ECT, Padre Jorge Contreras 1300, M5502JMA Mendoza ; Carlos García Garino; ITIC Research Institute & Facultad de Ingeniería, Universidad Nacional de Cuyo, Centro Universitario, M5502JMA Mendoza
Computing and Informatics, Tome 33 (2014) no. 1, / Harvested from Computing and Informatics
Text on Computing and Informatics
In this study we discuss how to enable grid sites for the support of data-intensive workflows. Usually, within grid sites, tasks and resources are administrated by local resource managers (LRMs). Many of LRMs have been designed for managing compute-intensive applications. Therefore, data-intensive workflow applications might not perform well on such environments due to the number and size of data transfers between tasks. To improve the performance of such kind of applications it is necessary to redefine the scheduling policies integrated on LRMs. This paper proposes a novel scheme for efficiently supporting data-intensive workflows in LRMs within grid sites. Such scheme is partially implemented in our grid middleware LOGOS and used to improve the performance of a well known LRM: HTCondor. The core of LOGOS is a novel communication-aware scheduling algorithm (PPSA) capable of finding near-optimal solutions. Experiments conducted in this study showed that our approach leads to performance improvements up to 52 % in the management of data-intensive workflow applications.
Publié le : 2014-06-03
Classification:  Parallel and Distributed Computing; Grid; Scheduling; Workflows,  Grid sites, data-intensive workflows, scheduling, HTCondor, DAGMan,  68M14, 68M20, 90C57 
@article{cai877,
     author = {David A. Monge; ITIC Research Institute, Universidad Nacional de Cuyo, ECT, Padre Jorge Contreras 1300, M5502JMA Mendoza and Carlos Garc\'\i a Garino; ITIC Research Institute \& Facultad de Ingenier\'\i a, Universidad Nacional de Cuyo, Centro Universitario, M5502JMA Mendoza},
     title = {LOGOS: Enabling Local Resource Managers for the Efficient Support of Data-Intensive Workflows within Grid Sites},
     journal = {Computing and Informatics},
     volume = {33},
     number = {1},
     year = {2014},
     language = {en},
     url = {http://dml.mathdoc.fr/item/cai877}
}

David A. Monge; ITIC Research Institute, Universidad Nacional de Cuyo, ECT, Padre Jorge Contreras 1300, M5502JMA Mendoza; Carlos García Garino; ITIC Research Institute & Facultad de Ingeniería, Universidad Nacional de Cuyo, Centro Universitario, M5502JMA Mendoza. LOGOS: Enabling Local Resource Managers for the Efficient Support of Data-Intensive Workflows within Grid Sites. Computing and Informatics, Tome 33 (2014) no. 1, . http://gdmltest.u-ga.fr/item/cai877/