The recent years have significantly changed the perception of web services and data storages, as clouds became a big part of IT market. New challenges appear in the field of scalable web systems, which become bigger and more complex. One of them is designing load balancing algorithms that could allow for optimal utilization of servers' resources in large, distributed systems. This paper presents an algorithm called Two-Level Load Balancing, which has been implemented and evaluated in onedata - a global data access system. A study of onedata architecture, request types and use cases has been performed to determine the requirements of load balancing set by similar, highly scalable distributed systems. The algorithm was designed to match these requirements, and it was achieved by using a synergy of DNS and internal dispatcher load balancing. Test results show that the algorithm does not introduce considerable overheads and maintains the performance of the system on high level, even in cases when its servers are not equally loaded.
Publié le : 2018-05-09
Classification:  Parallel and Distributed Computing,  Load balancing, geographically distributed systems, DNS, web clusters,  68M11, 68M14, 68W99
@article{cai2018_1_1,
     author = {\L ukasz Opio\l a; AGH University, ACC Cyfronet AGH, Krak\'ow and \L ukasz Dutka; AGH University, ACC Cyfronet AGH, Krak\'ow and Micha\l\ Wrzeszcz; AGH University, Department of Computer Science, Krak\'ow and Renata S\l ota; AGH University, Department of Computer Science, Krak\'ow and Jacek Kitowski; AGH University, Department of Computer Science, Krak\'ow},
     title = {Two-Layer Load Balancing for Onedata System},
     journal = {Computing and Informatics},
     volume = {36},
     number = {6},
     year = {2018},
     language = {en},
     url = {http://dml.mathdoc.fr/item/cai2018_1_1}
}
Łukasz Opioła; AGH University, ACC Cyfronet AGH, Kraków; Łukasz Dutka; AGH University, ACC Cyfronet AGH, Kraków; Michał Wrzeszcz; AGH University, Department of Computer Science, Kraków; Renata Słota; AGH University, Department of Computer Science, Kraków; Jacek Kitowski; AGH University, Department of Computer Science, Kraków. Two-Layer Load Balancing for Onedata System. Computing and Informatics, Tome 36 (2018) no. 6, . http://gdmltest.u-ga.fr/item/cai2018_1_1/