Καλησπέρα,
με την ευκαιρία της παρουσίασης την δουλειάς μας, "ORiON: Online
ResOurce Negotiator for multiple Big Data Analytics frameworks" στο ICAC
2018 την ερχόμενη εβδομάδα, σκεφτήκαμε με το Γιάννη να εγκαινιάσουμε τη
νέα σεζόν με μια πρόβα αυτή την Παρασκευή στη 13.00.
Ακολουθεί το abstract:
In recent years we observe the rapid growth of large-scale analytics
applications in a wide range of domains – from healthcare
infrastructures to traffic management. The high volume of data that need
to be processed has stimulated the development of special purpose
frameworks which handle the data deluge by parallelizing data processing
and concurrently using multiple computing nodes. These frameworks
differentiate significantly in terms of the policies they follow to
decompose their workloads into multiple tasks and also on the way they
exploit the available computing resources. As a result, based on the
framework that applications have been implemented in, we observe
significant variations in their resource utilization and execution
times. Therefore, determining the appropriate framework for executing a
big data application is not trivial. In this work we propose Orion, a
novel resource negotiator for cloud infrastructures that support
multiple big data frameworks such as Apache Spark, Apache Flink and
TensorFlow. More specifically, given an application, Orion determines
the most appropriate framework to assign it to. Additionally, Orion
reserves the required resources so that the application is able to meet
its performance requirements. Our negotiator exploits state- of-the-art
prediction techniques for estimating the application’s execution time
when it is assigned to a specific framework with varying configuration
parameters and processing resources. Finally, our detailed experimental
evaluation, using practical big data workloads on our local cluster,
illustrates that our approach outperforms its competitors.
N.
--
Nikolaos Chalvantzis
PhD Candidate
Computing Systems Laboratory, School of ECE
National Technical University of Athens
e-mail: nchalv(a)cslab.ece.ntua.gr
skype: n1k0s_ch47vant21s
tel: (+30)6977299040
