Results - Details
Search command : All Fields="Γλαμπεδάκης"
Current Record: 1 of 2
|
Identifier |
000413373 |
Title |
A big data analytics system based on a high level query language using Apache Spark |
Alternative Title |
Ένα σύστημα ανάλυσης μεγάλων δεδομένων βασισμένο σε μία γλώσσα επερωτήσεων υψηλού επιπέδου χρησιμοποιώντας το Apache Spark |
Author
|
Γλαμπεδάκης, Βασίλειος Γ.
|
Thesis advisor
|
Πλεξουσάκης, Δημήτρης
|
Reviewer
|
Σπυράτος, Νικόλας
Τζίτζικας, Γιάννης
|
Abstract |
Big data analytics is one of the most active research areas today with a lot of
challenges, both theoretical and practical. This thesis makes a contribution to the
area of big data analytics by implementing the HIFUN language using the Apache
Spark framework. HIFUN is a high level query language, proposed for expressing
analytic queries over big data sets. This language makes a clear separation between
the conceptual and the physical level. An analytic query and its answer are defined
at the conceptual level independently of the nature and location of data. The
abstract definitions are then mapped to lower level evaluation mechanisms, taking
into account the nature and location of data, as well as other related aspects. In this
thesis, we leverage this language to design and implement a system which allows
a user to analyse, visualize and discover information useful for decision making,
which is "hidden" in large-scale data sets. In the physical level, HIFUN queries
are mapped to lower level evaluation mechanisms of the Apache Spark framework
following the conceptual evaluation scheme proposed by HIFUN and supporting a
big range of data set formats. In the conceptual level, we apply the query rewriting
rules and create query execution plans, proposed by HIFUN. Our work shows that
the HIFUN formal model is useful in practice and the experimental evaluation
of the system proves that the model's approach to query rewriting and to the
generation of query execution plans succeeds in reducing the computational costs
regardless of the nature of the data.
|
Language |
English |
Subject |
Analytic queries |
|
Conceptual modeling |
|
Query languages |
|
Ανάλυση μεγάλων δεδομένων |
|
Γλώσσες επερωτήσεων |
|
Εννοιολογική μοντελοποίηση |
|
Επερωτήσεις ανάλυσης |
Issue date |
2017-11-24 |
Collection
|
School/Department--School of Sciences and Engineering--Department of Computer Science--Post-graduate theses
|
|
Type of Work--Post-graduate theses
|
Permanent Link |
https://elocus.lib.uoc.gr//dlib/7/f/c/metadata-dlib-1513757228-611759-7712.tkl
|
Views |
763 |