Post-graduate theses
Current Record: 18 of 833
|
Identifier |
000460803 |
Title |
Anthus: index shipping for LSM-based Key-Value stores utilizing hybrid Key-Value placement |
Alternative Title |
Αποστολή ευρετηρίου για συστήματα Κλειδιού-Τιμής βασισμένα σε LSM που χρησιμοποιούν υβριδική τοποθέτηση Κλειδιού-Τιμής |
Author
|
Στυλιανάκης, Γεώργιος Κ.
|
Thesis advisor
|
Μπίλας, Άγγελος
|
Reviewer
|
Μαγκούτης, Κωνσταντίνος
Πρατικάκης, Πολύβιος
|
Abstract |
Key-Value (KV) stores based on LSM tree have become a foundational layer in the
storage stack of Data Centers and Cloud Services. In state-of-the-art distributed
KV stores, the communication over the network is a severe performance bottleneck.
Current designs reduce the network traffic by sending only user data across
nodes to achieve system reliability and availability. As a result, they perform costly
compaction operations to reorganize data in both primary and backup nodes. This
approach increases device I/O traffic and CPU overhead and eventually hurts overall
system performance.
Initially, Tebis introduced the notion of Index-Shipping. Index-Shipping is an
efficient solution for two reasons: Firstly, Tebis uses RDMA thus reduces the network
overhead compared to traditional practices (TCP/IP) and secondly it reduces
resource consumption at the backup nodes by maintaining the replica index. However,
Tebis utilizes KV separation. In case of small KV pairs, which dominate
modern workloads, this method is impractical because it heightens garbage collection
costs resulting to increased I/O amplification.
In this work we introduce Anthus; an efficient replicated LSM-based KV store
which extends Tebis. In our implementation we utilize an Index-Shipping method
for KV stores that relies on hybrid KV placement instead of KV separation. Hybrid
KV placement is an emerging technique that reduces I/O amplification regardless
of the KV pair sizes. Our results show that our design increases throughput by
1.06−2.90x, CPU efficiency by up to 1.21−2.78x and decreases I/O amplification
by 1.7 − 3.27x over baseline implementations. Also, Anthus increases throughput
by 1.06 − 1.95x, CPU efficiency by 1.14 − 1.8x and minimizes I/O amplification by 1.5 − 1.87x over Tebis.
|
Language |
English |
Subject |
B-tree indexes |
|
Flash storage |
|
LSM-tree |
|
RDMA |
|
Δέντρα LSM |
|
Ευρετήρια B-tree |
|
Καταστήματα Κλειδιού-Τιμής |
|
Τεχνολογία αποθήκευσης Flash |
Issue date |
2023-12-01 |
Collection
|
School/Department--School of Sciences and Engineering--Department of Computer Science--Post-graduate theses
|
|
Type of Work--Post-graduate theses
|
Permanent Link |
https://elocus.lib.uoc.gr//dlib/c/7/f/metadata-dlib-1701430712-586616-4284.tkl
|
Views |
1083 |