We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Evaluating NVMe drives for accelerating HBase

Formale Metadaten

Titel
Evaluating NVMe drives for accelerating HBase
Untertitel
NVM HBase acceleration
Serientitel
Anzahl der Teile
611
Autor
Lizenz
CC-Namensnennung 2.0 Belgien:
Sie dürfen das Werk bzw. den Inhalt zu jedem legalen Zweck nutzen, verändern und in unveränderter oder veränderter Form vervielfältigen, verbreiten und öffentlich zugänglich machen, sofern Sie den Namen des Autors/Rechteinhabers in der von ihm festgelegten Weise nennen.
Identifikatoren
Herausgeber
Erscheinungsjahr
Sprache
Produktionsjahr2017

Inhaltliche Metadaten

Fachgebiet
Genre
Abstract
Non-Volatile-Memory express (NVMe) standard promises and order of magnitudefaster storage than regular SSDs, while at the same time being more economicalthan regular RAM on TB/$. This talk evaluates the use cases and benefits ofNVMe drives for its use in Big Data clusters with HBase and Hadoop HDFS. First, we benchmark the different drives using system level tools (FIO) to getmaximum expected values for each different device type and set expectations.Second, we explore the different options and use cases of HBase storage andbenchmark the different setups. And finally, we evaluate the speedups obtainedby the NVMe technology for the different Big Data use cases from the YCSBbenchmark. In summary, while the NVMe drives show up to 8x speedup in best casescenarios, testing the cost-efficiency of new device technologies is notstraightforward in Big Data, where we need to overcome system level caching tomeasure the maximum benefits.