We're sorry but this page doesn't work properly without JavaScript enabled. Please enable it to continue.
Feedback

Evaluating NVMe drives for accelerating HBase

Formal Metadata

Title
Evaluating NVMe drives for accelerating HBase
Subtitle
NVM HBase acceleration
Title of Series
Number of Parts
611
Author
License
CC Attribution 2.0 Belgium:
You are free to use, adapt and copy, distribute and transmit the work or content in adapted or unchanged form for any legal purpose as long as the work is attributed to the author in the manner specified by the author or licensor.
Identifiers
Publisher
Release Date
Language
Production Year2017

Content Metadata

Subject Area
Genre
Abstract
Non-Volatile-Memory express (NVMe) standard promises and order of magnitudefaster storage than regular SSDs, while at the same time being more economicalthan regular RAM on TB/$. This talk evaluates the use cases and benefits ofNVMe drives for its use in Big Data clusters with HBase and Hadoop HDFS. First, we benchmark the different drives using system level tools (FIO) to getmaximum expected values for each different device type and set expectations.Second, we explore the different options and use cases of HBase storage andbenchmark the different setups. And finally, we evaluate the speedups obtainedby the NVMe technology for the different Big Data use cases from the YCSBbenchmark. In summary, while the NVMe drives show up to 8x speedup in best casescenarios, testing the cost-efficiency of new device technologies is notstraightforward in Big Data, where we need to overcome system level caching tomeasure the maximum benefits.