hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Paulson <epaul...@unit1127.com>
Subject A list of some HDFS benchmarks
Date Wed, 04 Sep 2013 21:27:33 GMT
Hello all -

As part of a side project, I've been interested in HDFS benchmarking,
particularly of the Namenode. To get started, I tried to track down a
number of different benchmarks and collect a few observations about each.
I've put together a list here:

http://epaulson.github.io/HadoopInternals/benchmarks.html

The benchmarks I included were:
DFSIO
DFSIO-e
NNBench and NNBenchWithoutMR
S-Live
LoadGenerator
NNThroughputBenchmark
TestEditLog
MStress, from Quantcast
Ohio State Microbenchmarks
SWIM

(I also wrote a bit about what else I'd like to see in a NN benchmark)

I'd appreciate any corrections, feedback, and pointers to code that I
missed!

Thanks!

-Erik

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message