hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roy Leonard <roy.leonard...@gmail.com>
Subject Improving recovery performance for degraded reads
Date Fri, 22 Jul 2016 08:33:48 GMT

We are evaluating erasure coding on HDFS to reduce storage cost.
However, the degraded read latency seems like a crucial bottleneck for our
After exploring some strategies for alleviating the pain of degraded read
I found a "tree-like recovery" technique might be useful, as described in
the following paper:
"Partial-parallel-repair (PPR): a distributed technique for repairing
erasure coded storage" (Eurosys-2016)

My question is:

Do you already have such tree-like recovery implemented in HDFS-EC if not,
do you have any plans to add similar technique is near future ?

Also, I would like to know what others have done to sustain good
performance even under failures (other than keeping fail-over replicas).


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message