hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7715) Implement the Hitchhiker erasure coding algorithm
Date Tue, 07 Apr 2015 10:23:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14482953#comment-14482953

Kai Zheng commented on HDFS-7715:

bq.When do you have available time to make a phone call, I want to disscuss with you by phone
Maybe you could have some thoughts first before we can make the call. How about on this Thursday
bq.Can I upload the test codes alone?
I thought you could upload it just for me to review. While when committing, I'm not so sure.
Let's upload it first.
bq.maybe pb_index is ok
No,it's not in the good style. How about {{pbIndex}}?
bq.we need change private to protected of numDataUnits, numParityUnits in AbstractRawErasureCoder
No. It's good to have the temp variables, but please use good names, consistently.

Others sound good to me.

> Implement the Hitchhiker erasure coding algorithm
> -------------------------------------------------
>                 Key: HDFS-7715
>                 URL: https://issues.apache.org/jira/browse/HDFS-7715
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: jack liuquan
>         Attachments: 7715-hitchhikerXOR-v2.patch, HDFS-7715-hhxor-decoder.patch, HDFS-7715-hhxor-encoder.patch
> [Hitchhiker | http://www.eecs.berkeley.edu/~nihar/publications/Hitchhiker_SIGCOMM14.pdf]
is a new erasure coding algorithm developed as a research project at UC Berkeley. It has been
shown to reduce network traffic and disk I/O by 25%-45% during data reconstruction. This JIRA
aims to introduce Hitchhiker to the HDFS-EC framework, as one of the pluggable codec algorithms.
> The existing implementation is based on HDFS-RAID. 

This message was sent by Atlassian JIRA

View raw message