hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7545) Data striping support in HDFS client
Date Tue, 03 Feb 2015 11:39:35 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14303119#comment-14303119
] 

Li Bo commented on HDFS-7545:
-----------------------------

Hi, Zhe thanks for your careful review, and I learn a lot about the community development
details. I have created a subtask HDFS-7729 and upload a patch.
Nits: I think all of them are fixed.

Logics:
1.	I upload a patch(Codec-tmp.patch) which can do encoding and decoding work. 5 small files
are added and they don’t depends on other files.
This help us not blocked by codec related development.
       2&3.  A unit test is added.  ClientProtocol.addBlock still exists some problems
in my environment. Please help check this.
4. add some comments
5. yes. 
6. The newly added logic does not influence packet size.  
7.The code is not tested because unit test is blocked by ClientProtocol.addBlock(). I think
you’re right. I have fixed it in new patch on HDFS-7729.


> Data striping support in HDFS client
> ------------------------------------
>
>                 Key: HDFS-7545
>                 URL: https://issues.apache.org/jira/browse/HDFS-7545
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Zhe Zhang
>            Assignee: Li Bo
>         Attachments: DataStripingSupportinHDFSClient.pdf, HDFS-7545-001-DFSOutputStream.patch,
HDFS-7545-PoC.patch, clientStriping.patch
>
>
> Data striping is a commonly used data layout with critical benefits in the context of
erasure coding. This JIRA aims to extend HDFS client to work with striped blocks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message