hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kai Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-7729) Add logic to DFSOutputStream to support writing a file in striping layout
Date Wed, 11 Feb 2015 00:03:12 GMT

    [ https://issues.apache.org/jira/browse/HDFS-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315231#comment-14315231
] 

Kai Zheng commented on HDFS-7729:
---------------------------------

bq.this patch looks much better now ! Client striping logic is a complex piece and I believe
we are getting closer.
It's great ! Thanks [~zhz] for guiding Bo thru this. To get even closer, [~libo-intel], would
you please clean up, get the necessary left TODO items done this phase and make it edible
to commit. Possible to use erasure raw coder API and the RS coder impl in HADOOP-11542 ? Do
we have new tests for the stripping ? Please run thoroughly existing tests to ensure we're
not breaking.

Thanks.

> Add logic to DFSOutputStream to support writing a file in striping layout 
> --------------------------------------------------------------------------
>
>                 Key: HDFS-7729
>                 URL: https://issues.apache.org/jira/browse/HDFS-7729
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: Codec-tmp.patch, HDFS-7729-001.patch, HDFS-7729-002.patch, HDFS-7729-003.patch,
HDFS-7729-004.patch, HDFS-7729-005.patch
>
>
> If client wants to directly write a file striping layout, we need to add some logic to
DFSOutputStream.  DFSOutputStream needs multiple DataStreamers to write each cell of a stripe
to a remote datanode. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message