Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hdfs-issues@hadoop.apache.org
Date: Mon, 27 Apr 2015 07:53:39 +0000 (UTC)
From: "Li Bo (JIRA)" <jira@apache.org>
To: hdfs-issues@hadoop.apache.org
Message-ID: <JIRA.12786688.1427717425000.35075.1430121218995@Atlassian.JIRA>
In-Reply-To: <JIRA.12786688.1427717425000@Atlassian.JIRA>
References: <JIRA.12786688.1427717425000@Atlassian.JIRA>
 <JIRA.12786688.1427717425059@arcas>
Subject: [jira] [Commented] (HDFS-8015) Erasure Coding: local and remote
 block writer for coding work in DataNode
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable


    [ https://issues.apache.org/jira/browse/HDFS-8015?page=3Dcom.atlassian.=
jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D14513=
671#comment-14513671 ]=20

Li Bo commented on HDFS-8015:
-----------------------------

hi, Yi
I think there=E2=80=99re several ways to handle writing a decoded block to =
remote or local. My idea is that first get a domain socket which is bound a=
nd listened by {{DataNode#localDataXCeriverServer}}, then write data via th=
e output stream of this socket. The advantage is that we don=E2=80=99t need=
 to handle the details of block writing. The next step is to extend {{Block=
Receiver}}. Currently it writes to local disk and may also write to remote.=
 We can add a switcher to control its writing directions, i.e,  only local,=
 only remote, remote + local. We can discuss this issue after your first pa=
tch is ready.=20


> Erasure Coding: local and remote block writer for coding work in DataNode
> -------------------------------------------------------------------------
>
>                 Key: HDFS-8015
>                 URL: https://issues.apache.org/jira/browse/HDFS-8015
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Kai Zheng
>            Assignee: Li Bo
>         Attachments: HDFS-8015-000.patch
>
>
> As a task of HDFS-7344 ECWorker, in either stripping or non-stripping era=
sure coding, to perform encoding or decoding, we need to be able to write d=
ata blocks locally or remotely. This is to come up block writer facility in=
 DataNode side. Better to think about the similar work done in client side,=
 so in future it's possible to unify the both.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)