hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7653) Block Readers and Writers used in both client side and datanode side
Date Thu, 22 Jan 2015 02:47:34 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Li Bo updated HDFS-7653:
    Attachment: BlockReadersWriters.patch

This patch includes block readers and writers that will be used by client and datanode. Because
there exists BlockReader interface, we named a new interface called UnifiedBlockReader. Its
sub classes include: ClientBlockReader(read a block from client), LocalDatanodeBlockReader(read
a local block, used inside datanode), RemoteDatanodeBlockReader(read a block from remote datanode,
used inside datanode). BlockWriter's sub classes include ClientBlockWriter(write a block form
client), LocalDatanodeBlockWriter(write a block locally, used inside datanode), RemoteDatanodeBlockWriter(write
a block to a remote datanode, used inside datanode). Two unit tests are also uploaded.
Welcome to your feedback.

> Block Readers and Writers used in both client side and datanode side
> --------------------------------------------------------------------
>                 Key: HDFS-7653
>                 URL: https://issues.apache.org/jira/browse/HDFS-7653
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: BlockReadersWriters.patch
> There're a lot of block read/write operations in HDFS-EC, for example, when client writes
a file in striping layout, client has to write several blocks to several different datanodes;
if a datanode wants to do an encoding/decoding task, it has to read several blocks from itself
and other datanodes, and writes one or more blocks to itself or other datanodes.  

This message was sent by Atlassian JIRA

View raw message