hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Li Bo (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HDFS-7653) Block Readers and Writers used in both client side and datanode side
Date Thu, 22 Jan 2015 02:47:34 GMT

     [ https://issues.apache.org/jira/browse/HDFS-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Li Bo updated HDFS-7653:
------------------------
    Attachment: BlockReadersWriters.patch

This patch includes block readers and writers that will be used by client and datanode. Because
there exists BlockReader interface, we named a new interface called UnifiedBlockReader. Its
sub classes include: ClientBlockReader(read a block from client), LocalDatanodeBlockReader(read
a local block, used inside datanode), RemoteDatanodeBlockReader(read a block from remote datanode,
used inside datanode). BlockWriter's sub classes include ClientBlockWriter(write a block form
client), LocalDatanodeBlockWriter(write a block locally, used inside datanode), RemoteDatanodeBlockWriter(write
a block to a remote datanode, used inside datanode). Two unit tests are also uploaded.
Welcome to your feedback.

> Block Readers and Writers used in both client side and datanode side
> --------------------------------------------------------------------
>
>                 Key: HDFS-7653
>                 URL: https://issues.apache.org/jira/browse/HDFS-7653
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>            Reporter: Li Bo
>            Assignee: Li Bo
>         Attachments: BlockReadersWriters.patch
>
>
> There're a lot of block read/write operations in HDFS-EC, for example, when client writes
a file in striping layout, client has to write several blocks to several different datanodes;
if a datanode wants to do an encoding/decoding task, it has to read several blocks from itself
and other datanodes, and writes one or more blocks to itself or other datanodes.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message