hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars Hofhansl (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-6116) Allow parallel HDFS writes for HLogs.
Date Sat, 30 Jun 2012 16:54:43 GMT

    [ https://issues.apache.org/jira/browse/HBASE-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404563#comment-13404563
] 

Lars Hofhansl commented on HBASE-6116:
--------------------------------------

Yeah... I'll add a bit more diagnostics logging to make 100% sure as this definitely surprised
me.
The length (latency) of the pipe from the client to the RS is long (at least in my test) as
compared to the length of pipes between the RSs and the DNs.
Also the writing of the blocks is already interleaving with writing to the OS buffers, so
the pipeline might not have had as much as an effect as expected.

I'll also test together with durable sync, as this could show a different pattern.
                
> Allow parallel HDFS writes for HLogs.
> -------------------------------------
>
>                 Key: HBASE-6116
>                 URL: https://issues.apache.org/jira/browse/HBASE-6116
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>            Assignee: Lars Hofhansl
>         Attachments: 6116-v1.txt, apurtell-patches.zip, pipelined-vs-parallel-comparison.zip
>
>
> In HDFS-1783 I adapted Dhrubas changes to be used in Hadoop trunk.
> This issue will include the necessary reflection changes to optionally enable this for
the WALs in HBase.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message