accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mike Drob (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2866) Default WAL size should be based on HDFS Block Size
Date Fri, 06 Jun 2014 17:26:03 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020086#comment-14020086
] 

Mike Drob commented on ACCUMULO-2866:
-------------------------------------

[~ecn] - The WAL is not splitable and will only be processed by at most one server at a time.
Keeping it in a single block 1) alleviates extra NN pressure that we could be causing and
2) avoids some potential network overhead. Maybe I'm overstating the benefits here, but as
far as defaults go, it makes more sense to me than just picking a number out of the air.

> Default WAL size should be based on HDFS Block Size
> ---------------------------------------------------
>
>                 Key: ACCUMULO-2866
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2866
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: tserver
>            Reporter: Mike Drob
>            Priority: Minor
>              Labels: wal
>             Fix For: 1.7.0
>
>
> HBase automatically defaults their WAL size to 0.95 * HDFS block size. This makes a lot
of sense from a resource management perspective, and we should do the same.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message