accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1946) Include dfs.datanode.synconclose in hdfs configuration documentation
Date Mon, 02 Dec 2013 19:34:35 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13836821#comment-13836821
] 

Keith Turner commented on ACCUMULO-1946:
----------------------------------------

bq. Sadly, afaik, this isn't something we can "turn on" for users.

Right, but we can assume they will enable it and bump the default for  tserver.mutation.queue.max
to 512K or 1M maybe.  This will give better out of the box performance.  Also we can document
that users could further increase it for more performance gains in the readme (and/or we can
update the docs for the tserver.mutation.queue.max property).  For 1.7.0 we may want to consider
moving away from this fixed size buffer, I will open a ticket for that.

I feel comfortable tweaking these defaults for 1.6.0, but I am not sure about 1.5 and 1.4.
 Changing the defaults in a bug fix release could break an existing system.

> Include dfs.datanode.synconclose in hdfs configuration documentation
> --------------------------------------------------------------------
>
>                 Key: ACCUMULO-1946
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1946
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: docs
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 1.5.1, 1.6.0
>
>
> We should be including some writeup about dfs.datanode.synconclose in our documentation
surrounding the HDFS configuration as it better ensures that data is lost in the face of hard
shutdown (power loss) of the datanode process.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message