accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1946) Include dfs.datanode.synconclose in hdfs configuration documentation
Date Tue, 03 Dec 2013 16:42:49 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13837882#comment-13837882
] 

Keith Turner commented on ACCUMULO-1946:
----------------------------------------

bq. however substantially less probable than the walog issue.

I am not sure its less probable, I think it depends on how frequently compactions are running.
 If a system is constantly compacting, then it will have compacted data in memory thats not
flushed to disk a significant percentage of a given time period.  If lots of nodes are running
compactions, then there may always be unflushed data somewhere. If the power goes out on a
system running lots of compaction, then data loss seems highly likely.

> Include dfs.datanode.synconclose in hdfs configuration documentation
> --------------------------------------------------------------------
>
>                 Key: ACCUMULO-1946
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1946
>             Project: Accumulo
>          Issue Type: Improvement
>          Components: docs
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 1.5.1, 1.6.0
>
>
> We should be including some writeup about dfs.datanode.synconclose in our documentation
surrounding the HDFS configuration as it better ensures that data is lost in the face of hard
shutdown (power loss) of the datanode process.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message