accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <>
Subject [jira] [Created] (ACCUMULO-1947) dfs.datanode.synconclose check is lacking
Date Mon, 02 Dec 2013 17:24:36 GMT
Josh Elser created ACCUMULO-1947:

             Summary: dfs.datanode.synconclose check is lacking
                 Key: ACCUMULO-1947
             Project: Accumulo
          Issue Type: Bug
            Reporter: Josh Elser
            Assignee: Josh Elser
             Fix For: 1.5.1, 1.6.0

The dfs configuration checks we now perform to support hdfs WALs includes a check for dfs.datanode.synconclose
which informs the datanode to flush to disk when a file is closed instead of lazily writing
the block (very important in the case of power failure).

Looking at the actual check, it performs reflection on a CreateFlag class. In Apache Hadoop
1.2.1, this class doesn't exist yet the option for dfs.datanode.synconclose does exist. We
should likely just reflect on the constant DFSConfigKeys.DFS_DATANODE_SYNCONCLOSE_KEY or DFSConfigKeys.DFS_DATANODE_SYNCONCLOSE_DEFAULT
to determine if that option is present.

This message was sent by Atlassian JIRA

View raw message