accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Newton <eric.new...@gmail.com>
Subject Re: HDFS durable sync
Date Fri, 08 Nov 2013 20:45:06 GMT
It's related, in that it reduces data loss, but it's a different setting.

We're constantly syncing the WALog, but not data in RFiles.  To get
datanodes to sync when a file is closed, you should use
dfs.datanode.synconclose=true.

-Eric


On Fri, Nov 8, 2013 at 3:32 PM, Miguel Pereira <miguelapereira1@gmail.com>wrote:

> Alright guys, with Accumulo 1.5.0 and CDH4.4 we are getting this warning:
>
> 2013-11-08 15:11:02,672 [tabletserver.TabletServer] WARN :
> > dfs.datanode.synconclose set to false: data loss is possible on system
> > reset or power loss
> >
>
> I was wondering if this is related to the durable sync and the recommended
> way to change the config settings ( xml files, Cloudera manager ).
>
> Cheers,
> Miguel
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message