accumulo-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Elser <josh.el...@gmail.com>
Subject Re: Running Accumulo on a standard file system, without Hadoop
Date Mon, 16 Jan 2017 22:53:16 GMT


Dylan Hutchison wrote:
>> You can configure HDFS to use the RawLocalFileSystem class forfile://
>> >  URIs which is what is done for a majority of the integration tests. Beware
>> >  that you configure the RawLocalFileSystem as the ChecksumFileSystem
>> >  (default forfile://) will fail miserably around WAL recovery.
>> >
>> >  https://github.com/apache/accumulo/blob/master/test/src/main
>> >  /java/org/apache/accumulo/test/BulkImportVolumeIT.java#L61
>> >
>> >
> Hi Josh, are you saying that the ChecksumFileSystem is required or
> forbidden for WAL recovery?  Looking at the Hadoop code it seems that
> LocalFileSystem wraps around a RawLocalFileSystem to provide checksum
> capabilities.  Is that right?
>

Sorry I wasn't clearer: forbidden. If you use the RawLocalFileSystem and 
you should not see any issues. If you use the ChecksumFileSystem (which 
is the default) and you *will* see issues.

Mime
View raw message