hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fabio Pitzolu <fabio.pitz...@gr-ci.com>
Subject Re: Hadoop fs -getmerge
Date Thu, 18 Apr 2013 07:41:50 GMT
Hi Hemanth,
I guess that the only solution is to delete the crc files after the export.
Does anyone of you knows if someone filed a Jira to implement a parameter
to -getmerge to delete the crc files afterwards?



*Fabio Pitzolu*
Consultant - BI & Infrastructure

Mob. +39 3356033776
Telefono 02 87157239
Fax. 02 93664786

*Gruppo Consulenza Innovazione - http://www.gr-ci.com*


2013/4/18 Hemanth Yamijala <yhemanth@thoughtworks.com>

> I don't think that is possible. When we use -getmerge, the destination
> filesystem happens to be a LocalFileSystem which extends from
> ChecksumFileSystem. I believe that's why the CRC files are getting in.
>
> Would it not be possible for you to ignore them, since they have a fixed
> extension ?
>
> Thanks
> Hemanth
>
>
> On Wed, Apr 17, 2013 at 8:09 PM, Fabio Pitzolu <fabio.pitzolu@gr-ci.com>wrote:
>
>> Hi all,
>> is there a way to use the "*getmerge*" fs command and not generate the
>> .crc files in the output local directory?
>>
>> Thanks,
>>
>> Fabio Pitzolu**
>>
>
>

Mime
View raw message