hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Quigley <dquigle...@gmail.com>
Subject Re: SnapshotInputFormat long initialization time.
Date Tue, 08 Apr 2014 14:48:54 GMT
No haven't seen that, I think I backported just before that jira was
created. Thanks! ill check it out


On Tue, Apr 8, 2014 at 7:45 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> Have you looked at HBASE-10642 which was integrated to 0.94.18 ?
>
> Cheers
>
>
> On Tue, Apr 8, 2014 at 8:19 AM, David Quigley <dquigley89@gmail.com>wrote:
>
>> Hi all,
>>
>> I backported SnapshotInputFormat to hbase 0.94. This resulted in a huge
>> performance gain while the scan is running. Here is the corresponding jira
>> https://issues.apache.org/jira/browse/HBASE-8369. The overall
>> performance gain is mitigated by a very long initialization period. It can
>> take up to 30 minutes after the snapshot completes for the MR job to
>> actually begin.
>>
>> Does anybody have experience running SnapshotInputFormay on 0.94 or 0.98?
>> Are you seeing the same long initialization period?
>>
>> Thanks!
>> Dave
>>
>
>

Mime
View raw message