hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: SnapshotInputFormat long initialization time.
Date Tue, 08 Apr 2014 14:45:02 GMT
Have you looked at HBASE-10642 which was integrated to 0.94.18 ?

Cheers


On Tue, Apr 8, 2014 at 8:19 AM, David Quigley <dquigley89@gmail.com> wrote:

> Hi all,
>
> I backported SnapshotInputFormat to hbase 0.94. This resulted in a huge
> performance gain while the scan is running. Here is the corresponding jira
> https://issues.apache.org/jira/browse/HBASE-8369. The overall performance
> gain is mitigated by a very long initialization period. It can take up to
> 30 minutes after the snapshot completes for the MR job to actually begin.
>
> Does anybody have experience running SnapshotInputFormay on 0.94 or 0.98?
> Are you seeing the same long initialization period?
>
> Thanks!
> Dave
>

Mime
View raw message