incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Travis Crawford <traviscrawf...@gmail.com>
Subject Re: Pig's reducer estimator
Date Mon, 14 May 2012 03:41:31 GMT
Hey Aniket -

I allegedly fixed this in:

Automagically setting parallelism based on input file size does not
work with HCatalog
https://issues.apache.org/jira/browse/PIG-2573

HCatLoader should report its input size so pig can estimate the number
of reducers
https://issues.apache.org/jira/browse/HCATALOG-328

If its not working we should fix it. Can you provide more details?

--travis


On Sun, May 13, 2012 at 7:24 PM, Aniket Mokashi <aniket486@gmail.com> wrote:
> Hi,
>
> I have observed that pig's reducer estimator does not work with HCatalog. I
> am wondering if there is a way to make it work? If not, should we have a
> jira with pig to track this?
>
> Thanks,
> Aniket

Mime
View raw message