incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Travis Crawford <>
Subject Re: Pig's reducer estimator
Date Mon, 14 May 2012 03:41:31 GMT
Hey Aniket -

I allegedly fixed this in:

Automagically setting parallelism based on input file size does not
work with HCatalog

HCatLoader should report its input size so pig can estimate the number
of reducers

If its not working we should fix it. Can you provide more details?


On Sun, May 13, 2012 at 7:24 PM, Aniket Mokashi <> wrote:
> Hi,
> I have observed that pig's reducer estimator does not work with HCatalog. I
> am wondering if there is a way to make it work? If not, should we have a
> jira with pig to track this?
> Thanks,
> Aniket

View raw message