incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bill Graham <billgra...@gmail.com>
Subject Re: Pig's reducer estimator
Date Mon, 14 May 2012 06:22:32 GMT
I believe this JIRA could be related:

https://issues.apache.org/jira/browse/PIG-2693


On Sun, May 13, 2012 at 8:41 PM, Travis Crawford
<traviscrawford@gmail.com>wrote:

> Hey Aniket -
>
> I allegedly fixed this in:
>
> Automagically setting parallelism based on input file size does not
> work with HCatalog
> https://issues.apache.org/jira/browse/PIG-2573
>
> HCatLoader should report its input size so pig can estimate the number
> of reducers
> https://issues.apache.org/jira/browse/HCATALOG-328
>
> If its not working we should fix it. Can you provide more details?
>
> --travis
>
>
> On Sun, May 13, 2012 at 7:24 PM, Aniket Mokashi <aniket486@gmail.com>
> wrote:
> > Hi,
> >
> > I have observed that pig's reducer estimator does not work with
> HCatalog. I
> > am wondering if there is a way to make it work? If not, should we have a
> > jira with pig to track this?
> >
> > Thanks,
> > Aniket
>



-- 
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*

Mime
View raw message