incubator-hcatalog-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Travis Crawford <traviscrawf...@gmail.com>
Subject Re: Pig's reducer estimator
Date Tue, 15 May 2012 22:44:40 GMT
To close the loop on this... we identified an issue with a recent pig
patch and are fixing. Will be fixed shortly.

--travis


On Sun, May 13, 2012 at 11:22 PM, Bill Graham <billgraham@gmail.com> wrote:
> I believe this JIRA could be related:
>
> https://issues.apache.org/jira/browse/PIG-2693
>
>
> On Sun, May 13, 2012 at 8:41 PM, Travis Crawford
> <traviscrawford@gmail.com>wrote:
>
>> Hey Aniket -
>>
>> I allegedly fixed this in:
>>
>> Automagically setting parallelism based on input file size does not
>> work with HCatalog
>> https://issues.apache.org/jira/browse/PIG-2573
>>
>> HCatLoader should report its input size so pig can estimate the number
>> of reducers
>> https://issues.apache.org/jira/browse/HCATALOG-328
>>
>> If its not working we should fix it. Can you provide more details?
>>
>> --travis
>>
>>
>> On Sun, May 13, 2012 at 7:24 PM, Aniket Mokashi <aniket486@gmail.com>
>> wrote:
>> > Hi,
>> >
>> > I have observed that pig's reducer estimator does not work with
>> HCatalog. I
>> > am wondering if there is a way to make it work? If not, should we have a
>> > jira with pig to track this?
>> >
>> > Thanks,
>> > Aniket
>>
>
>
>
> --
> *Note that I'm no longer using my Yahoo! email address. Please email me at
> billgraham@gmail.com going forward.*

Mime
View raw message