hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek <abhishek.dod...@gmail.com>
Subject Re: Hive partitioner
Date Tue, 24 Jul 2012 14:08:02 GMT
Data is skewed here so does it help?

Thanks
Abhi


Sent from my iPhone

On Jul 24, 2012, at 9:50 AM, Nitin Pawar <nitinpawar432@gmail.com> wrote:

> Tried rarely.
> 
> It also depends on the data :)
> 
> On Tue, Jul 24, 2012 at 6:26 PM, Abhishek <abhishek.dodda1@gmail.com> wrote:
>> Hi nitin,
>> 
>> Thanks for the reply.By setting this in hive does it improve the performance ?
>> 
>> Regards
>> Abhi
>> 
>> Sent from my iPhone
>> 
>> On Jul 23, 2012, at 3:18 AM, Nitin Pawar <nitinpawar432@gmail.com> wrote:
>> 
>>> you may try this
>>> 
>>> set hive.mapred.partitioner=
>>> org.apache.hadoop.mapred.lib.TotalOrderPartitioner;
>>> set total.order.partitioner.natural.order=[false|true];
>>> set total.order.partitioner.path=[path];
>>> 
>>> On Mon, Jul 23, 2012 at 8:56 AM, abhiTowson cal
>>> <abhishek.dodda1@gmail.com> wrote:
>>>> 
>>>> hi all,
>>>> 
>>>> How to use total order partitioner hive?
>>>> 
>>>> Regards
>>>> Abhishek
>>> 
>>> 
>>> 
>>> 
>>> --
>>> Nitin Pawar
> 
> 
> 
> -- 
> Nitin Pawar

Mime
View raw message