hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cam Bazz <camb...@gmail.com>
Subject Re: joining user sessions
Date Wed, 13 Jun 2012 17:09:12 GMT
Thank you. But how do I put the smaller table into distributed cache?
is it done magically when we do a hive.auto.convert.join=true ?

On Wed, Jun 13, 2012 at 7:52 PM, Bejoy KS <bejoy_ks@yahoo.com> wrote:
> Hi,
>
> If one of your tables are small enough then you can go in for map side joins, which actually
distributes the smaller table contents into the distributed cache and then perform the join
which is much faster compared to normal reduce side joins.
>
> To enable map side joins, before executing join query set the following property
> hive> hive.auto.convert.join=true;
> Regards
> Bejoy KS
>
> Sent from handheld, please excuse typos.
>
> -----Original Message-----
> From: Cam Bazz <cambazz@gmail.com>
> Date: Wed, 13 Jun 2012 19:46:18
> To: <user@hive.apache.org>
> Reply-To: user@hive.apache.org
> Subject: joining user sessions
>
> hello,
>
> for all the log files i have i log the session id and user cookie. now
> i need to seperate certain items of certain users, so i need to join
> all my data to a global cookike table.
>
> what are some common practices doing this? just put it in a table and
> join? or maybe keep them in some sort of in memory cache?
>
> and ideas / recomendations greatly appreciated.
>
> best regards,

Mime
View raw message