hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From max scalf <oracle.bl...@gmail.com>
Subject Re: Hive and engine performance tez vs mr
Date Mon, 06 Apr 2015 17:15:05 GMT
Try setting the below in Hive and see what happens..btw what are you
configs in hive if any?

set mapred.map.tasks = 20;


On Thu, Apr 2, 2015 at 11:01 AM, Erwan MAS <erwan@mas.nom.fr> wrote:

> Hello ,
>
> I have a issue on hive , with tez engine . When  try to execute a query ,
> with
> tez engine , the query is 9 times slower than map/reduce .
>
> The query is a left outer join on two table using orc storage .
>
> With map/reduce i have  :
> Job 0 : Map 27 Reduce 256
> Job 1 : Map 27 Reduce 256
> Time taken 110 sec
>
> With tez i have :
> Map 1 :  1/1 Map 4 : 3/3 Reducer 2: 256/256 Reducer 3: 256/256
> Time taken 930 sec
>
> With my configuration tez want to use only one mapper for some part .
>
> How to increase this number of mapper ?
> Which variable on hive , i must set to change this behavior  ?
>
> My context :
>    Hive 0.13 on Hortonworks 2.1
>
> --
>      ____________________________________________________________
>     / Erwan MAS                                                 /\
>    | mailto:erwan@mas.nom.fr                                   |_/
> ___|________________________________________________________   |
> \___________________________________________________________\__/
>

Mime
View raw message