hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erwan MAS <er...@mas.nom.fr>
Subject Hive and engine performance tez vs mr
Date Thu, 02 Apr 2015 16:01:53 GMT
Hello ,

I have a issue on hive , with tez engine . When  try to execute a query , with 
tez engine , the query is 9 times slower than map/reduce . 

The query is a left outer join on two table using orc storage .

With map/reduce i have  :
Job 0 : Map 27 Reduce 256
Job 1 : Map 27 Reduce 256
Time taken 110 sec

With tez i have :
Map 1 :  1/1 Map 4 : 3/3 Reducer 2: 256/256 Reducer 3: 256/256
Time taken 930 sec 

With my configuration tez want to use only one mapper for some part .

How to increase this number of mapper ? 
Which variable on hive , i must set to change this behavior  ?

My context :
   Hive 0.13 on Hortonworks 2.1

--
     ____________________________________________________________
    / Erwan MAS                                                 /\
   | mailto:erwan@mas.nom.fr                                   |_/
___|________________________________________________________   |
\___________________________________________________________\__/

Mime
View raw message