hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "majian" <maj...@nq.com>
Subject hive-merge small file
Date Wed, 22 May 2013 02:36:23 GMT

Hello:

I want merge reduce output file 。

hadoop version:hadoop-0.20.205.0/
hive version: hive-0.9.0 

for example:

hive>set hive.merge.mapredfiles=true;
hive>set hive.merge.smallfiles.avgsize=160000000000;
hive>set mapred.reduce.tasks=10;
hive>insert overwrite local directory "/home/db_hive_user/data0"
        select aaer_userid,count(1) from temp_1206 group by aaer_userid;


but, why reduce output is 10 files?

2013-05-22 



majian 
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message