hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From venkata kishore <p.venkata.kish...@gmail.com>
Subject hive.exec.max.created.files
Date Tue, 01 Sep 2015 21:34:58 GMT
hi Group,
    default value of hive.exec.max.created.files is 100,000.
I have huge table without partitions.
I want to remove duplicates by using "group by" and insert into a new
partitioned table with dynamic partition.

exception:
[Fatal Error] total number of created files now is 101859, which exceeds
100000

I want to increase this setting. Before increasing, how do i know if its
safe to do so?

I have a ~50 node cluster.

-- 
Cheers,
Kishore

Mime
View raw message