hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From venkata kishore <>
Subject hive.exec.max.created.files
Date Tue, 01 Sep 2015 21:34:58 GMT
hi Group,
    default value of hive.exec.max.created.files is 100,000.
I have huge table without partitions.
I want to remove duplicates by using "group by" and insert into a new
partitioned table with dynamic partition.

[Fatal Error] total number of created files now is 101859, which exceeds

I want to increase this setting. Before increasing, how do i know if its
safe to do so?

I have a ~50 node cluster.


View raw message