hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ascot Moss <ascot.m...@gmail.com>
Subject Maximum number of files in Hadoop v2
Date Fri, 03 Jun 2016 18:32:33 GMT

I read some (old?) articles from Internet about hadoop:

"Due to the DataNode-NameNode block report mechanism, we cannot exceed
100-200K blocks (or files) per node, thereby limiting our 10-node cluster
to less than 2M files."

Is this true in Hadoop v2.x?


View raw message