hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Zhang <ezh...@yahoo-inc.com>
Subject max number of files opened at the same time on Hdfs?
Date Tue, 22 Jul 2008 01:01:36 GMT
Apology if this question has been answered before, but I could not find 
in the archive and twiki pages.   I am wondering what's the max number 
of open files for writes  at the same time given a Hdfs cluster?   I am 
streaming data into many different files (in the order of thousands) at 
the same time on Hdfs (200 node cluster) and seemed to have problem 
doing this.    Any insights is greatly appreciated.

Eric Zhang
Vespa Content team

View raw message