hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nguyen Manh Tien <tien.nguyenm...@gmail.com>
Subject Number of concurrent writer to HDFS
Date Fri, 03 Aug 2012 17:33:32 GMT
I plan to streaming logs data HDFS using many writer, each writer write a
stream of data to a HDFS file (may rotate)

I wonder how many concurrent writer i should use?
And if you have that experience please share to me : hadoop cluster size,
number of writer, replication.


View raw message