hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nguyen Manh Tien <tien.nguyenm...@gmail.com>
Subject Number of concurrent writer to HDFS
Date Fri, 03 Aug 2012 17:33:32 GMT
Hi,
I plan to streaming logs data HDFS using many writer, each writer write a
stream of data to a HDFS file (may rotate)

I wonder how many concurrent writer i should use?
And if you have that experience please share to me : hadoop cluster size,
number of writer, replication.

Thanks.
Tien

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message