hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chen Wang <chen.apache.s...@gmail.com>
Subject Re: any optimize suggestion for high concurrent write into hdfs?
Date Fri, 21 Feb 2014 04:15:46 GMT
Ch,
you may consider using flume as it already has a flume sink that can sink
to hdfs. What I did is to set up a flume listening on an Avro sink, and
then sink to hdfs. Then in my application, i just send my data to avro
socket.
Chen


On Thu, Feb 20, 2014 at 5:07 PM, ch huang <justlooks@gmail.com> wrote:

> hi,maillist:
>           is there any optimize for large of write into hdfs in same time
> ? thanks
>

Mime
View raw message