hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: How many files can a hdfs client can access simultaneously
Date Sat, 19 Nov 2011 06:50:06 GMT
Kartheek,

(Moving to hdfs-user@. Bcc'd common-user@. Please use the right lists for reaching to the
proper audience :))

Writing multiple files from a single DFS client instance should not be a problem at all. You
get one output stream per file creation, leaving you're free to write to a number of them
in parallel and to also expect an amount of gain.

On 19-Nov-2011, at 11:26 AM, kartheek muthyala wrote:

> Hi all,
> I know that while writing the file, a hdfs client writes the blocks in
> sequential fashion, writing one block only at one time and when this block
> is acknowledged as a complete write then the next block write happens. But
> can a hdfs client write two or three files at a same time, ideally it
> should do, can i get a confirmation on this?
> ~Kartheek


Mime
View raw message