hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: How many files can a hdfs client can access simultaneously
Date Sat, 19 Nov 2011 09:15:24 GMT
Oops, s/you're/you. I rephrased half-way.

On 19-Nov-2011, at 2:02 PM, kartheek muthyala wrote:

> Thanks harsh for the confirmation and for referring me to this dl. :)
> 
> On Sat, Nov 19, 2011 at 12:20 PM, Harsh J <harsh@cloudera.com> wrote:
> 
>> Kartheek,
>> 
>> (Moving to hdfs-user@. Bcc'd common-user@. Please use the right lists for
>> reaching to the proper audience :))
>> 
>> Writing multiple files from a single DFS client instance should not be a
>> problem at all. You get one output stream per file creation, leaving you're
>> free to write to a number of them in parallel and to also expect an amount
>> of gain.
>> 
>> On 19-Nov-2011, at 11:26 AM, kartheek muthyala wrote:
>> 
>>> Hi all,
>>> I know that while writing the file, a hdfs client writes the blocks in
>>> sequential fashion, writing one block only at one time and when this
>> block
>>> is acknowledged as a complete write then the next block write happens.
>> But
>>> can a hdfs client write two or three files at a same time, ideally it
>>> should do, can i get a confirmation on this?
>>> ~Kartheek
>> 
>> 


Mime
View raw message