hadoop-general mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From elton sky <eltonsky9...@gmail.com>
Subject Why single thread for HDFS?
Date Fri, 02 Jul 2010 06:13:35 GMT
I guess this question was igored, so I just post it again.

>From my understanding, HDFS uses a single thread to do read and write.
Since a file is composed of many blocks and each block is stored as a file
in the underlying FS, we can do some parallelism on block base.
When read across multi-blocks, threads can be used to read all blocks. When
write, we can calculate the offset of each block and write to all of them

Is this right?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message