hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hyunsik Choi <hyunsikc...@korea.ac.kr>
Subject Re: Block placement in HDFS
Date Wed, 26 Nov 2008 01:55:05 GMT
Hi All,

I try to divide some data into partitions explicitly (like regions of
Hbase). I wonder the following way to do is the best method.

For example, when we assume a block size 64MB, a file potion
corresponding to 0~63MB is allocated to first block?

I have three questions as follows:

Is the above method valid?
Is it the best method?
Is there alternative method?

Thank in advance.

-- 
Hyunsik Choi
Database & Information Systems Group
Dept. of Computer Science & Engineering, Korea University


On Mon, 2008-11-24 at 20:44 -0800, Mahadev Konar wrote:
> Hi Dennis,
>   I don't think that is possible to do.  The block placement is determined
> by HDFS internally (which is local, rack local and off rack).
> 
> 
> mahadev
> 
> 
> On 11/24/08 6:59 PM, "dennis81" <dlogothetis@gmail.com> wrote:
> 
> > 
> > Hi everyone,
> > 
> > I was wondering whether it is possible to control the placement of the
> > blocks of a file in HDFS. Is it possible to instruct HDFS about which nodes
> > will hold the block replicas?
> > 
> > Thanks!



Mime
View raw message