hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uma Maheswara Rao G 72686 <mahesw...@huawei.com>
Subject Re: Strategy Of Replica
Date Tue, 11 Oct 2011 05:26:35 GMT
To get the best performance from Hadoop, we can configure network topology.
Based on that, it will apply RackAwareness algorithms and write/read the files.
  Also HDFS-2246 will improve performance by reading directly local replicas. 

If you have good algorithm and will get good performance than this current algorithms, please
file a JIRA with your proposed strategy and design doc. :-)

Thanks & Regards,
Uma

----- Original Message -----
From: gschen <gongsuochen@yahoo.com.cn>
Date: Tuesday, October 11, 2011 9:26 am
Subject: Re: Strategy Of Replica
To: common-dev@hadoop.apache.org

> On 2011/10/11 11:13, Uma Maheswara Rao G 72686 wrote:
> > I did not get your proposed strategy implementations.
> >
> > Note that, already you can set the replication levels for files. 
> If you set less replication, then obviously your perf and space 
> will get benefits and also risk will be high in this case. I think 
> we can manage your requirements using that replication factor. 
> Your expectations are something different that this?
> >
> > Regards,
> > Uma
> > ----- Original Message -----
> > From: gschen<gongsuochen@yahoo.com.cn>
> > Date: Tuesday, October 11, 2011 8:14 am
> > Subject: Strategy Of Replica
> > To: "common-dev@hadoop.apache.org"<common-dev@hadoop.apache.org>
> >
> >> Hi guys,
> >> What do you think of the strategy of replication in hdfs? How about
> >> the
> >> customized strategy that users customized their strategy of
> >> replication
> >> such as price, performance and so on?
> >>
> >> Thank you in advance.
> >>
> Thanks for your reply. In hdfs only one thing we can do is that we 
> could 
> set replication factor to change replication  strategy, but we can 
> not 
> change where the block is stored and what type of storage that we 
> stored 
> the data. Just think this  case: In order to improve the 
> downloading 
> speed, I can choose my block replication near my location or near 
> someone's location. I mean that users could have more option to 
> decide 
> their block replication strategy.
> 

Mime
View raw message