hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christoph Schmitz <Christoph.Schm...@1und1.de>
Subject AW: Under-replication warnings for Distributed Cache?
Date Tue, 16 Aug 2011 06:39:17 GMT
> Von: Harsh J [mailto:harsh@cloudera.com] 
> Gesendet: Dienstag, 16. August 2011 07:15
> An: mapreduce-user@hadoop.apache.org
> Betreff: Re: Under-replication warnings for Distributed Cache?
> 
> On Mon, Aug 15, 2011 at 7:10 PM, Christoph Schmitz
> <Christoph.Schmitz@1und1.de> wrote:
> > Still, I have two questions: Shouldn't there be an automatic limit of mapred.submit.replication
to the number > of data nodes? And more generally, should I worry about this warning?
> 
> 1> That'd somehow bind MR to HDFS more tightly. Besides, your HDFS
> won't attack busy nodes for job jar writes/etc forms of replication.
> if they report themselves as busy (loaded) or unavailable. The idea
> sounds good though, please file a JIRA for this?

Ok, will do! Thank for the help,

Christoph


Mime
View raw message