hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandro Simas <sandro.csi...@gmail.com>
Subject Re: A slave knows the other in hadoop?
Date Wed, 16 Feb 2011 18:42:22 GMT
and the others questions ?

why when i try to insert a node in cluster when a mapreduce runs the reduce
stay in the same value forever ?

11/02/16 15:33:52 INFO mapred.FileInputFormat: Total input paths to process
: 100
11/02/16 15:33:53 INFO mapred.JobClient: Running job: job_201102161502_0005
11/02/16 15:33:54 INFO mapred.JobClient:  map 0% reduce 0%
11/02/16 15:34:02 INFO mapred.JobClient:  map 1% reduce 0%
11/02/16 15:34:03 INFO mapred.JobClient:  map 7% reduce 0%
11/02/16 15:34:05 INFO mapred.JobClient:  map 9% reduce 0%
11/02/16 15:34:06 INFO mapred.JobClient:  map 16% reduce 0%
11/02/16 15:34:08 INFO mapred.JobClient:  map 18% reduce 0%
11/02/16 15:34:09 INFO mapred.JobClient:  map 24% reduce 0%
11/02/16 15:34:11 INFO mapred.JobClient:  map 26% reduce 0%
11/02/16 15:34:12 INFO mapred.JobClient:  map 31% reduce 3%
11/02/16 15:34:14 INFO mapred.JobClient:  map 33% reduce 3%
11/02/16 15:34:15 INFO mapred.JobClient:  map 39% reduce 3%
11/02/16 15:34:17 INFO mapred.JobClient:  map 41% reduce 3%
11/02/16 15:34:18 INFO mapred.JobClient:  map 47% reduce 3%
11/02/16 15:34:20 INFO mapred.JobClient:  map 49% reduce 3%
11/02/16 15:34:21 INFO mapred.JobClient:  map 55% reduce 7%
11/02/16 15:34:23 INFO mapred.JobClient:  map 57% reduce 7%
11/02/16 15:34:24 INFO mapred.JobClient:  map 63% reduce 7%
11/02/16 15:34:26 INFO mapred.JobClient:  map 65% reduce 7%
11/02/16 15:34:27 INFO mapred.JobClient:  map 71% reduce 13%
11/02/16 15:34:29 INFO mapred.JobClient:  map 73% reduce 13%
11/02/16 15:34:30 INFO mapred.JobClient:  map 79% reduce 13%
11/02/16 15:34:32 INFO mapred.JobClient:  map 81% reduce 13%
11/02/16 15:34:33 INFO mapred.JobClient:  map 87% reduce 13%
11/02/16 15:34:35 INFO mapred.JobClient:  map 89% reduce 13%
11/02/16 15:34:36 INFO mapred.JobClient:  map 95% reduce 17%
11/02/16 15:34:38 INFO mapred.JobClient:  map 97% reduce 17%
11/02/16 15:34:39 INFO mapred.JobClient:  map 100% reduce 17%
11/02/16 15:34:42 INFO mapred.JobClient:  map 100% reduce 23%
11/02/16 15:34:51 INFO mapred.JobClient:  map 100% reduce 24%

I think that is the Shuffling Phase.


On Wed, Feb 16, 2011 at 3:23 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> >> Need i put the public key of the first slave in authorized_keys of the
> second ?
>
> That is not needed.
>
> On Wed, Feb 16, 2011 at 10:19 AM, Sandro Simas <sandro.csimas@gmail.com
> >wrote:
>
> > This is a simple question, a slave know the other slave in Hadoop ?
> > Need i put the public key of the first slave in authorized_keys of the
> > second ?
> > In /etc/hosts file, i have to put all ips and names of cluster nodes?
> >  [image: JusBrasil - O maior acervo jurmdico da Internet Brasileira.] *
> > www.jusbrasil.com.br *   * Sandro Simas *
> > * Equipe JusBrasil *
> > * sandro@jusbrasil.com.br  *
> >  (71) 3389-5204 / (71) 9966-1020
> >
>
 [image: JusBrasil - O maior acervo jurmdico da Internet Brasileira.] *
www.jusbrasil.com.br *   * Sandro Simas *
* Equipe JusBrasil *
* sandro@jusbrasil.com.br  *
 (71) 3389-5204 / (71) 9966-1020

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message