hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From praveenesh kumar <praveen...@gmail.com>
Subject Re: reducer not starting
Date Wed, 21 Nov 2012 12:00:58 GMT
Sometimes its network issue, reducers are not able to find hostnames or IPs
of the other machines. Make sure your /etc/hosts entries and hostnames are
correct.

Regards,
Praveenesh

On Tue, Nov 20, 2012 at 10:46 PM, Harsh J <harsh@cloudera.com> wrote:

> Your mappers are failing (possibly a user-side error or an
> environmental one) and are being reattempted by the framework (default
> behavior, attempts 4 times to avoid transient failure scenario).
>
> Visit your job's logs in the JobTracker web UI, to find more
> information on why your tasks fail.
>
> On Tue, Nov 20, 2012 at 10:22 PM, jamal sasha <jamalshasha@gmail.com>
> wrote:
> >
> >
> >
> > I am not sure whats happening, but I wrote a simple mapper and reducer
> > script.
> >
> >
> >
> > And I am testing it against a small dataset (like few lines long).
> >
> >
> >
> > For some reason reducer is just not starting.. and mapper is executing
> again
> > and again?
> >
> >
> >
> >     12/11/20 09:21:18 INFO streaming.StreamJob:  map 0%  reduce 0%
> >
> >     12/11/20 09:22:05 INFO streaming.StreamJob:  map 50%  reduce 0%
> >
> >     12/11/20 09:22:10 INFO streaming.StreamJob:  map 100%  reduce 0%
> >
> >     12/11/20 09:32:05 INFO streaming.StreamJob:  map 50%  reduce 0%
> >
> >     12/11/20 09:32:11 INFO streaming.StreamJob:  map 0%  reduce 0%
> >
> >     12/11/20 09:32:20 INFO streaming.StreamJob:  map 50%  reduce 0%
> >
> >     12/11/20 09:32:31 INFO streaming.StreamJob:  map 100%  reduce 0%
> >
> >     12/11/20 09:42:20 INFO streaming.StreamJob:  map 50%  reduce 0%
> >
> >     12/11/20 09:42:31 INFO streaming.StreamJob:  map 0%  reduce 0%
> >
> >     12/11/20 09:42:32 INFO streaming.StreamJob:  map 50%  reduce 0%
> >
> >     12/11/20 09:42:50 INFO streaming.StreamJob:  map 100%  reduce 0%
> >
> >
> >
> >
> >
> > Let me know if you want the code also.
> >
> > Any clues of where I am going wrong?
> >
> > Thanks
> >
> >
> >
> >
> >
> >
>
>
>
> --
> Harsh J
>

Mime
View raw message