hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andreas Kostyrka <andr...@kostyrka.org>
Subject Re: reducers hanging problem
Date Tue, 01 Jul 2008 08:46:02 GMT
On Tuesday 01 July 2008 02:00:00 Andreas Kostyrka wrote:
> On Monday 30 June 2008 18:38:28 Runping Qi wrote:
> > Looks like the reducer stuck at shuffling phase.
> > What is the progression percentage do you see for the reducer from web
> > GUI?
> >
> > It is known that 0.17 does not handle shuffling well.
>
> I think it has been 87% (meaning that 19 of 22 reducer tasks were
> finished). On a smaller job size, it hangs at 93%.
>
> That makes me curious, when will 0.18 be out? Or 0.17.1? Till now I always
> managed to run into problems far behind the curve that there was almost
> always a cure in form of an upgrade. Not knowing if running trunk is a good
> idea.

Well, in this case, restarting the hadoop java processes of the whole cluster 
seems to have cured it for the moment.

Andreas


Mime
View raw message