hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Laurent Hatier <laurent.hat...@gmail.com>
Subject Re: cleanup task doesn't run always
Date Thu, 09 Jun 2011 08:03:22 GMT
Have you try to restart your hadoop node ? (or all hadoop node). When you go
to restart, the namenode go to format the directory that you have choosen

2011/6/8 Pedro Costa <psdc1978@gmail.com>

> Hi,
>
> After I run the command "bin/hadoop job -history /temp/history/", I've
> got these 2 task summary. In one of them, it run a cleanup task and in
> the other hasn't run the cleanup task. This means that a cleanup task
> doesn't run always. So, when a cleanup task should run?
>
> Task Summary
> ============================
> Kind    Total   Successful      Failed  Killed  StartTime       FinishTime
>
> Setup   1       1               0       0       8-Jun-2011 15:54:50
>  8-Jun-2011 15:54:51 (0sec)
> Map     600     600             0       0       8-Jun-2011 15:54:54
>  8-Jun-2011 15:57:05 (2mins, 11sec)
> Reduce  252     250             0       2       8-Jun-2011 15:55:06
>  8-Jun-2011 15:57:48 (2mins, 42sec)
> Cleanup 0       0               0       0
> ============================
>
>
>
> Task Summary
> ============================
> Kind    Total   Successful      Failed  Killed  StartTime       FinishTime
>
> Setup   1       1               0       0       8-Jun-2011 16:04:19
>  8-Jun-2011 16:04:20 (1sec)
> Map     500     383             0       117             8-Jun-2011 16:04:40
> Reduce  0       0               0       0
> Cleanup 1       1               0       0       8-Jun-2011 16:04:37
>  8-Jun-2011 16:04:38 (1sec)
> ============================
>
> Thanks,
>



-- 
Laurent HATIER
Étudiant en 2e année du Cycle Ingénieur à l'EISTI

Mime
View raw message