hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Meng Mao <meng...@gmail.com>
Subject Re: Repeated attempts to kill old job?
Date Wed, 03 Feb 2010 00:55:24 GMT
We restarted the grid and that did kill the repeated KillJobAction attempts.
I forgot to look around with hadoop -dfsadmin, though.

On Mon, Feb 1, 2010 at 11:29 PM, Rekha Joshi <rekhajos@yahoo-inc.com> wrote:

> I would say restart the cluster, but suspect that would not help either -
> instead try checking up your running process list (eg: perl/shell script or
> a ETL pipeline job) to analyze/kill.
> Also wondering if any hadoop -dfsadmin commands can supersede this
> scenario..
>
> Cheers,
> /R
>
>
> On 2/2/10 2:50 AM, "Meng Mao" <mengmao@gmail.com> wrote:
>
> On our worker nodes, I see repeated requests for KillJobActions for the
> same
> old job:
> 2010-01-31 00:00:01,024 INFO org.apache.hadoop.mapred.TaskTracker: Received
> 'KillJobAction' for job: job_201001261532_0690
> 2010-01-31 00:00:01,064 WARN org.apache.hadoop.mapred.TaskTracker: Unknown
> job job_201001261532_0690 being deleted.
>
> This request and response is repeated almost 30k times over the course of
> the day. Other nodes have the same behavior, except with different job ids.
> The jobs presumably all ran in the past, to completion or got killed
> manually. We use the grid fairly actively and that job is several hundred
> increments old.
>
> Has anyone seen this before? Is there a way to stop it?
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message