hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rekha Joshi <rekha...@yahoo-inc.com>
Subject Re: Repeated attempts to kill old job?
Date Tue, 02 Feb 2010 04:29:28 GMT
I would say restart the cluster, but suspect that would not help either - instead try checking
up your running process list (eg: perl/shell script or a ETL pipeline job) to analyze/kill.
Also wondering if any hadoop -dfsadmin commands can supersede this scenario..


On 2/2/10 2:50 AM, "Meng Mao" <mengmao@gmail.com> wrote:

On our worker nodes, I see repeated requests for KillJobActions for the same
old job:
2010-01-31 00:00:01,024 INFO org.apache.hadoop.mapred.TaskTracker: Received
'KillJobAction' for job: job_201001261532_0690
2010-01-31 00:00:01,064 WARN org.apache.hadoop.mapred.TaskTracker: Unknown
job job_201001261532_0690 being deleted.

This request and response is repeated almost 30k times over the course of
the day. Other nodes have the same behavior, except with different job ids.
The jobs presumably all ran in the past, to completion or got killed
manually. We use the grid fairly actively and that job is several hundred
increments old.

Has anyone seen this before? Is there a way to stop it?

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message