hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-5247) NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.
Date Thu, 19 Feb 2009 10:32:01 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amar Kamat updated HADOOP-5247:
-------------------------------

    Attachment: HADOOP-5247-v1.4.patch

Attaching a patch that does the following
- Sends "Kill-Job-Action" to all the trackers upon a job completion.
- RunningJob doesnt do any update if the job is completed. If RunningJob tries to get an update
for a job which is missing with the JobTracker then an exception is raised to inform that
the job no longer exists.
- trackerToJobsToCleanup is made a HashMap
- Locking is now fined grained. May be we should do the same for other methods like getTasksToKill().
I think the reason its done this way is to keep it simple as there is no need to make these
calls thread-safe.
- getJobsToKill now does Set<JobID> jobs = trackerToJobsToCleanup.remove(taskTracker)
- updateTaskStatuses() : Here its important to remove the attempt from the expiry queue irrespective
of the job and hence the first step is to remove the expiring task.
- The testcase is removed as the test has nothing to do with this issue

> NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set
to zero.
> ------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-5247
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5247
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Vinod K V
>            Assignee: Amar Kamat
>            Priority: Blocker
>             Fix For: 0.20.0
>
>         Attachments: HADOOP-5247-v1.1.patch, HADOOP-5247-v1.4.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message