hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "sam rash (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-5608) NullPointerException when retrieving task reports
Date Wed, 01 Apr 2009 17:48:13 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12694639#action_12694639
] 

sam rash commented on HADOOP-5608:
----------------------------------

code that brought about this bug;  hangs on one particular job in the loop to get map task
reports.

{code}
log.info("start: querying hadoop job tracker %s", conf.get("mapred.job.tracker"));

for (JobStatus jobStatus : jobClient.getAllJobs()) {
    List<MapTaskProfile> mapTaskProfileList = new ArrayList<MapTaskProfile>();
    for (TaskReport taskReport : jobClient.getMapTaskReports(jobStatus.getJobID())) {
        mapTaskProfileList.add(new MapTaskProfile(taskReport, jobStatus.getJobID().toString()));
    }

	List<ReduceTaskProfile> reduceTaskProfileList = new ArrayList<ReduceTaskProfile>();
	for (TaskReport taskReport : jobClient.getReduceTaskReports(jobStatus.getJobID())) {
		reduceTaskProfileList.add(new ReduceTaskProfile(taskReport, jobStatus.getJobID().toString()));
	}

	RunningJob runningJob = jobClient.getJob(jobStatus.getJobID());
	if (runningJob != null) {
		eventList.add(new JobProfileEvent(eventBatchId.get(), new DateTime(),
			new JobProfile(jobStatus, runningJob.getJobName(), mapTaskProfileList, reduceTaskProfileList,
runningJob.getCounters()))
		);
	}
}

log.info("end: querying hadoop job tracker %s", conf.get("mapred.job.tracker"));
{code}


if i try to view the info of this job from the jobtracker gui, i also get a 500 and the logs
show the same NPE

2009-04-01 17:40:06,400 WARN /: /jobdetails.jsp?jobid=job_200902281847_18859&refresh=0:

java.lang.NullPointerException



> NullPointerException when retrieving task reports
> -------------------------------------------------
>
>                 Key: HADOOP-5608
>                 URL: https://issues.apache.org/jira/browse/HADOOP-5608
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.19.0
>            Reporter: sam rash
>
> It appears as thought Counters is null for a given task which causes an NPE in the logs
(and clients to hang)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message