hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hemanth Yamijala (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2403) JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory
Date Tue, 12 Aug 2008 09:16:44 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12621741#action_12621741
] 

Hemanth Yamijala commented on HADOOP-2403:
------------------------------------------

bq. We also need to make sure that the characters that are used as delimiter (., ", tab) should
not occur in a value

I guess what you mean is that they must be escaped. This is similar to what Amarsri has done,
but is asking that the escaping be done for all characters that have significance in job history.
+1 for that.

> JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory
> ----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-2403
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2403
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Runping Qi
>            Assignee: Amareshwari Sriramadasu
>            Priority: Critical
>             Fix For: 0.19.0
>
>         Attachments: EncodeDecode.java, patch-2403.txt
>
>
> When some tasks failed, the job tracker writes an line to the history file with error
message.
> However, the error message may mess up with the history file format, choking the history
parser. Here is an example:
> MapAttempt TASK_TYPE="MAP" TASKID="tip_200712102254_0001_m_000090" TASK_ATTEMPT_ID="task_200712102254_0001_m_000090_0"
TASK_STATUS="FAILED" FINISH_TIME="1197327293253" HOSTNAME="XXXX:50050" ERROR="java.lang.IllegalArgumentException:
Trouble to get key or value (<,> substituted by null 
> . Key XML-Ori:
>         <Root>

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message