hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amar Kamat (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-2403) JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory
Date Wed, 30 Jul 2008 14:21:32 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amar Kamat updated HADOOP-2403:
-------------------------------

    Attachment: EncodeDecode.java

Attaching a sample encode/decode implementation

_Data in code_  :
{code}
 StringBuffer line = new StringBuffer();
  line.append("I m happy");
  line.append('\n');
  line.append("me 2");
  line.append('\n');
  line.append("`1234567890-=qwertyuiop[]\\asdfghjkl;'zxcvbnm,./~!@#$%^&*()_+QWERTYUIOP{}|ASDFGHJKL:\"'ZXCVBNM<>?\r\t\b\n\f");
{code}
_Data on screen_ :
Data : 
{code}
I m happy
me 2
`1234567890-=qwertyuiop[]\asdfghjkl;'zxcvbnm,./~!@#$%^&*()_+QWERTYUIOP{}|ASDFGHJKL:"'ZXCVBNM<>?


{code}
------------------------------------
Code : 
{code}
73-32-109-32-104-97-112-112-121-10-109-101-32-50-10-96-49-50-51-52-53-54-55-56-57-48-45-61-113-119-101-114-116-121-117-105-111-112-91-93-92-97-115-100-102-103-104-106-107-108-59-39-122-120-99-118-98-110-109-44-46-47-126-33-64-35-36-37-94-38-42-40-41-95-43-81-87-69-82-84-89-85-73-79-80-123-125-124-65-83-68-70-71-72-74-75-76-58-34-39-90-88-67-86-66-78-77-60-62-63-13-9-8-10-12-
{code}
------------------------------------
Decoded :
{code}
I m happy
me 2
`1234567890-=qwertyuiop[]\asdfghjkl;'zxcvbnm,./~!@#$%^&*()_+QWERTYUIOP{}|ASDFGHJKL:"'ZXCVBNM<>?


{code}

> JobHistory log files contain data that cannot be parsed by org.apache.hadoop.mapred.JobHistory
> ----------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-2403
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2403
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Runping Qi
>            Priority: Critical
>         Attachments: EncodeDecode.java
>
>
> When some tasks failed, the job tracker writes an line to the history file with error
message.
> However, the error message may mess up with the history file format, choking the history
parser. Here is an example:
> MapAttempt TASK_TYPE="MAP" TASKID="tip_200712102254_0001_m_000090" TASK_ATTEMPT_ID="task_200712102254_0001_m_000090_0"
TASK_STATUS="FAILED" FINISH_TIME="1197327293253" HOSTNAME="XXXX:50050" ERROR="java.lang.IllegalArgumentException:
Trouble to get key or value (<,> substituted by null 
> . Key XML-Ori:
>         <Root>

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message