hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Konstantin Shvachko (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-1596) TestSymLink is failing
Date Thu, 12 Jul 2007 01:59:04 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-1596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511928

Konstantin Shvachko commented on HADOOP-1596:

This is the result of changing job id  	 HADOOP-1473
The initial exception in TestSymLink is hard to find but it actually is this:

java.lang.NumberFormatException: For input string: "m"
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
	at java.lang.Integer.parseInt(Integer.java:447)
	at java.lang.Integer.parseInt(Integer.java:497)
	at org.apache.hadoop.streaming.StreamUtil.getTaskInfo(StreamUtil.java:451)
	at org.apache.hadoop.streaming.PipeMapRed.setStreamJobDetails(PipeMapRed.java:190)
	at org.apache.hadoop.streaming.PipeMapRed.configure(PipeMapRed.java:132)
	at org.apache.hadoop.streaming.PipeMapper.configure(PipeMapper.java:61)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
	at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:32)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:185)
	at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1763)

After that the task remains not configured. And we see other exceptions NPE or "File does
not exist".
So the problem is that streaming was not changed to correctly parse new task ids.

A more general problem with streaming is that it just dumps exceptions into stderr and proceeds
like nothing happened.

> TestSymLink is failing
> ----------------------
>                 Key: HADOOP-1596
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1596
>             Project: Hadoop
>          Issue Type: Bug
>          Components: contrib/streaming
>            Reporter: Doug Cutting
>            Priority: Blocker
>             Fix For: 0.14.0
> TestSymLink started failing sometime today.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message