hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1375) TestFileArgs fails intermittently
Date Fri, 12 Feb 2010 00:18:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832751#action_12832751
] 

Todd Lipcon commented on MAPREDUCE-1375:
----------------------------------------

I think I got this figured out. The issue is that the test actually tries to write some "roses
are red" text to ls's stdin. Very infrequently, the ls will actually complete before the data
can be flushed, so the task gets a "Broken pipe" exception - see MAPREDUCE-1481. I'm actually
unsure whether MAPREDUCE-1481 is a bug, but the easy fix for this test is to make the input
"" so no data gets written into ls's stdin.

I'm running the test in a loop with this fix now. If it keeps going for a couple hours without
failure I'll post a patch. (before, this loop would fail after about 10 minutes usually)

> TestFileArgs fails intermittently
> ---------------------------------
>
>                 Key: MAPREDUCE-1375
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1375
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>            Reporter: Amar Kamat
>            Assignee: Todd Lipcon
>             Fix For: 0.22.0
>
>         Attachments: TEST-org.apache.hadoop.streaming.TestFileArgs.txt
>
>
> TestFileArgs failed once for me with the following error
> {code}
> expected:<[job.jar
> sidefile
> tmp
> ]> but was:<[]>
> sidefile
> tmp
> ]> but was:<[]>
>         at org.apache.hadoop.streaming.TestStreaming.checkOutput(TestStreaming.java:107)
>         at org.apache.hadoop.streaming.TestStreaming.testCommandLine(TestStreaming.java:123)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message