hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alejandro Abdelnur (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-3427) streaming tests fail with MR2
Date Fri, 18 Nov 2011 04:41:51 GMT
streaming tests fail with MR2

                 Key: MAPREDUCE-3427
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3427
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: contrib/streaming, mrv2
    Affects Versions: 0.24.0, 0.23.1
            Reporter: Alejandro Abdelnur
            Priority: Blocker
             Fix For: 0.24.0, 0.23.1

After Mavenizing streaming and getting its testcases to use the MiniMRCluster wrapper (MAPREDUCE-3169),
4 testcases fail to pass.

Following is an assessment of those failures. Note that the testcases have been tweaked only
to set the streaming JAR and yarn as the  framework.
(If these issues are unrelated we should create sub-tasks for each one of them).

*TestStreamingCombiner*, fails because returned counters don't match assertion. However, counters
printed in the test output indicate values that would satisfy the assertion. As Tom has indicated
it seems MR/YARN are not passing back counter information to the client API.

*TestStreamingBadRecords*, the job is failing with the following exception

Application application_1321575850006_0001 failed 1 times due to AM Container for 
appattempt_1321575850006_0001_000001 exited with  exitCode: 127 due to: 
.Failing this attempt.. Failing the application.

Difficult to troubleshoot because there are not task logs from Mini MR/YARN  run.

*TestStreamingStatus* fails in validateTaskStatus() in the following assertion

expected:<[before consuming input > sort]> but was:<[SUCCEEDED]>

*TestUlimit* fails with

org.junit.ComparisonFailure: output is wrong expected:<[786432]> but was:<[unlimited]>

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message