pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "fang fang chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIG-2405) svn tags/release-0.9.1: some unit test case failed with open JDK
Date Tue, 06 Nov 2012 06:46:13 GMT

    [ https://issues.apache.org/jira/browse/PIG-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13491253#comment-13491253
] 

fang fang chen commented on PIG-2405:
-------------------------------------

Hi Cheolsoo,

Thanks for your review.

- You are right, the sortLogMessages() method is sorting the output with some spacial order.
- Actually, I though about to fix by using reg. exp. as which is much more simpler. The reason
of not use it is we need to do the same steps to all related test cases(current 4 tests).
In future, if we need to add new tests, the same action would also be needed. 
- Besides, the reg. exp. will be too complex when there are too many items in [], like:
"Map key required for raw: $0->[cm_serve_id, cm_serve_timestamp_ms, p_url, source, type]"

So I insist the original fix. Do you agree? Please let me know if I miss anything. Thanks.
I regenerated the patch files by following "how to contribute" steps, and attach them at "Attachments".
Could you please tell what is "RB"? Please help load them to RB and let me know if modifications
are needed. Thanks

                
> svn tags/release-0.9.1: some unit test case failed with open JDK
> ----------------------------------------------------------------
>
>                 Key: PIG-2405
>                 URL: https://issues.apache.org/jira/browse/PIG-2405
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.1
>         Environment: ant-1.8.2
> open jdk: 1.6
>            Reporter: fang fang chen
>            Assignee: fang fang chen
>         Attachments: PIG-2405-0.11.patch, PIG-2405-trunk.patch
>
>
>     [junit] Test org.apache.pig.test.TestDataModel FAILED
> Testcase: testTupleToString took 0.004 sec
>         FAILED
> toString expected:<...ad a little lamb)},[[hello#world,goodbye#all]],42,5000000000,3.14...>
but was:<...ad a little lamb)},[[goodbye#all,hello#world]],42,5000000000,3.14...>
> junit.framework.ComparisonFailure: toString expected:<...ad a little lamb)},[[hello#world,goodbye#all]],42,5000000000,3.14...>
but was:<...ad a little lamb)},[[goodbye#all,hello#world]],42,5000000000,3.14...>
>          at org.apache.pig.test.TestDataModel.testTupleToString(TestDataModel.java:269
>     [junit] Test org.apache.pig.test.TestHBaseStorage FAILED
> Tests run: 18, Failures: 0, Errors: 12, Time elapsed: 188.612 sec
> Testcase: testHeterogeneousScans took 0.018 sec
>         Caused an ERROR
> java.io.FileNotFoundException: /root/pigtest/conf/hadoop-site.xml (Too many open files)
> java.lang.RuntimeException: java.io.FileNotFoundException: /root/pigtest/conf/hadoop-site.xml
(Too many open files)
>         at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1162)
>         at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1035)
>         at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:980)
>         at org.apache.hadoop.conf.Configuration.get(Configuration.java:436)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:271)
>         at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:155)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:167)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:130)
>         at org.apache.pig.test.TestHBaseStorage.prepareTable(TestHBaseStorage.java:809)
>         at org.apache.pig.test.TestHBaseStorage.testHeterogeneousScans(TestHBaseStorage.java:741)
> Caused by: java.io.FileNotFoundException: /root/pigtest/conf/hadoop-site.xml (Too many
open files)
>         at java.io.FileInputStream.<init>(FileInputStream.java:112)
>         at java.io.FileInputStream.<init>(FileInputStream.java:72)
>         at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:70)
>         at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:161)
>         at org.apache.xerces.impl.XMLEntityManager.setupCurrentEntity(Unknown Source)
>         at org.apache.xerces.impl.XMLVersionDetector.determineDocVersion(Unknown Source)
>         at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
>         at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source)
>         at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
>         at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
>         at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
>         at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
>         at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1079)
>         Caused an ERROR
> Could not resolve the DNS name of hostname:39611
> java.lang.IllegalArgumentException: Could not resolve the DNS name of hostname:39611
>         at org.apache.hadoop.hbase.HServerAddress.checkBindAddressCanBeResolved(HServerAddress.java:105)
>         at org.apache.hadoop.hbase.HServerAddress.<init>(HServerAddress.java:66)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:755)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:590)
>         at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:555)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:171)
>         at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:145)
>         at org.apache.pig.test.TestHBaseStorage.deleteAllRows(TestHBaseStorage.java:120)
>         at org.apache.pig.test.TestHBaseStorage.tearDown(TestHBaseStorage.java:112)
>     [junit] Test org.apache.pig.test.TestMRCompiler FAILED
> Testcase: testSortUDF1 took 0.045 sec
>         FAILED
> null expected:<...---MapReduce(20,SUM,[COUNT,TestMRCompiler$WeirdComparator]) - -18:
>         |  ...> but was:<...---MapReduce(20,SUM,[TestMRCompiler$WeirdComparator,COUNT])
- -18:
>         |  ...>
> junit.framework.ComparisonFailure: null expected:<...---MapReduce(20,SUM,[COUNT,TestMRCompiler$WeirdComparator])
- -18:
>         |  ...> but was:<...---MapReduce(20,SUM,[TestMRCompiler$WeirdComparator,COUNT])
- -18:
>         |  ...>
>         at org.apache.pig.test.TestMRCompiler.run(TestMRCompiler.java:1080)
>         at org.apache.pig.test.TestMRCompiler.testSortUDF1(TestMRCompiler.java:791
>     [junit] Test org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor FAILED
> (1)
> Testcase: testSimplePlan took 0.675 sec
>         FAILED
> expected:<class org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject>
but was:<class org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression>
> junit.framework.AssertionFailedError: expected:<class org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject>
but was:<class org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression>
>         at org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor.testSimplePlan(TestNewPlanLogToPhyTranslationVisitor.java:127)
> (2)
> Testcase: testJoinPlan took 0.064 sec
>         FAILED
> expected:<0> but was:<1>
> junit.framework.AssertionFailedError: expected:<0> but was:<1>
>         at org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor.testJoinPlan(TestNewPlanLogToPhyTranslationVisitor.java:158)
> (3)
> Testcase: testMultiStore took 0.041 sec
>         FAILED
> expected:<0> but was:<1>
> junit.framework.AssertionFailedError: expected:<0> but was:<1>
>         at org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor.testMultiStore(TestNewPlanLogToPhyTranslationVisitor.java:239)
>     [junit] Test org.apache.pig.test.TestPruneColumn FAILED
> (1)
> Testcase: testMapKey2 took 7.1 sec
>         FAILED
> null
> junit.framework.AssertionFailedError: null
>         at org.apache.pig.test.TestPruneColumn.testMapKey2(TestPruneColumn.java:1206)
> (2)
> Testcase: testMapKey3 took 7.088 sec
>         FAILED
> null
> junit.framework.AssertionFailedError: null
>         at org.apache.pig.test.TestPruneColumn.testMapKey3(TestPruneColumn.java:1222)
> (3)
> Testcase: testMapKeyInSplit1 took 7.1 sec
>         FAILED
> null
> junit.framework.AssertionFailedError: null
>         at org.apache.pig.test.TestPruneColumn.testMapKeyInSplit1(TestPruneColumn.java:1296)
> (4)
> Testcase: testSharedSchemaObject took 7.1 sec
>         FAILED
> null
> junit.framework.AssertionFailedError: null
>         at org.apache.pig.test.TestPruneColumn.testSharedSchemaObject(TestPruneColumn.java:1619)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message