hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject Build failed in Jenkins: Hadoop-Hdfs-trunk #2495
Date Sat, 31 Oct 2015 02:38:17 GMT
See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2495/changes>

Changes:

[aw] HADOOP-12133 Add schemas to Maven Assembly XMLs

[kihwal] MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs

[kihwal] Addendum to MAPREDUCE-6451

------------------------------------------
[...truncated 9917 lines...]
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:402)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:378)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:281)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.run(TestDFSStripedOutputStreamWithFailure.java:486)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.test6(TestDFSStripedOutputStreamWithFailure.java:495)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Caused by: java.io.IOException: Failed to get 6 nodes from namenode: blockGroupSize= 9, blocks.length=
5
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.allocateNewBlock(DFSStripedOutputStream.java:441)
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.writeChunk(DFSStripedOutputStream.java:482)
	at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunks(FSOutputSummer.java:217)
	at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:164)
	at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:145)
	at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:79)
	at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:48)
	at java.io.DataOutputStream.write(DataOutputStream.java:88)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:400)
	... 13 more

  TestSaslDataTransfer.testAuthentication:80->doTest:185 expected:<3> but was:<2>
  TestSaslDataTransfer.testPrivacy:100->doTest:185 expected:<3> but was:<2>
  TestSaslDataTransfer.testNoSaslAndSecurePortsIgnored:165->doTest:185 expected:<3>
but was:<2>
  TestSaslDataTransfer.testIntegrity:90->doTest:185 expected:<3> but was:<2>
  TestDFSStripedOutputStreamWithFailure190>TestDFSStripedOutputStreamWithFailure$TestBase.test0:489->TestDFSStripedOutputStreamWithFailure$TestBase.run:486
failed, dn=0, length=4128767java.lang.AssertionError: expected:<1003> but was:<1004>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.junit.Assert.assertEquals(Assert.java:542)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:362)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:281)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.run(TestDFSStripedOutputStreamWithFailure.java:486)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.test0(TestDFSStripedOutputStreamWithFailure.java:489)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)

  TestDFSStripedOutputStreamWithFailure100>TestDFSStripedOutputStreamWithFailure$TestBase.test0:489->TestDFSStripedOutputStreamWithFailure$TestBase.run:486
failed, dn=0, length=2162687java.io.IOException: Failed at i=4607
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:402)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:378)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.runTest(TestDFSStripedOutputStreamWithFailure.java:281)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.run(TestDFSStripedOutputStreamWithFailure.java:486)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure$TestBase.test0(TestDFSStripedOutputStreamWithFailure.java:489)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Caused by: java.io.IOException: Failed to get 6 nodes from namenode: blockGroupSize= 9, blocks.length=
5
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.allocateNewBlock(DFSStripedOutputStream.java:441)
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.writeChunk(DFSStripedOutputStream.java:482)
	at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunks(FSOutputSummer.java:217)
	at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:164)
	at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:145)
	at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:79)
	at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:48)
	at java.io.DataOutputStream.write(DataOutputStream.java:88)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.write(TestDFSStripedOutputStreamWithFailure.java:400)
	... 13 more

  TestReplication.testReplication:292->runReplication:259->checkFile:155 null
  TestReplication.testNoExtraReplicationWhenBlockReceivedIsLate:665 timed out while waiting
for no pending replication.
  TestDFSStripedOutputStreamWithFailure.testAddBlockWhenNoSufficientDataBlockNumOfNodes:238
Expected to find 'Failed to get 6 nodes from namenode: blockGroupSize= 9, blocks.length= 5'
but got unexpected exception:java.io.IOException: Failed to get 6 nodes from namenode: blockGroupSize=
9, blocks.length= 4
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.allocateNewBlock(DFSStripedOutputStream.java:441)
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.writeChunk(DFSStripedOutputStream.java:482)
	at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunks(FSOutputSummer.java:217)
	at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:164)
	at org.apache.hadoop.fs.FSOutputSummer.flushBuffer(FSOutputSummer.java:145)
	at org.apache.hadoop.hdfs.DFSStripedOutputStream.closeImpl(DFSStripedOutputStream.java:922)
	at org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:753)
	at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
	at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:101)
	at org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure.testAddBlockWhenNoSufficientDataBlockNumOfNodes(TestDFSStripedOutputStreamWithFailure.java:234)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)

  TestDFSStripedOutputStreamWithFailure.testBlockTokenExpired:199->runTest:362 expected:<1001>
but was:<1002>

Tests in error: 
  TestFSImageWithSnapshot.testSaveLoadImageWithAppending » IO Failed to replace ...
  TestFileTruncate.testTruncateFailure » IO Failed to replace a bad datanode on ...
  TestFileTruncate.testSnapshotWithAppendTruncate » IO Failed to replace a bad d...
  TestAddStripedBlocks.testAddStripedBlock:124->writeAndFlushStripedOutputStream:113 »
IO
  TestHAAppend.testMultipleAppendsDuringCatchupTailing » IO Failed to replace a ...
  TestAddBlock.testAddBlockUC » IO Failed to replace a bad datanode on the exist...
  TestDiskspaceQuotaUpdate.testUpdateQuotaForAppend » IO Failed to replace a bad...
  TestSnapshotDiffReport.testDiffReportWithRenameAndAppend » IO Failed to replac...
  TestFsck.testUnderMinReplicatedBlock » Remote File /testUnderMinReplicatedBloc...
  TestFsck.testECFsck:1768 » IO Failed to get 6 nodes from namenode: blockGroupS...
  TestDiskError.testShutdown:110 » Timeout Timed out waiting for /test.txt1 to r...
  TestDatanodeRestart.testFinalizedReplicas:67 » Timeout Timed out waiting for /...
  TestDataNodeHotSwapVolumes.testDirectlyReloadAfterCheckDiskError:740->createFile:140->createFile:156
» 
  TestDataNodeHotSwapVolumes.testReplicatingAfterRemoveVolume:484->waitReplication:192
Timeout
  TestDataNodeVolumeFailureReporting.testSuccessiveVolumeFailures » Remote File ...
  TestDataNodeVolumeFailureReporting.testMultipleVolFailuresOnNode » Remote File...
  TestDataNodeVolumeFailureReporting.testDataNodeReconfigureWithVolumeFailures » Remote
  TestDataNodeVolumeFailureReporting.testVolFailureStatsPreservedOnNNRestart » Remote
  TestNodeCount.testNodeCount:130->checkTimeout:146->checkTimeout:152 Timeout Ti...
  TestRBWBlockInvalidation.testRWRInvalidation » IO All datanodes [DatanodeInfoW...
  TestBlockTokenWithDFSStriped.testEnd2End:89 » IO Failed to get 6 nodes from na...
  TestBlockTokenWithDFSStriped.testRead:62->TestBlockTokenWithDFS.doTestRead:407->isBlockTokenExpired:109->TestBlockTokenWithDFS.isBlockTokenExpired:628
» NullPointer
  TestUnderReplicatedBlocks.testNumberOfBlocksToBeReplicated:122 » Timeout Timed...
  TestOverReplicatedBlocks.testChooseReplicaToDelete:166 » Timeout Timed out wai...
  TestBalancer.testBalancerWithStripedFile:1713->doTestBalancerWithStripedFile:1746 »
IO
  TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks1:69->readFileWithMissingBlocks:104
» Timeout
  TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks2:74->readFileWithMissingBlocks:104
» Timeout
  TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks3:79->readFileWithMissingBlocks:104
» Timeout
  TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks4:84->readFileWithMissingBlocks:104
» Timeout
  TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks5:89->readFileWithMissingBlocks:104
» Timeout
  TestReadStripedFileWithMissingBlocks.testReadFileWithMissingBlocks6:94->readFileWithMissingBlocks:104
» Timeout
  TestReadStripedFileWithDecoding.testReadCorruptedDataByDeleting:136->testReadWithBlockCorrupted:320->verifyRead:161
» IO
  TestReadStripedFileWithDecoding.testReadCorruptedData:119->testReadWithBlockCorrupted:320->verifyRead:161
» IO
  TestGetFileChecksum.testGetFileChecksum » IO Failed to replace a bad datanode ...
  TestDFSStripedOutputStream.testFileSmallerThanOneCell1:80->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileSmallerThanOneCell2:85->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileMoreThanOneStripe1:110->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileMoreThanOneStripe2:115->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileEqualsWithOneCell:90->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileSmallerThanOneStripe2:100->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileMoreThanABlockGroup1:132->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileMoreThanABlockGroup2:137->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileMoreThanABlockGroup3:144->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileEqualsWithOneStripe:105->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileFullBlockGroup:127->testOneFile:155 » Timeout
  TestDFSStripedOutputStream.testFileLessThanFullBlockGroup:121->testOneFile:155 » Timeout
  TestQuota.testBlockAllocationAdjustsUsageConservatively:890 » Timeout Timed ou...
  TestSafeModeWithStripedFile.testStripedFile0:72->doTest:94 » IO Failed to get ...
  TestSafeModeWithStripedFile.testStripedFile1:77->doTest:102 » IO Failed to get...
  TestClientProtocolForPipelineRecovery.testPipelineRecoveryOnRestartFailure » IO
  TestClientProtocolForPipelineRecovery.testPacketTransmissionDelay:211 IO The f...
  TestFileCreation.testFsCloseAfterClusterShutdown » Remote File /TestFileCreati...
  TestDecommission.testPendingNodes:1111 » IO Unable to close file because the l...
  TestInjectionForSimulatedStorage.testInjection:139->waitForBlockReplication:88 IO
  TestCrcCorruption.testCrcCorruption:306->thistest:163 » Timeout Timed out wait...
  TestPipelines.pipeline_01 » IO Failed to replace a bad datanode on the existin...
  TestDFSStripedOutputStreamWithFailure.testAddBlockWhenNoSufficientParityNumOfNodes:267 »
IO
  TestDFSStripedOutputStreamWithFailure.testMultipleDatanodeFailure56:172->runTestWithMultipleFailure:301->runTest:378->write:402
IO

Tests run: 4051, Failures: 84, Errors: 58, Skipped: 17

[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS Native Client
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HttpFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS BookKeeper Journal
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Skipping Apache Hadoop HDFS-NFS
[INFO] This project has been banned from the build due to previous failures.
[INFO] ------------------------------------------------------------------------
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project ---
[INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target>
[INFO] 
[INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project ---
[INFO] Executing tasks

main:
    [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir>
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project
---
[INFO] 
[INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project
---
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project
---
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project ---
[INFO] Skipping javadoc generation
[INFO] 
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project ---
[INFO] 
[INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project ---
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:56 min]
[INFO] Apache Hadoop HDFS ................................ FAILURE [  04:09 h]
[INFO] Apache Hadoop HDFS Native Client .................. SKIPPED
[INFO] Apache Hadoop HttpFS .............................. SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED
[INFO] Apache Hadoop HDFS Project ........................ SUCCESS [  0.063 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 04:13 h
[INFO] Finished at: 2015-10-31T02:38:00+00:00
[INFO] Final Memory: 56M/820M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test)
on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: The forked VM terminated
without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs>
&& /home/jenkins/tools/java/jdk1.7.0_55/jre/bin/java -Xmx2048m -XX:MaxPermSize=768m
-XX:+HeapDumpOnOutOfMemoryError -jar <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefirebooter655233396700767063.jar>
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire82766303222843983tmp>
<https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire_5115938295673090344860tmp>
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following
articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hadoop-hdfs
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Updating HADOOP-12133
Updating MAPREDUCE-6451

Mime
View raw message