hadoop-hdfs-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Hudson Server <hud...@hudson.apache.org>
Subject Hadoop-Hdfs-trunk - Build # 547 - Still Failing
Date Sun, 09 Jan 2011 16:03:55 GMT
See https://hudson.apache.org/hudson/job/Hadoop-Hdfs-trunk/547/

###################################################################################
########################## LAST 60 LINES OF THE CONSOLE ###########################
[...truncated 473004 lines...]
    [junit] 2011-01-09 12:04:09,262 INFO  mortbay.log (?:invoke0(?)) - Started SelectChannelConnector@localhost:47240
    [junit] 2011-01-09 12:04:09,262 INFO  namenode.NameNode (NameNode.java:run(523)) - NameNode
Web-server up at: localhost/127.0.0.1:47240
    [junit] 2011-01-09 12:04:09,263 INFO  ipc.Server (Server.java:run(608)) - IPC Server Responder:
starting
    [junit] 2011-01-09 12:04:09,263 INFO  ipc.Server (Server.java:run(443)) - IPC Server listener
on 44994: starting
    [junit] 2011-01-09 12:04:09,264 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 0 on 44994: starting
    [junit] 2011-01-09 12:04:09,264 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 2 on 44994: starting
    [junit] 2011-01-09 12:04:09,264 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 1 on 44994: starting
    [junit] 2011-01-09 12:04:09,264 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 4 on 44994: starting
    [junit] 2011-01-09 12:04:09,264 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 3 on 44994: starting
    [junit] 2011-01-09 12:04:09,264 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 5 on 44994: starting
    [junit] 2011-01-09 12:04:09,265 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 6 on 44994: starting
    [junit] 2011-01-09 12:04:09,265 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 8 on 44994: starting
    [junit] 2011-01-09 12:04:09,265 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 7 on 44994: starting
    [junit] 2011-01-09 12:04:09,265 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 9 on 44994: starting
    [junit] 2011-01-09 12:04:09,266 INFO  namenode.NameNode (NameNode.java:initialize(390))
- NameNode up at: localhost/127.0.0.1:44994
    [junit] Starting DataNode 0 with dfs.datanode.data.dir: file:/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data1/,file:/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data2/
    [junit] 2011-01-09 12:04:09,434 INFO  datanode.DataNode (DataNode.java:initDataXceiver(472))
- Opened info server at 54360
    [junit] 2011-01-09 12:04:09,438 INFO  datanode.DataNode (DataXceiverServer.java:<init>(77))
- Balancing bandwith is 1048576 bytes/s
    [junit] 2011-01-09 12:04:09,444 INFO  common.Storage (DataStorage.java:recoverTransitionRead(127))
- Storage directory /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data1
is not formatted.
    [junit] 2011-01-09 12:04:09,445 INFO  common.Storage (DataStorage.java:recoverTransitionRead(128))
- Formatting ...
    [junit] 2011-01-09 12:04:09,448 INFO  common.Storage (DataStorage.java:recoverTransitionRead(127))
- Storage directory /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data2
is not formatted.
    [junit] 2011-01-09 12:04:09,449 INFO  common.Storage (DataStorage.java:recoverTransitionRead(128))
- Formatting ...
    [junit] 2011-01-09 12:04:09,504 INFO  datanode.DataNode (FSDataset.java:registerMBean(1772))
- Registered FSDatasetStatusMBean
    [junit] 2011-01-09 12:04:09,511 INFO  datanode.DirectoryScanner (DirectoryScanner.java:<init>(149))
- scan starts at 1294585621511 with interval 21600000
    [junit] 2011-01-09 12:04:09,513 INFO  http.HttpServer (HttpServer.java:addGlobalFilter(409))
- Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
    [junit] 2011-01-09 12:04:09,517 INFO  http.HttpServer (HttpServer.java:start(579)) - Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener
on 0
    [junit] 2011-01-09 12:04:09,517 INFO  http.HttpServer (HttpServer.java:start(584)) - listener.getLocalPort()
returned 44401 webServer.getConnectors()[0].getLocalPort() returned 44401
    [junit] 2011-01-09 12:04:09,518 INFO  http.HttpServer (HttpServer.java:start(617)) - Jetty
bound to port 44401
    [junit] 2011-01-09 12:04:09,518 INFO  mortbay.log (?:invoke0(?)) - jetty-6.1.14
    [junit] 2011-01-09 12:04:09,664 INFO  mortbay.log (?:invoke0(?)) - Started SelectChannelConnector@localhost:44401
    [junit] 2011-01-09 12:04:09,666 INFO  jvm.JvmMetrics (JvmMetrics.java:init(71)) - Cannot
initialize JVM Metrics with processName=DataNode, sessionId=null - already initialized
    [junit] 2011-01-09 12:04:09,670 INFO  ipc.Server (Server.java:run(338)) - Starting SocketReader
    [junit] 2011-01-09 12:04:09,670 INFO  metrics.RpcMetrics (RpcMetrics.java:<init>(63))
- Initializing RPC Metrics with hostName=DataNode, port=58842
    [junit] 2011-01-09 12:04:09,671 INFO  metrics.RpcDetailedMetrics (RpcDetailedMetrics.java:<init>(57))
- Initializing RPC Metrics with hostName=DataNode, port=58842
    [junit] 2011-01-09 12:04:09,672 INFO  datanode.DataNode (DataNode.java:initIpcServer(432))
- dnRegistration = DatanodeRegistration(h9.grid.sp2.yahoo.net:54360, storageID=, infoPort=44401,
ipcPort=58842)
    [junit] 2011-01-09 12:04:09,677 INFO  hdfs.StateChange (FSNamesystem.java:registerDatanode(2514))
- BLOCK* NameSystem.registerDatanode: node registration from 127.0.0.1:54360 storage DS-1090277604-127.0.1.1-54360-1294574649675
    [junit] 2011-01-09 12:04:09,682 INFO  net.NetworkTopology (NetworkTopology.java:add(331))
- Adding a new node: /default-rack/127.0.0.1:54360
    [junit] 2011-01-09 12:04:09,687 INFO  datanode.DataNode (DataNode.java:register(714))
- New storage id DS-1090277604-127.0.1.1-54360-1294574649675 is assigned to data-node 127.0.0.1:54360
    [junit] 2011-01-09 12:04:09,688 INFO  datanode.DataNode (DataNode.java:run(1438)) - DatanodeRegistration(127.0.0.1:54360,
storageID=DS-1090277604-127.0.1.1-54360-1294574649675, infoPort=44401, ipcPort=58842)In DataNode.run,
data = FSDataset{dirpath='/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data1/current/finalized,/grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/data/data2/current/finalized'}
    [junit] 2011-01-09 12:04:09,688 INFO  ipc.Server (Server.java:run(608)) - IPC Server Responder:
starting
    [junit] 2011-01-09 12:04:09,689 INFO  ipc.Server (Server.java:run(443)) - IPC Server listener
on 58842: starting
    [junit] 2011-01-09 12:04:09,689 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 0 on 58842: starting
    [junit] 2011-01-09 12:04:09,689 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 1 on 58842: starting
    [junit] 2011-01-09 12:04:09,690 INFO  datanode.DataNode (DataNode.java:offerService(904))
- using BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec
    [junit] 2011-01-09 12:04:09,690 INFO  ipc.Server (Server.java:run(1369)) - IPC Server
handler 2 on 58842: starting
    [junit] 2011-01-09 12:04:09,702 INFO  datanode.DataNode (DataNode.java:blockReport(1143))
- BlockReport of 0 blocks got processed in 8 msecs
    [junit] 2011-01-09 12:04:09,702 INFO  datanode.DataNode (DataNode.java:offerService(946))
- Starting Periodic block scanner.
    [junit] 2011-01-09 12:04:09,767 INFO  FSNamesystem.audit (FSNamesystem.java:logAuditEvent(148))
- ugi=hudson	ip=/127.0.0.1	cmd=create	src=/testWriteConf.xml	dst=null	perm=hudson:supergroup:rw-r--r--
    [junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 60.074 sec
Build timed out. Aborting
[FINDBUGS] Skipping publisher since build result is FAILURE
Publishing Javadoc
Archiving artifacts
Recording test results
Recording fingerprints
Publishing Clover coverage report...
No Clover report will be published due to a Build Failure
Email was triggered for: Failure
Sending email for trigger: Failure



###################################################################################
############################## FAILED TESTS (if any) ##############################
5 tests failed.
FAILED:  org.apache.hadoop.hdfs.TestFileConcurrentReader.testUnfinishedBlockCRCErrorTransferToVerySmallWrite

Error Message:
Too many open files

Stack Trace:
java.io.IOException: Too many open files
	at sun.nio.ch.IOUtil.initPipe(Native Method)
	at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:49)
	at sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:18)
	at java.nio.channels.Selector.open(Selector.java:209)
	at org.apache.hadoop.ipc.Server$Responder.<init>(Server.java:602)
	at org.apache.hadoop.ipc.Server.<init>(Server.java:1511)
	at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:408)
	at org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:332)
	at org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:292)
	at org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:47)
	at org.apache.hadoop.ipc.RPC.getServer(RPC.java:382)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.initIpcServer(DataNode.java:421)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:512)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:282)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:264)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1575)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1518)
	at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1485)
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:630)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:464)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:186)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:71)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:178)
	at org.apache.hadoop.hdfs.TestFileConcurrentReader.init(TestFileConcurrentReader.java:88)
	at org.apache.hadoop.hdfs.TestFileConcurrentReader.setUp(TestFileConcurrentReader.java:73)


FAILED:  org.apache.hadoop.hdfs.TestFileConcurrentReader.testUnfinishedBlockCRCErrorNormalTransfer

Error Message:
Cannot lock storage /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/name1.
The directory is already locked.

Stack Trace:
java.io.IOException: Cannot lock storage /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/name1.
The directory is already locked.
	at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:615)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:1342)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:1360)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1408)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:202)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:451)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:186)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:71)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:178)
	at org.apache.hadoop.hdfs.TestFileConcurrentReader.init(TestFileConcurrentReader.java:88)
	at org.apache.hadoop.hdfs.TestFileConcurrentReader.setUp(TestFileConcurrentReader.java:73)


FAILED:  org.apache.hadoop.hdfs.TestFileConcurrentReader.testUnfinishedBlockCRCErrorNormalTransferVerySmallWrite

Error Message:
Cannot lock storage /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/name1.
The directory is already locked.

Stack Trace:
java.io.IOException: Cannot lock storage /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/name1.
The directory is already locked.
	at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.lock(Storage.java:615)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:1342)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:1360)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1408)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:202)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:451)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:186)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:71)
	at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:178)
	at org.apache.hadoop.hdfs.TestFileConcurrentReader.init(TestFileConcurrentReader.java:88)
	at org.apache.hadoop.hdfs.TestFileConcurrentReader.setUp(TestFileConcurrentReader.java:73)


FAILED:  org.apache.hadoop.hdfs.TestWriteConfigurationToDFS.testWriteConf

Error Message:
test timed out after 60000 milliseconds

Stack Trace:
java.lang.Exception: test timed out after 60000 milliseconds
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:485)
	at org.apache.hadoop.hdfs.DFSOutputStream.waitAndQueueCurrentPacket(DFSOutputStream.java:1169)
	at org.apache.hadoop.hdfs.DFSOutputStream.writeChunk(DFSOutputStream.java:1228)
	at org.apache.hadoop.fs.FSOutputSummer.writeChecksumChunk(FSOutputSummer.java:161)
	at org.apache.hadoop.fs.FSOutputSummer.write1(FSOutputSummer.java:104)
	at org.apache.hadoop.fs.FSOutputSummer.write(FSOutputSummer.java:90)
	at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:54)
	at java.io.DataOutputStream.write(DataOutputStream.java:90)
	at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202)
	at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:263)
	at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:106)
	at java.io.OutputStreamWriter.write(OutputStreamWriter.java:190)
	at com.sun.org.apache.xml.internal.serializer.ToStream.characters(ToStream.java:1499)
	at com.sun.org.apache.xml.internal.serializer.ToUnknownStream.characters(ToUnknownStream.java:789)
	at com.sun.org.apache.xml.internal.serializer.ToUnknownStream.characters(ToUnknownStream.java:323)
	at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:240)
	at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:226)
	at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:226)
	at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:226)
	at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:132)
	at com.sun.org.apache.xalan.internal.xsltc.trax.DOM2TO.parse(DOM2TO.java:94)
	at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transformIdentity(TransformerImpl.java:662)
	at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:708)
	at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerImpl.transform(TransformerImpl.java:313)
	at org.apache.hadoop.conf.Configuration.writeXml(Configuration.java:1608)
	at org.apache.hadoop.conf.Configuration.writeXml(Configuration.java:1559)
	at org.apache.hadoop.hdfs.TestWriteConfigurationToDFS.__CLR3_0_28n7kbs1103(TestWriteConfigurationToDFS.java:46)
	at org.apache.hadoop.hdfs.TestWriteConfigurationToDFS.testWriteConf(TestWriteConfigurationToDFS.java:33)


FAILED:  org.apache.hadoop.hdfs.server.namenode.TestStorageRestore.testStorageRestore

Error Message:
Image file /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/secondary/current/fsimage
is corrupt with MD5 checksum of 6ae5155343687c34c267ad438a53a1d4 but expecting 560cb7ae846968145f1a6b1ec1f902df

Stack Trace:
java.io.IOException: Image file /grid/0/hudson/hudson-slave/workspace/Hadoop-Hdfs-trunk/trunk/build/test/data/dfs/secondary/current/fsimage
is corrupt with MD5 checksum of 6ae5155343687c34c267ad438a53a1d4 but expecting 560cb7ae846968145f1a6b1ec1f902df
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:1063)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.doMerge(SecondaryNameNode.java:702)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode$CheckpointStorage.access$500(SecondaryNameNode.java:600)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doMerge(SecondaryNameNode.java:477)
	at org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode.doCheckpoint(SecondaryNameNode.java:438)
	at org.apache.hadoop.hdfs.server.namenode.TestStorageRestore.__CLR3_0_2dn2tm4tka(TestStorageRestore.java:316)
	at org.apache.hadoop.hdfs.server.namenode.TestStorageRestore.testStorageRestore(TestStorageRestore.java:286)




Mime
View raw message