Return-Path: X-Original-To: apmail-tajo-dev-archive@minotaur.apache.org Delivered-To: apmail-tajo-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C663F10E3B for ; Wed, 16 Oct 2013 11:22:11 +0000 (UTC) Received: (qmail 9761 invoked by uid 500); 16 Oct 2013 11:22:07 -0000 Delivered-To: apmail-tajo-dev-archive@tajo.apache.org Received: (qmail 9669 invoked by uid 500); 16 Oct 2013 11:22:06 -0000 Mailing-List: contact dev-help@tajo.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@tajo.incubator.apache.org Delivered-To: mailing list dev@tajo.incubator.apache.org Received: (qmail 9617 invoked by uid 99); 16 Oct 2013 11:22:04 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Oct 2013 11:22:04 +0000 X-ASF-Spam-Status: No, hits=-2000.5 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 16 Oct 2013 11:22:03 +0000 Received: (qmail 8277 invoked by uid 99); 16 Oct 2013 11:21:42 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 16 Oct 2013 11:21:42 +0000 Date: Wed, 16 Oct 2013 11:21:42 +0000 (UTC) From: "Hyunsik Choi (JIRA)" To: dev@tajo.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (TAJO-257) Unit tests occassionally fail. MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TAJO-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyunsik Choi updated TAJO-257: ------------------------------ Status: Patch Available (was: Open) > Unit tests occassionally fail. > ------------------------------ > > Key: TAJO-257 > URL: https://issues.apache.org/jira/browse/TAJO-257 > Project: Tajo > Issue Type: Bug > Reporter: Hyunsik Choi > Assignee: Hyunsik Choi > Priority: Blocker > Fix For: 0.2-incubating > > Attachments: TAJO-257.patch > > > {noformat} > 2013-10-16 14:55:43,110 INFO tajo.TajoTestingCluster (TajoTestingCluster.java:startMiniTajoCluster(292)) - Mini Tajo cluster is up > 2013-10-16 14:55:43,110 INFO rm.TajoWorkerResourceManager (TajoWorkerResourceManager.java:workerHeartbeat(395)) - TajoWorker:host:local05.gruter.com, port=44238,44237,47304, slots=2048:4:8, used=0:0:0 added in live TajoWorker list > 2013-10-16 14:55:43,149 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2174)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60398 is added to blk_-2382303275850279660_1004{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60398|RBW]]} size 117894 > 2013-10-16 14:55:43,600 INFO tajo.TajoTestingCluster (TajoTestingCluster.java:shutdownMiniCluster(447)) - ======================================== > 2013-10-16 14:55:43,600 INFO tajo.TajoTestingCluster (TajoTestingCluster.java:shutdownMiniCluster(448)) - Shutdown minicluster > 2013-10-16 14:55:43,600 INFO tajo.TajoTestingCluster (TajoTestingCluster.java:shutdownMiniCluster(449)) - ======================================== > 2013-10-16 14:55:43,612 INFO rpc.NettyServerBase (NettyServerBase.java:shutdown(120)) - Rpc (TajoMasterProtocol) listened on 127.0.0.1:44236) shutdown > 2013-10-16 14:55:43,613 INFO rpc.NettyServerBase (NettyServerBase.java:shutdown(120)) - Rpc (TajoMasterClientProtocol) listened on 127.0.0.1:44235) shutdown > 2013-10-16 14:55:43,614 INFO rpc.NettyServerBase (NettyServerBase.java:shutdown(120)) - Rpc (CatalogProtocol) listened on 127.0.0.1:44234) shutdown > 2013-10-16 14:55:43,614 INFO catalog.CatalogServer (CatalogServer.java:stop(161)) - Catalog Server (127.0.0.1:44234) shutdown > 2013-10-16 14:55:43,614 INFO master.TajoMaster (TajoMaster.java:stop(436)) - Tajo Master main thread exiting > 2013-10-16 14:55:43,615 INFO worker.TajoWorker (TajoWorker.java:run(451)) - Worker Resource Heartbeat Thread stopped. > 2013-10-16 14:55:43,616 INFO rpc.NettyClientBase (NettyClientBase.java:close(87)) - Proxy is disconnected from 127.0.0.1:44234 > 2013-10-16 14:55:43,618 INFO rpc.NettyClientBase (NettyClientBase.java:close(87)) - Proxy is disconnected from 127.0.0.1:44236 > 2013-10-16 14:55:43,619 INFO rpc.NettyServerBase (NettyServerBase.java:shutdown(120)) - Rpc (TajoWorkerProtocol) listened on 0:0:0:0:0:0:0:0:44238) shutdown > 2013-10-16 14:55:43,619 INFO worker.TajoWorkerManagerService (TajoWorkerManagerService.java:stop(109)) - TajoWorkerManagerService stopped > 2013-10-16 14:55:43,619 INFO querymaster.QueryMaster (QueryMaster.java:run(346)) - QueryMaster heartbeat thread stopped > 2013-10-16 14:55:43,620 INFO master.TajoAsyncDispatcher (TajoAsyncDispatcher.java:stop(122)) - AsyncDispatcher stopped:querymaster_1381902943098 > 2013-10-16 14:55:43,620 INFO querymaster.QueryMaster (QueryMaster.java:stop(151)) - QueryMaster stop > 2013-10-16 14:55:43,620 INFO worker.TajoWorkerClientService (TajoWorkerClientService.java:stop(103)) - TajoWorkerClientService stopping > 2013-10-16 14:55:43,621 INFO rpc.NettyServerBase (NettyServerBase.java:shutdown(120)) - Rpc (QueryMasterClientProtocol) listened on 0:0:0:0:0:0:0:0:44237) shutdown > 2013-10-16 14:55:43,621 INFO worker.TajoWorkerClientService (TajoWorkerClientService.java:stop(107)) - TajoWorkerClientService stopped > 2013-10-16 14:55:43,628 INFO worker.TajoWorker (TajoWorker.java:stop(211)) - TajoWorker main thread exiting > 2013-10-16 14:55:43,628 WARN datanode.DirectoryScanner (DirectoryScanner.java:shutdown(289)) - DirectoryScanner: shutdown has been called > 2013-10-16 14:55:43,745 WARN datanode.DataNode (BPServiceActor.java:offerService(575)) - BPOfferService for Block pool BP-1571979412-192.168.0.205-1381902941942 (storage id DS-977793291-192.168.0.205-60398-1381902942381) service to localhost/127.0.0.1:56994 interrupted > 2013-10-16 14:55:43,745 WARN datanode.DataNode (BPServiceActor.java:run(685)) - Ending block pool service for: Block pool BP-1571979412-192.168.0.205-1381902941942 (storage id DS-977793291-192.168.0.205-60398-1381902942381) service to localhost/127.0.0.1:56994 > 2013-10-16 14:55:43,747 WARN datanode.DirectoryScanner (DirectoryScanner.java:shutdown(289)) - DirectoryScanner: shutdown has been called > 2013-10-16 14:55:45,043 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1308)) - BLOCK* ask 127.0.0.1:41909 to replicate blk_8623857380696071962_1002 to datanode(s) 127.0.0.1:60398 127.0.0.1:51428 > 2013-10-16 14:55:45,279 WARN datanode.DataNode (DataNode.java:run(1485)) - DatanodeRegistration(127.0.0.1, storageID=DS-1668021296-192.168.0.205-41909-1381902942201, infoPort=60807, ipcPort=52563, storageInfo=lv=-40;cid=testClusterID;nsid=1161821716;c=0):Failed to transfer BP-1571979412-192.168.0.205-1381902941942:blk_8623857380696071962_1002 to 127.0.0.1:60398 got > java.net.ConnectException: Connection refused > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708) > at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206) > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:526) > at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:490) > at org.apache.hadoop.hdfs.server.datanode.DataNode$DataTransfer.run(DataNode.java:1423) > at java.lang.Thread.run(Thread.java:724) > 2013-10-16 14:55:45,361 WARN datanode.DataNode (BPServiceActor.java:run(685)) - Ending block pool service for: Block pool BP-1571979412-192.168.0.205-1381902941942 (storage id DS-617348020-192.168.0.205-51428-1381902942289) service to localhost/127.0.0.1:56994 > 2013-10-16 14:55:51,045 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1308)) - BLOCK* ask 127.0.0.1:41909 to replicate blk_8623857380696071962_1002 to datanode(s) 127.0.0.1:51428 127.0.0.1:60398 > 2013-10-16 14:55:51,282 WARN datanode.DataNode (BlockReceiver.java:(233)) - IOException in BlockReceiver constructor. Cause is > 2013-10-16 14:55:51,282 ERROR datanode.DataNode (DataXceiver.java:run(223)) - 127.0.0.1:51428:DataXceiver error processing WRITE_BLOCK operation src: /127.0.0.1:46346 dest: /127.0.0.1:51428 > java.io.IOException: block pool BP-1571979412-192.168.0.205-1381902941942 is not found > at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.getBlockPoolSlice(FsVolumeImpl.java:122) > at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.createTmpFile(FsVolumeImpl.java:150) > at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:818) > at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.createTemporary(FsDatasetImpl.java:91) > at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.(BlockReceiver.java:155) > at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:393) > at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:98) > at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:65) > at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:219) > at java.lang.Thread.run(Thread.java:724) > ^C2013-10-16 14:55:56,252 INFO worker.TajoWorker (TajoWorker.java:run(459)) - ============================================ > 2013-10-16 14:55:56,252 INFO worker.TajoWorker (TajoWorker.java:run(460)) - TajoWorker received SIGINT Signal > 2013-10-16 14:55:56,252 INFO worker.TajoWorker (TajoWorker.java:run(461)) - ============================================ > {noformat} -- This message was sent by Atlassian JIRA (v6.1#6144)