hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reinis Vicups <hb...@orbit-x.de>
Subject HBaseTestingUtility: Issue with unclosed sessions after minicluster is shutdown
Date Fri, 11 Jul 2014 10:40:35 GMT
Hi,

I have built a test-harness that I am using to test integration with the 
help of HBaseTestingUtility. The code bellow although allows me to run 
tests, it has one very annoying side effect - some of the sessions 
woun't get closed after I shutdown the minicluster, thus causing lag and 
delayed test execution.

I would be very grateful to anyone who could give me tip on how to fix this.

merci
reinis

Test Suite Code:
----------------------------------------------------------------------------------------------

abstract trait LocalHBaseSuite extends BeforeAndAfterAll {
   this: Suite =>
   @transient lazy val traitLog: Logger = 
LoggerFactory.getLogger(this.getClass.getName)

   var localHBase: HBaseTestingUtility = null
   var localFileSystem: FileSystem = null

   override def beforeAll = {
     traitLog.warn("{} before beforeAll", this.getClass.getName) //<- 
see in log

     // load snappy.dll found in hadoop bin directory
     val hadoopHomePath = 
file.Paths.get(ClassLoader.getSystemResource("hadoop").toURI)
addJavaLibraryPath(file.Paths.get(hadoopHomePath.toAbsolutePath.toString, "bin").toString)
     System.loadLibrary("snappy")
     System.setProperty("hadoop.home.dir", 
hadoopHomePath.toAbsolutePath.toString)

     localHBase = new HBaseTestingUtility()

     val localConfig = localHBase.getConfiguration
     localConfig.set("mapreduce.framework.name", "local")
     localConfig.set("dfs.permissions.enabled", "false")
     localConfig.set("fs.file.impl.disable.cache", "true")

     localHBase.startMiniCluster()
     localFileSystem = localHBase.getTestFileSystem

     traitLog.warn("{} after beforeAll", this.getClass.getName) //<- see 
in log
   }

   override def afterAll = {
     traitLog.warn("{} before afterAll", this.getClass.getName) //<- see 
in log
     localHBase.shutdownMiniCluster()
     traitLog.warn("{} after afterAll", this.getClass.getName) //<- see 
in log
     localHBase = null
   }

   /**
    * Adds the given path to the java.library.path system property
    */
   private def addJavaLibraryPath(libraryPath: String): Unit = {
     val usrPathsField: Field = 
classOf[ClassLoader].getDeclaredField("usr_paths")
     usrPathsField.setAccessible(true)
     val newPaths = usrPathsField.get(null).asInstanceOf[Array[String]] 
:+ libraryPath
     usrPathsField.set(null, newPaths.asInstanceOf[Array[String]])
   }
}


Resulting Log-File:
-------------------------------------------

[info] Loading project definition from D:\git\myproj\project
[info] Set current project to myproj (in build file:/D:/git/myproj/)
[success] Total time: 1 s, completed 11.07.2014 11:00:53
[info] Compiling 1 Scala source to 
D:\git\myproj\etl\target\scala-2.10\test-classes...
[info] ScalaTest
[info] Run completed in 42 milliseconds.
[info] Total number of tests run: 0
[info] Suites: completed 0, aborted 0
[info] Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
[info] No tests were executed.
[info] Passed: Total 0, Failed 0, Errors 0, Passed 0
[info] No tests to run for myproj-Root/it:test
[info] ScalaTest
[info] Run completed in 25 milliseconds.
[info] Total number of tests run: 0
[info] Suites: completed 0, aborted 0
[info] Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
[info] No tests were executed.
[info] Passed: Total 0, Failed 0, Errors 0, Passed 0
[info] No tests to run for myproj-API/it:test
[info] VectorizeTicketSolutionLogMRJobTest:
14/07/11 11:01:01 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest: 
com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest 
before beforeAll
Formatting using clusterid: testClusterID
14/07/11 11:01:03 WARN impl.MetricsConfig: Cannot locate configuration: 
tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
14/07/11 11:01:04 WARN server.AuthenticationFilter: 'signature.secret' 
configuration not set, using a random value as secret
14/07/11 11:01:06 WARN hbase.ZNodeClearer: Environment variable 
HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start 
scripts (Longer MTTR!)
14/07/11 11:01:08 WARN hbase.ZNodeClearer: Environment variable 
HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start 
scripts (Longer MTTR!)
14/07/11 11:01:09 WARN zookeeper.RecoverableZooKeeper: Node 
/hbase/meta-region-server already deleted, retry=false
14/07/11 11:01:10 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest: 
com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest 
after beforeAll
14/07/11 11:01:10 WARN hbase.HBaseCommonTestingUtility: close() called 
on HBaseAdmin instance returned from HBaseTestingUtility.getHBaseAdmin()
14/07/11 11:01:12 WARN mapreduce.JobSubmitter: No job jar file set. User 
classes may not be found. See Job or Job#setJar(String).
14/07/11 11:01:12 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/hadoop/mapreduce-jobtracker-staging-root-dir/user467204862/.staging/job_local467204862_0001/job.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.retry.interval;  Ignoring.
14/07/11 11:01:12 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/hadoop/mapreduce-jobtracker-staging-root-dir/user467204862/.staging/job_local467204862_0001/job.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.attempts;  Ignoring.
14/07/11 11:01:12 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/hadoop_tmp/mapred/local/localRunner/user/job_local467204862_0001/job_local467204862_0001.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.retry.interval;  Ignoring.
14/07/11 11:01:12 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/hadoop_tmp/mapred/local/localRunner/user/job_local467204862_0001/job_local467204862_0001.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.attempts;  Ignoring.
[info] - should validate that VectorizeTicketSolutionLogMRJob generates 
correct HBase table
14/07/11 11:01:13 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest: 
com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest 
after table close
14/07/11 11:01:13 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest: 
com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest 
before afterAll
14/07/11 11:01:13 WARN server.NIOServerCnxn: caught end of stream exception
EndOfStreamException: Unable to read additional data from client 
sessionid 0x14724a78b320003, likely client has closed socket
     at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
     at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
     at java.lang.Thread.run(Thread.java:722)
14/07/11 11:01:18 WARN server.NIOServerCnxn: caught end of stream exception
EndOfStreamException: Unable to read additional data from client 
sessionid 0x14724a78b320004, likely client has closed socket
     at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
     at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
     at java.lang.Thread.run(Thread.java:722)
14/07/11 11:01:18 ERROR client.HConnectionManager: Connection not found 
in the list, can't delete it (connection 
key=HConnectionKey{properties={hbase.rpc.timeout=60000, 
hbase.zookeeper.property.clientPort=63640, hbase.client.pause=100, 
zookeeper.znode.parent=/hbase, hbase.client.retries.number=350, 
hbase.zookeeper.quorum=localhost}, username='user'}). May be the key was 
modified?
java.lang.Exception
     at 
org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:466)
     at 
org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:402)
     at 
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.stop(ReplicationLogCleaner.java:142)
     at 
org.apache.hadoop.hbase.master.cleaner.CleanerChore.cleanup(CleanerChore.java:276)
     at org.apache.hadoop.hbase.Chore.run(Chore.java:94)
     at java.lang.Thread.run(Thread.java:722)
14/07/11 11:01:19 WARN datanode.DirectoryScanner: DirectoryScanner: 
shutdown has been called
14/07/11 11:01:19 WARN datanode.DataNode: BPOfferService for Block pool 
BP-466654724-192.168.178.20-1405069263037 (Datanode Uuid 
cc3e8ece-62e2-4877-92fe-8fdec4d1179f) service to /127.0.0.1:61391 
interrupted
14/07/11 11:01:19 WARN datanode.DataNode: Ending block pool service for: 
Block pool BP-466654724-192.168.178.20-1405069263037 (Datanode Uuid 
cc3e8ece-62e2-4877-92fe-8fdec4d1179f) service to /127.0.0.1:61391
14/07/11 11:01:19 WARN blockmanagement.DecommissionManager: Monitor 
interrupted: java.lang.InterruptedException: sleep interrupted
14/07/11 11:01:19 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest: 
com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest 
after afterAll
14/07/11 11:01:19 WARN 
similarity.TicketTextSimilarityPreferenceMRJobTest: 
com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest before 
beforeAll
[info] TicketTextSimilarityPreferenceMRJobTest:
14/07/11 11:01:19 WARN hbase.HBaseCommonTestingUtility: hadoop.tmp.dir 
property value differs in configuration and system: 
Configuration=/tmp/hadoop-user while 
System=D:/git/myproj/etl/target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/hadoop_tmp

Erasing configuration value by system value.
Formatting using clusterid: testClusterID
14/07/11 11:01:19 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:20 WARN server.AuthenticationFilter: 'signature.secret' 
configuration not set, using a random value as secret
14/07/11 11:01:20 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:21 WARN hbase.ZNodeClearer: Environment variable 
HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start 
scripts (Longer MTTR!)
14/07/11 11:01:22 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:22 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:23 WARN regionserver.HRegionServer: reportForDuty failed; 
sleeping and then retrying.
14/07/11 11:01:23 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:24 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:26 WARN hbase.ZNodeClearer: Environment variable 
HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start 
scripts (Longer MTTR!)
14/07/11 11:01:26 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:27 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:27 WARN zookeeper.RecoverableZooKeeper: Node 
/hbase/meta-region-server already deleted, retry=false
14/07/11 11:01:28 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:28 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:28 WARN 
similarity.TicketTextSimilarityPreferenceMRJobTest: 
com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest after 
beforeAll
14/07/11 11:01:28 WARN hbase.HBaseCommonTestingUtility: close() called 
on HBaseAdmin instance returned from HBaseTestingUtility.getHBaseAdmin()
14/07/11 11:01:30 WARN mapreduce.JobSubmitter: No job jar file set. User 
classes may not be found. See Job or Job#setJar(String).
14/07/11 11:01:30 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/hadoop/mapreduce-jobtracker-staging-root-dir/user1872843153/.staging/job_local1872843153_0002/job.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.retry.interval;  Ignoring.
14/07/11 11:01:30 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/hadoop/mapreduce-jobtracker-staging-root-dir/user1872843153/.staging/job_local1872843153_0002/job.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.attempts;  Ignoring.
14/07/11 11:01:30 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/mapred_local/localRunner/user/job_local1872843153_0002/job_local1872843153_0002.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.retry.interval;  Ignoring.
14/07/11 11:01:30 WARN conf.Configuration: 
file:/D:/git/myproj/etl/target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/mapred_local/localRunner/user/job_local1872843153_0002/job_local1872843153_0002.xml:an

attempt to override final parameter: 
mapreduce.job.end-notification.max.attempts;  Ignoring.
14/07/11 11:01:31 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:31 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:32 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:33 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
[info] - should run ticket text similarity preference mr job
[info] - should generate preference table that is compatible with 
HBasedDataModel
14/07/11 11:01:33 WARN 
similarity.TicketTextSimilarityPreferenceMRJobTest: 
com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest after 
table close
14/07/11 11:01:33 WARN 
similarity.TicketTextSimilarityPreferenceMRJobTest: 
com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest before 
afterAll
14/07/11 11:01:35 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:36 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:36 ERROR client.HConnectionManager: Connection not found 
in the list, can't delete it (connection 
key=HConnectionKey{properties={hbase.rpc.timeout=60000, 
hbase.zookeeper.property.clientPort=65078, hbase.client.pause=100, 
zookeeper.znode.parent=/hbase, hbase.client.retries.number=350, 
hbase.zookeeper.quorum=localhost}, username='user'}). May be the key was 
modified?
java.lang.Exception
     at 
org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:466)
     at 
org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:402)
     at 
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.stop(ReplicationLogCleaner.java:142)
     at 
org.apache.hadoop.hbase.master.cleaner.CleanerChore.cleanup(CleanerChore.java:276)
     at org.apache.hadoop.hbase.Chore.run(Chore.java:94)
     at java.lang.Thread.run(Thread.java:722)
14/07/11 11:01:37 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:37 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:37 WARN datanode.DirectoryScanner: DirectoryScanner: 
shutdown has been called
14/07/11 11:01:37 WARN datanode.DataNode: BPOfferService for Block pool 
BP-912909389-192.168.178.20-1405069279778 (Datanode Uuid 
c6c45632-3e50-4575-8b65-92d7479a48ba) service to /127.0.0.1:61553 
interrupted
14/07/11 11:01:37 WARN datanode.DataNode: Ending block pool service for: 
Block pool BP-912909389-192.168.178.20-1405069279778 (Datanode Uuid 
c6c45632-3e50-4575-8b65-92d7479a48ba) service to /127.0.0.1:61553
14/07/11 11:01:37 WARN blockmanagement.DecommissionManager: Monitor 
interrupted: java.lang.InterruptedException: sleep interrupted
14/07/11 11:01:37 WARN 
similarity.TicketTextSimilarityPreferenceMRJobTest: 
com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest after afterAll
[info] TicketMasterDataCategoryGroupingMRJobTest:
14/07/11 11:01:37 WARN 
masterdata.TicketMasterDataCategoryGroupingMRJobTest: 
com.myproj.quantify.ticket.masterdata.TicketMasterDataCategoryGroupingMRJobTest 
before beforeAll
14/07/11 11:01:37 WARN hbase.HBaseCommonTestingUtility: hadoop.tmp.dir 
property value differs in configuration and system: 
Configuration=/tmp/hadoop-user while 
System=D:/git/myproj/etl/target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/hadoop_tmp

Erasing configuration value by system value.
Formatting using clusterid: testClusterID
14/07/11 11:01:38 WARN server.AuthenticationFilter: 'signature.secret' 
configuration not set, using a random value as secret
14/07/11 11:01:38 WARN zookeeper.ClientCnxn: Session 0x14724a7c5790007 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:38 WARN zookeeper.ClientCnxn: Session 0x14724a7c5790002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)
14/07/11 11:01:39 WARN hbase.ZNodeClearer: Environment variable 
HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start 
scripts (Longer MTTR!)
14/07/11 11:01:39 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 
for server null, unexpected error, closing socket connection and 
attempting reconnect
java.net.ConnectException: Connection refused: no further information
     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
     at 
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
     at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1075)

# ... This goes on and on and on ...

[info] ScalaTest
[info] Run completed in 5 minutes, 23 seconds.
[info] Total number of tests run: 22
[info] Suites: completed 10, aborted 0
[info] Tests: succeeded 22, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
[info] Passed: Total 26, Failed 0, Errors 0, Passed 24, Skipped 2
[success] Total time: 331 s, completed 11.07.2014 11:06:24


Mime
View raw message