hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Esteban Gutierrez <este...@cloudera.com>
Subject Re: HBaseTestingUtility: Issue with unclosed sessions after minicluster is shutdown
Date Sun, 13 Jul 2014 04:34:45 GMT
Hello Renis,

Is this happening every time the test runs? I've seen this happening few
times when the test is running with a very small heap or the test is
running on VMs and the Java VM or the local file system are unstable due
load on the virtualized environment. Have you looked into increasing the
heap or the the load of the environment where you are running this test?

cheers,
esteban.







--
Cloudera, Inc.



On Fri, Jul 11, 2014 at 3:40 AM, Reinis Vicups <hbase@orbit-x.de> wrote:

> Hi,
>
> I have built a test-harness that I am using to test integration with the
> help of HBaseTestingUtility. The code bellow although allows me to run
> tests, it has one very annoying side effect - some of the sessions woun't
> get closed after I shutdown the minicluster, thus causing lag and delayed
> test execution.
>
> I would be very grateful to anyone who could give me tip on how to fix
> this.
>
> merci
>
> reinis
>
> Test Suite Code:
> ------------------------------------------------------------
> ----------------------------------
>
> abstract trait LocalHBaseSuite extends BeforeAndAfterAll {
>
>   this: Suite =>
>   @transient lazy val traitLog: Logger = LoggerFactory.getLogger(this.
> getClass.getName)
>
>   var localHBase: HBaseTestingUtility = null
>   var localFileSystem: FileSystem = null
>
>   override def beforeAll = {
>     traitLog.warn("{} before beforeAll", this.getClass.getName) //<- see
> in log
>
>     // load snappy.dll found in hadoop bin directory
>     val hadoopHomePath = file.Paths.get(ClassLoader.
> getSystemResource("hadoop").toURI)
> addJavaLibraryPath(file.Paths.get(hadoopHomePath.toAbsolutePath.toString,
> "bin").toString)
>     System.loadLibrary("snappy")
>     System.setProperty("hadoop.home.dir", hadoopHomePath.toAbsolutePath.
> toString)
>
>     localHBase = new HBaseTestingUtility()
>
>     val localConfig = localHBase.getConfiguration
>     localConfig.set("mapreduce.framework.name", "local")
>     localConfig.set("dfs.permissions.enabled", "false")
>     localConfig.set("fs.file.impl.disable.cache", "true")
>
>     localHBase.startMiniCluster()
>     localFileSystem = localHBase.getTestFileSystem
>
>     traitLog.warn("{} after beforeAll", this.getClass.getName) //<- see in
> log
>   }
>
>   override def afterAll = {
>     traitLog.warn("{} before afterAll", this.getClass.getName) //<- see in
> log
>     localHBase.shutdownMiniCluster()
>     traitLog.warn("{} after afterAll", this.getClass.getName) //<- see in
> log
>     localHBase = null
>   }
>
>   /**
>    * Adds the given path to the java.library.path system property
>    */
>   private def addJavaLibraryPath(libraryPath: String): Unit = {
>     val usrPathsField: Field = classOf[ClassLoader].
> getDeclaredField("usr_paths")
>     usrPathsField.setAccessible(true)
>     val newPaths = usrPathsField.get(null).asInstanceOf[Array[String]] :+
> libraryPath
>     usrPathsField.set(null, newPaths.asInstanceOf[Array[String]])
>   }
> }
>
>
> Resulting Log-File:
> -------------------------------------------
>
> [info] Loading project definition from D:\git\myproj\project
> [info] Set current project to myproj (in build file:/D:/git/myproj/)
> [success] Total time: 1 s, completed 11.07.2014 11:00:53
> [info] Compiling 1 Scala source to D:\git\myproj\etl\target\
> scala-2.10\test-classes...
> [info] ScalaTest
> [info] Run completed in 42 milliseconds.
> [info] Total number of tests run: 0
> [info] Suites: completed 0, aborted 0
> [info] Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
> [info] No tests were executed.
> [info] Passed: Total 0, Failed 0, Errors 0, Passed 0
> [info] No tests to run for myproj-Root/it:test
> [info] ScalaTest
> [info] Run completed in 25 milliseconds.
> [info] Total number of tests run: 0
> [info] Suites: completed 0, aborted 0
> [info] Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
> [info] No tests were executed.
> [info] Passed: Total 0, Failed 0, Errors 0, Passed 0
> [info] No tests to run for myproj-API/it:test
> [info] VectorizeTicketSolutionLogMRJobTest:
> 14/07/11 11:01:01 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest:
> com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest
> before beforeAll
> Formatting using clusterid: testClusterID
> 14/07/11 11:01:03 WARN impl.MetricsConfig: Cannot locate configuration:
> tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
> 14/07/11 11:01:04 WARN server.AuthenticationFilter: 'signature.secret'
> configuration not set, using a random value as secret
> 14/07/11 11:01:06 WARN hbase.ZNodeClearer: Environment variable
> HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start
> scripts (Longer MTTR!)
> 14/07/11 11:01:08 WARN hbase.ZNodeClearer: Environment variable
> HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start
> scripts (Longer MTTR!)
> 14/07/11 11:01:09 WARN zookeeper.RecoverableZooKeeper: Node
> /hbase/meta-region-server already deleted, retry=false
> 14/07/11 11:01:10 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest:
> com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest
> after beforeAll
> 14/07/11 11:01:10 WARN hbase.HBaseCommonTestingUtility: close() called on
> HBaseAdmin instance returned from HBaseTestingUtility.getHBaseAdmin()
> 14/07/11 11:01:12 WARN mapreduce.JobSubmitter: No job jar file set. User
> classes may not be found. See Job or Job#setJar(String).
> 14/07/11 11:01:12 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/
> hadoop/mapreduce-jobtracker-staging-root-dir/user467204862/.staging/job_local467204862_0001/job.xml:an
> attempt to override final parameter: mapreduce.job.end-
> notification.max.retry.interval;  Ignoring.
> 14/07/11 11:01:12 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/
> hadoop/mapreduce-jobtracker-staging-root-dir/user467204862/.staging/job_local467204862_0001/job.xml:an
> attempt to override final parameter: mapreduce.job.end-notification.max.attempts;
>  Ignoring.
> 14/07/11 11:01:12 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/
> hadoop_tmp/mapred/local/localRunner/user/job_local467204862_0001/job_local467204862_0001.xml:an
> attempt to override final parameter: mapreduce.job.end-
> notification.max.retry.interval;  Ignoring.
> 14/07/11 11:01:12 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/
> hadoop_tmp/mapred/local/localRunner/user/job_local467204862_0001/job_local467204862_0001.xml:an
> attempt to override final parameter: mapreduce.job.end-notification.max.attempts;
>  Ignoring.
> [info] - should validate that VectorizeTicketSolutionLogMRJob generates
> correct HBase table
> 14/07/11 11:01:13 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest:
> com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest
> after table close
> 14/07/11 11:01:13 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest:
> com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest
> before afterAll
> 14/07/11 11:01:13 WARN server.NIOServerCnxn: caught end of stream exception
> EndOfStreamException: Unable to read additional data from client sessionid
> 0x14724a78b320003, likely client has closed socket
>     at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> NIOServerCnxn.java:220)
>     at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:208)
>     at java.lang.Thread.run(Thread.java:722)
> 14/07/11 11:01:18 WARN server.NIOServerCnxn: caught end of stream exception
> EndOfStreamException: Unable to read additional data from client sessionid
> 0x14724a78b320004, likely client has closed socket
>     at org.apache.zookeeper.server.NIOServerCnxn.doIO(
> NIOServerCnxn.java:220)
>     at org.apache.zookeeper.server.NIOServerCnxnFactory.run(
> NIOServerCnxnFactory.java:208)
>     at java.lang.Thread.run(Thread.java:722)
> 14/07/11 11:01:18 ERROR client.HConnectionManager: Connection not found in
> the list, can't delete it (connection key=HConnectionKey{properties={hbase.rpc.timeout=60000,
> hbase.zookeeper.property.clientPort=63640, hbase.client.pause=100,
> zookeeper.znode.parent=/hbase, hbase.client.retries.number=350,
> hbase.zookeeper.quorum=localhost}, username='user'}). May be the key was
> modified?
> java.lang.Exception
>     at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(
> HConnectionManager.java:466)
>     at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(
> HConnectionManager.java:402)
>     at org.apache.hadoop.hbase.replication.master.
> ReplicationLogCleaner.stop(ReplicationLogCleaner.java:142)
>     at org.apache.hadoop.hbase.master.cleaner.CleanerChore.
> cleanup(CleanerChore.java:276)
>     at org.apache.hadoop.hbase.Chore.run(Chore.java:94)
>     at java.lang.Thread.run(Thread.java:722)
> 14/07/11 11:01:19 WARN datanode.DirectoryScanner: DirectoryScanner:
> shutdown has been called
> 14/07/11 11:01:19 WARN datanode.DataNode: BPOfferService for Block pool
> BP-466654724-192.168.178.20-1405069263037 (Datanode Uuid
> cc3e8ece-62e2-4877-92fe-8fdec4d1179f) service to /127.0.0.1:61391
> interrupted
> 14/07/11 11:01:19 WARN datanode.DataNode: Ending block pool service for:
> Block pool BP-466654724-192.168.178.20-1405069263037 (Datanode Uuid
> cc3e8ece-62e2-4877-92fe-8fdec4d1179f) service to /127.0.0.1:61391
> 14/07/11 11:01:19 WARN blockmanagement.DecommissionManager: Monitor
> interrupted: java.lang.InterruptedException: sleep interrupted
> 14/07/11 11:01:19 WARN solutionlog.VectorizeTicketSolutionLogMRJobTest:
> com.myproj.quantify.ticket.solutionlog.VectorizeTicketSolutionLogMRJobTest
> after afterAll
> 14/07/11 11:01:19 WARN similarity.TicketTextSimilarityPreferenceMRJobTest:
> com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest before
> beforeAll
> [info] TicketTextSimilarityPreferenceMRJobTest:
> 14/07/11 11:01:19 WARN hbase.HBaseCommonTestingUtility: hadoop.tmp.dir
> property value differs in configuration and system:
> Configuration=/tmp/hadoop-user while System=D:/git/myproj/etl/
> target/test-data/1e71ff51-76c5-45e9-8d44-1249dbff3055/hadoop_tmp Erasing
> configuration value by system value.
> Formatting using clusterid: testClusterID
> 14/07/11 11:01:19 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:20 WARN server.AuthenticationFilter: 'signature.secret'
> configuration not set, using a random value as secret
> 14/07/11 11:01:20 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:21 WARN hbase.ZNodeClearer: Environment variable
> HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start
> scripts (Longer MTTR!)
> 14/07/11 11:01:22 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:22 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:23 WARN regionserver.HRegionServer: reportForDuty failed;
> sleeping and then retrying.
> 14/07/11 11:01:23 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:24 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:26 WARN hbase.ZNodeClearer: Environment variable
> HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start
> scripts (Longer MTTR!)
> 14/07/11 11:01:26 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:27 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:27 WARN zookeeper.RecoverableZooKeeper: Node
> /hbase/meta-region-server already deleted, retry=false
> 14/07/11 11:01:28 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:28 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:28 WARN similarity.TicketTextSimilarityPreferenceMRJobTest:
> com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest after
> beforeAll
> 14/07/11 11:01:28 WARN hbase.HBaseCommonTestingUtility: close() called on
> HBaseAdmin instance returned from HBaseTestingUtility.getHBaseAdmin()
> 14/07/11 11:01:30 WARN mapreduce.JobSubmitter: No job jar file set. User
> classes may not be found. See Job or Job#setJar(String).
> 14/07/11 11:01:30 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/
> hadoop/mapreduce-jobtracker-staging-root-dir/user1872843153/.staging/job_
> local1872843153_0002/job.xml:an attempt to override final parameter:
> mapreduce.job.end-notification.max.retry.interval;  Ignoring.
> 14/07/11 11:01:30 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/
> hadoop/mapreduce-jobtracker-staging-root-dir/user1872843153/.staging/job_
> local1872843153_0002/job.xml:an attempt to override final parameter:
> mapreduce.job.end-notification.max.attempts;  Ignoring.
> 14/07/11 11:01:30 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/
> mapred_local/localRunner/user/job_local1872843153_0002/job_local1872843153_0002.xml:an
> attempt to override final parameter: mapreduce.job.end-
> notification.max.retry.interval;  Ignoring.
> 14/07/11 11:01:30 WARN conf.Configuration: file:/D:/git/myproj/etl/
> target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/
> mapred_local/localRunner/user/job_local1872843153_0002/job_local1872843153_0002.xml:an
> attempt to override final parameter: mapreduce.job.end-notification.max.attempts;
>  Ignoring.
> 14/07/11 11:01:31 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:31 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:32 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:33 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> [info] - should run ticket text similarity preference mr job
> [info] - should generate preference table that is compatible with
> HBasedDataModel
> 14/07/11 11:01:33 WARN similarity.TicketTextSimilarityPreferenceMRJobTest:
> com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest after table
> close
> 14/07/11 11:01:33 WARN similarity.TicketTextSimilarityPreferenceMRJobTest:
> com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest before
> afterAll
> 14/07/11 11:01:35 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:36 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:36 ERROR client.HConnectionManager: Connection not found in
> the list, can't delete it (connection key=HConnectionKey{properties={hbase.rpc.timeout=60000,
> hbase.zookeeper.property.clientPort=65078, hbase.client.pause=100,
> zookeeper.znode.parent=/hbase, hbase.client.retries.number=350,
> hbase.zookeeper.quorum=localhost}, username='user'}). May be the key was
> modified?
> java.lang.Exception
>     at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(
> HConnectionManager.java:466)
>     at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(
> HConnectionManager.java:402)
>     at org.apache.hadoop.hbase.replication.master.
> ReplicationLogCleaner.stop(ReplicationLogCleaner.java:142)
>     at org.apache.hadoop.hbase.master.cleaner.CleanerChore.
> cleanup(CleanerChore.java:276)
>     at org.apache.hadoop.hbase.Chore.run(Chore.java:94)
>     at java.lang.Thread.run(Thread.java:722)
> 14/07/11 11:01:37 WARN zookeeper.ClientCnxn: Session 0x14724a78b320007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:37 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:37 WARN datanode.DirectoryScanner: DirectoryScanner:
> shutdown has been called
> 14/07/11 11:01:37 WARN datanode.DataNode: BPOfferService for Block pool
> BP-912909389-192.168.178.20-1405069279778 (Datanode Uuid
> c6c45632-3e50-4575-8b65-92d7479a48ba) service to /127.0.0.1:61553
> interrupted
> 14/07/11 11:01:37 WARN datanode.DataNode: Ending block pool service for:
> Block pool BP-912909389-192.168.178.20-1405069279778 (Datanode Uuid
> c6c45632-3e50-4575-8b65-92d7479a48ba) service to /127.0.0.1:61553
> 14/07/11 11:01:37 WARN blockmanagement.DecommissionManager: Monitor
> interrupted: java.lang.InterruptedException: sleep interrupted
> 14/07/11 11:01:37 WARN similarity.TicketTextSimilarityPreferenceMRJobTest:
> com.myproj.similarity.TicketTextSimilarityPreferenceMRJobTest after
> afterAll
> [info] TicketMasterDataCategoryGroupingMRJobTest:
> 14/07/11 11:01:37 WARN masterdata.TicketMasterDataCategoryGroupingMRJobTest:
> com.myproj.quantify.ticket.masterdata.TicketMasterDataCategoryGroupingMRJobTest
> before beforeAll
> 14/07/11 11:01:37 WARN hbase.HBaseCommonTestingUtility: hadoop.tmp.dir
> property value differs in configuration and system:
> Configuration=/tmp/hadoop-user while System=D:/git/myproj/etl/
> target/test-data/c85b7f3b-4e4b-40b4-a434-a45cecc9cba8/hadoop_tmp Erasing
> configuration value by system value.
> Formatting using clusterid: testClusterID
> 14/07/11 11:01:38 WARN server.AuthenticationFilter: 'signature.secret'
> configuration not set, using a random value as secret
> 14/07/11 11:01:38 WARN zookeeper.ClientCnxn: Session 0x14724a7c5790007 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:38 WARN zookeeper.ClientCnxn: Session 0x14724a7c5790002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
> 14/07/11 11:01:39 WARN hbase.ZNodeClearer: Environment variable
> HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start
> scripts (Longer MTTR!)
> 14/07/11 11:01:39 WARN zookeeper.ClientCnxn: Session 0x14724a78b320002 for
> server null, unexpected error, closing socket connection and attempting
> reconnect
> java.net.ConnectException: Connection refused: no further information
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>     at sun.nio.ch.SocketChannelImpl.finishConnect(
> SocketChannelImpl.java:692)
>     at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:350)
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(
> ClientCnxn.java:1075)
>
> # ... This goes on and on and on ...
>
> [info] ScalaTest
> [info] Run completed in 5 minutes, 23 seconds.
> [info] Total number of tests run: 22
> [info] Suites: completed 10, aborted 0
> [info] Tests: succeeded 22, failed 0, canceled 0, ignored 0, pending 0
> [info] All tests passed.
> [info] Passed: Total 26, Failed 0, Errors 0, Passed 24, Skipped 2
> [success] Total time: 331 s, completed 11.07.2014 11:06:24
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message