incubator-blur-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron McCurry (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (BLUR-240) BlurClusterTest Unit test failing
Date Fri, 20 Sep 2013 18:43:52 GMT

    [ https://issues.apache.org/jira/browse/BLUR-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773291#comment-13773291
] 

Aaron McCurry edited comment on BLUR-240 at 9/20/13 6:43 PM:
-------------------------------------------------------------

What OS are you running this on?  This test is a bit finicky, it actually is suppose to test
that the back pressure feature is working correctly by nearly running the JVM out of memory
and letting Blur react by killing currently running queries.  The hope is that the back pressure
feature will save the JVM from an OOM exception.  OSX running jdk6 seems to work every time,
however I have seen issues on ubuntu and I really haven't tried it on jdk7.  Probably need
to make OS and runtime specific setting for configuring a nearly OOM situation.
                
      was (Author: amccurry):
    What OS are you running this on?  This test is a bit finicky, it actually is suppose to
test that the back pressure feature is working correctly by nearly running the JVM out of
memory and letting Blur react by killing currently running queries.  The hope is that the
back pressure feature will save the JVM from an OOM exception.  OSX running jdk6 seems to
work every time, however I have seem issues on ubuntu and I really haven't tried it on jdk7.
 Probably need to may OS and runtime specific setting for configuring a nearly OOM situation.
                  
> BlurClusterTest Unit test failing
> ---------------------------------
>
>                 Key: BLUR-240
>                 URL: https://issues.apache.org/jira/browse/BLUR-240
>             Project: Apache Blur
>          Issue Type: Bug
>    Affects Versions: 0.3.0
>         Environment: Ubuntu 12.04.2 LTS
> Linux 2.6.32-042stab057.1 #1 SMP Fri Jun 22 02:17:07 MSD 2012 x86_64 x86_64 x86_64 GNU/Linux
> java version "1.7.0_21"
> Java(TM) SE Runtime Environment (build 1.7.0_21-b11)
> Java HotSpot(TM) 64-Bit Server VM (build 23.21-b01, mixed mode)
> commit aeba56bdf30997f8516837c600e856334131ef8d (2f9e54b7e0bc1da65ca0a84cfca0bf13319f44e9
+ license patch from issue BLUR-239)
>            Reporter: Tony Bussieres
>            Priority: Minor
>
> Likely to be a version mismatch in the pom.xml ?
> Running org.apache.blur.thrift.BlurClusterTest
> INFO  20130920_13:08:58:058_EDT [main] utils.GCWatcher: GCWatcher was setup.
> INFO  20130920_13:08:58:058_EDT [gc-watch] utils.GCWatcher: totalTime spent in GC [132
ms] collected [36,953,400 bytes]
> INFO  20130920_13:08:58:058_EDT [main] mortbay.log: jetty-6.1.26
> INFO  20130920_13:08:58:058_EDT [main] mortbay.log: Extract jar:file:/home/tbussier/.m2/repository/org/apache/hadoop/hadoop-core/1.2.1/hadoop-core-1.2.1.jar!/webapps/hdfs
to /tmp/Jetty_localhost_59000_hdfs____.c461je/webapp
> INFO  20130920_13:08:58:058_EDT [main] mortbay.log: Started SelectChannelConnector@localhost:59000
> Starting DataNode 0 with dfs.data.dir: file:/home/tbussier/incubator-blur/blur-core/target/target/tmp/blur-cluster-test/cluster/hdfs/dfs/data/data1,file:/home/tbussier/incubator-blur/blur-core/target/target/tmp/blur-cluster-test/cluster/hdfs/dfs/data/data2
> INFO  20130920_13:08:58:058_EDT [main] mortbay.log: jetty-6.1.26
> INFO  20130920_13:08:58:058_EDT [main] mortbay.log: Extract jar:file:/home/tbussier/.m2/repository/org/apache/hadoop/hadoop-core/1.2.1/hadoop-core-1.2.1.jar!/webapps/datanode
to /tmp/Jetty_localhost_60828_datanode____.b9vc0l/webapp
> INFO  20130920_13:08:58:058_EDT [main] mortbay.log: Started SelectChannelConnector@localhost:60828
> Cluster is active
> Cluster is active
> INFO  20130920_13:08:58:058_EDT [Thread-956] server.ZooKeeperServerMain: Starting server
> INFO  20130920_13:08:58:058_EDT [Thread-956] server.ZooKeeperServer: tickTime set to
2000
> INFO  20130920_13:08:58:058_EDT [Thread-956] server.ZooKeeperServer: minSessionTimeout
set to -1
> INFO  20130920_13:08:58:058_EDT [Thread-956] server.ZooKeeperServer: maxSessionTimeout
set to -1
> INFO  20130920_13:08:58:058_EDT [Thread-956] server.NIOServerCnxnFactory: binding to
port 0.0.0.0/0.0.0.0:21810
> INFO  20130920_13:08:58:058_EDT [Thread-956] persistence.FileTxnSnapLog: Snapshotting:
0x0 to file:/home/tbussier/incubator-blur/blur-core/target/target/tmp/blur-cluster-test/cluster/zk/zk_test/version-2/snapshot.0
> INFO  20130920_13:08:58:058_EDT [main] zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:21810 sessionTimeout=30000 watcher=org.apache.blur.MiniCluster$5@7f1ba300
> INFO  20130920_13:08:58:058_EDT [main-EventThread] zookeeper.ClientCnxn: EventThread
shut down
> INFO  20130920_13:08:58:058_EDT [main] zookeeper.ZooKeeper: Session: 0x0 closed
> INFO  20130920_13:08:58:058_EDT [main] thrift.ThriftBlurControllerServer: Shard Server
using index [0] bind address [0.0.0.0:40010]
> INFO  20130920_13:08:58:058_EDT [main] zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:21810 sessionTimeout=90000 watcher=org.apache.blur.zookeeper.ZkUtils$ConnectionWatcher@2b01ad2b
> INFO  20130920_13:08:58:058_EDT [main-SendThread(localhost:21810)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/0:0:0:0:0:0:0:1:21810. Will not attempt to authenticate
using SASL (unknown error)
> INFO  20130920_13:08:58:058_EDT [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:21810] server.NIOServerCnxnFactory:
Accepted socket connection from /0:0:0:0:0:0:0:1:57660
> INFO  20130920_13:08:58:058_EDT [main-SendThread(localhost:21810)] zookeeper.ClientCnxn:
Socket connection established to localhost/0:0:0:0:0:0:0:1:21810, initiating session
> INFO  20130920_13:08:58:058_EDT [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:21810] server.ZooKeeperServer:
Client attempting to establish new session at /0:0:0:0:0:0:0:1:57660
> INFO  20130920_13:08:58:058_EDT [SyncThread:0] persistence.FileTxnLog: Creating new log
file: log.1
> INFO  20130920_13:08:58:058_EDT [SyncThread:0] server.ZooKeeperServer: Established session
0x1413c588ef60000 with negotiated timeout 40000 for client /0:0:0:0:0:0:0:1:57660
> INFO  20130920_13:08:58:058_EDT [main-SendThread(localhost:21810)] zookeeper.ClientCnxn:
Session establishment complete on server localhost/0:0:0:0:0:0:0:1:21810, sessionid = 0x1413c588ef60000,
negotiated timeout = 40000
> INFO  20130920_13:08:58:058_EDT [main-EventThread] zookeeper.ZkUtils: ZooKeeper [localhost:21810]
timeout [90,000] changed to [SyncConnected] state
> WARN  20130920_13:08:59:059_EDT [Watch Children [/blur/clusters][0578ae54-640b-4500-ac3c-6ab2a0b9913d]]
zookeeper.WatchNodeExistance: Closing [85735304-4b59-4cc1-863b-d914bb56ff80]
> WARN  20130920_13:08:59:059_EDT [Watch Children [/blur/clusters][0578ae54-640b-4500-ac3c-6ab2a0b9913d]]
zookeeper.WatchNodeExistance: Closing [f7150a06-7939-4430-b976-a1db9fded1d4]
> INFO  20130920_13:08:59:059_EDT [Watch Children [/blur/clusters/default/tables][0c4defbf-0e89-4086-af64-001de0b81a54]]
thrift.BlurControllerServer: Layout change.
> INFO  20130920_13:08:59:059_EDT [Watch Children [/blur/clusters/default/online-nodes][00785eba-66f5-40e1-b25d-94122e7fa584]]
thrift.BlurControllerServer: Layout change.
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchChildren: Closing [0578ae54-640b-4500-ac3c-6ab2a0b9913d]
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchChildren: Closing [00785eba-66f5-40e1-b25d-94122e7fa584]
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchNodeExistance: Closing [d7b038f7-cd9c-4fc1-9474-a580eacd8da6]
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchChildren: Closing [0c4defbf-0e89-4086-af64-001de0b81a54]
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchNodeExistance: Closing [45d97866-7abe-4e40-a66d-572d29e6d6ee]
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchChildren: Closing [82ebb44c-5850-470e-8763-e11ae9edef80]
> WARN  20130920_13:08:59:059_EDT [main] zookeeper.WatchChildren: Closing [7fef3edb-b7e0-4cfb-a194-4c8d44ebfe34]
> INFO  20130920_13:08:59:059_EDT [ProcessThread(sid:0 cport:-1):] server.PrepRequestProcessor:
Processed session termination for sessionid: 0x1413c588ef60000
> INFO  20130920_13:08:59:059_EDT [main] zookeeper.ZooKeeper: Session: 0x1413c588ef60000
closed
> INFO  20130920_13:08:59:059_EDT [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:21810] server.NIOServerCnxn:
Closed socket connection for client /0:0:0:0:0:0:0:1:57660 which had sessionid 0x1413c588ef60000
> INFO  20130920_13:08:59:059_EDT [main-EventThread] zookeeper.ClientCnxn: EventThread
shut down
> Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 1.848 sec <<<
FAILURE!
> org.apache.blur.thrift.BlurClusterTest  Time elapsed: 1.848 sec  <<< ERROR!
> java.lang.NoSuchMethodError: org.apache.blur.thrift.Connection.getConnectionStr()Ljava/lang/Object;
>         at org.apache.blur.MiniCluster.startControllers(MiniCluster.java:243)
>         at org.apache.blur.MiniCluster.startControllers(MiniCluster.java:201)
>         at org.apache.blur.MiniCluster.startBlurCluster(MiniCluster.java:138)
>         at org.apache.blur.thrift.BlurClusterTest.startCluster(BlurClusterTest.java:94)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>         at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>         at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>         at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:27)
>         at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
>         at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>         at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
>         at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
>         at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
>         at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
>         at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
>         at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
>         at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
> org.apache.blur.thrift.BlurClusterTest  Time elapsed: 1.848 sec  <<< ERROR!
> java.lang.NullPointerException
>         at org.apache.blur.thrift.ThriftServer.close(ThriftServer.java:157)
>         at org.apache.blur.MiniCluster.stopControllers(MiniCluster.java:189)
>         at org.apache.blur.MiniCluster.shutdownBlurCluster(MiniCluster.java:148)
>         at org.apache.blur.thrift.BlurClusterTest.shutdownCluster(BlurClusterTest.java:99)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>         at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>         at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>         at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:37)
>         at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>         at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
>         at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
>         at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
>         at org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
>         at org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
>         at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
>         at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
> INFO  20130920_13:09:00:000_EDT [Thread-975] indexserver.BlurServerShutDown: Closing
zookeeper.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message