samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jordi Blasi Uribarri <jbl...@nextel.es>
Subject RE: testThreadInterruptInOperationSleep on clean installation
Date Tue, 04 Aug 2015 06:53:13 GMT
Hi,

There was no gradle process and I have tried to run it increasing the log level. It seems
that the test that is failing is the one related to Rocksdb.

How can I run the test on eclipse?

This is what I get:

Executing task ':samza-kv-rocksdb_2.10:sourcesJar' (up-to-date check took 0.005 secs) due
to:
  Output file /opt/samza/samza-kv-rocksdb/build/libs/samza-kv-rocksdb_2.10-0.10.0-SNAPSHOT-sources.jar
has changed.
  Output file /opt/samza/samza-kv-rocksdb/build/libs/samza-kv-rocksdb_2.10-0.10.0-SNAPSHOT-sources.jar
has been removed.
:samza-kv-rocksdb_2.10:sourcesJar (Thread[Daemon,5,main]) completed. Took 0.019 secs.
:samza-kv-rocksdb_2.10:signArchives (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:signArchives
Skipping task ':samza-kv-rocksdb_2.10:signArchives' as task onlyIf is false.
:samza-kv-rocksdb_2.10:signArchives SKIPPED
:samza-kv-rocksdb_2.10:signArchives (Thread[Daemon,5,main]) completed. Took 0.003 secs.
:samza-kv-rocksdb_2.10:assemble (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:assemble
Skipping task ':samza-kv-rocksdb_2.10:assemble' as it has no actions.
:samza-kv-rocksdb_2.10:assemble (Thread[Daemon,5,main]) completed. Took 0.001 secs.
:samza-kv-rocksdb_2.10:compileTestJava (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:compileTestJava
Skipping task ':samza-kv-rocksdb_2.10:compileTestJava' as it has no source files.
:samza-kv-rocksdb_2.10:compileTestJava UP-TO-DATE
:samza-kv-rocksdb_2.10:compileTestJava (Thread[Daemon,5,main]) completed. Took 0.001 secs.
:samza-kv-rocksdb_2.10:compileTestScala (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:compileTestScala
Executing task ':samza-kv-rocksdb_2.10:compileTestScala' (up-to-date check took 0.068 secs)
due to:
  Output file /opt/samza/samza-kv-rocksdb/build/classes/test has changed.
  Output file /opt/samza/samza-kv-rocksdb/build/classes/test/org/apache/samza/storage/kv/TestRocksDbKeyValueStore.class
has been removed.
  Output file /opt/samza/samza-kv-rocksdb/build/classes/test/org/apache/samza/storage/kv/TestRocksDbKeyValueStore$$anonfun$testTTL$2.class
has been removed.
Compiling with Ant scalac task.
[ant:scalac] Compiling 1 source file to /opt/samza/samza-kv-rocksdb/build/classes/test
[ant:scalac] Element '/opt/samza/samza-kv-rocksdb/build/resources/main' does not exist.
:samza-kv-rocksdb_2.10:compileTestScala (Thread[Daemon,5,main]) completed. Took 1.158 secs.
:samza-kv-rocksdb_2.10:processTestResources (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:processTestResources
Skipping task ':samza-kv-rocksdb_2.10:processTestResources' as it has no source files.
:samza-kv-rocksdb_2.10:processTestResources UP-TO-DATE
:samza-kv-rocksdb_2.10:processTestResources (Thread[Daemon,5,main]) completed. Took 0.003
secs.
:samza-kv-rocksdb_2.10:testClasses (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:testClasses
Skipping task ':samza-kv-rocksdb_2.10:testClasses' as it has no actions.
:samza-kv-rocksdb_2.10:testClasses (Thread[Daemon,5,main]) completed. Took 0.001 secs.
:samza-kv-rocksdb_2.10:test (Thread[Daemon,5,main]) started.
:samza-kv-rocksdb_2.10:test
Executing task ':samza-kv-rocksdb_2.10:test' (up-to-date check took 0.11 secs) due to:
  No history is available.
Starting process 'Gradle Test Executor 16'. Working directory: /opt/samza/samza-kv-rocksdb
Command: /usr/lib/jvm/java-7-openjdk-amd64/bin/java -Djava.security.manager=jarjar.org.gradle.process.internal.child.BootstrapSecurityManager
-Dfile.encoding=UTF-8 -ea -cp /root/.gradle/caches/2.0/workerMain/gradle-worker.jar jarjar.org.gradle.process.internal.launcher.GradleWorkerMain
Successfully started process 'Gradle Test Executor 16'
Gradle Test Executor 16 started executing tests.

org.apache.samza.storage.kv.TestRocksDbKeyValueStore > testTTL STANDARD_ERROR
    SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
/usr/lib/jvm/java-7-openjdk-amd64/bin/java: symbol lookup error: /tmp/librocksdbjni1871304830042440508..so:
undefined symbol: clock_gettime
:samza-kv-rocksdb_2.10:test FAILED
:samza-kv-rocksdb_2.10:test (Thread[Daemon,5,main]) completed. Took 2.36 secs.

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':samza-kv-rocksdb_2.10:test'.
> Process 'Gradle Test Executor 16' finished with non-zero exit value 127

Thanks,

    Jordi

-----Mensaje original-----
De: Yan Fang [mailto:yanfang724@gmail.com] 
Enviado el: martes, 04 de agosto de 2015 0:29
Para: dev@samza.apache.org
Asunto: Re: testThreadInterruptInOperationSleep on clean installation

Hi Jordi,

Those two exceptions seems like caused by the race condition. Since I can not reproduce it,
can you try 1) kill all the GradleDaemon and GradleWrapperMain processes when you rerun the
build ? 2) can you try to run those two tests in the eclipse (or some other ways) without
gradle ? I doubt both are related to the gradle.

Thanks,

Fang, Yan
yanfang724@gmail.com

On Sun, Aug 2, 2015 at 11:45 PM, Jordi Blasi Uribarri <jblasi@nextel.es>
wrote:

> Hi,
>
> I am trying to do a clean installation of Samza on a newly installed 
> Debian 7.8 box. Following the stpes I collected in a previous 0.8.2 
> Samza installation I have performed the following steps:
>
> apt-get install openjdk-7-jdk openjdk-7-jre git maven curl vi 
> /root/.bashrc export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
> export CLASSPATH=$CLASSPATH:/usr/share/java
>
> cd /opt
> git clone http://git-wip-us.apache.org/repos/asf/samza.git
> cd samza
> ./gradlew clean build
>
>
> Every time I run it I get an error on the test the script runs:
> testThreadInterruptInOperationSleep
> va.lang.AssertionError: expected:<1> but was:<0>
>        at org.junit.Assert.fail(Assert.java:91)
>        at org.junit.Assert.failNotEquals(Assert.java:645)
>        at org.junit.Assert.assertEquals(Assert.java:126)
>        at org.junit.Assert.assertEquals(Assert.java:470)
>        at org.junit.Assert.assertEquals(Assert.java:454)
>        at
> org.apache.samza.util.TestExponentialSleepStrategy.testThreadInterruptInOperationSleep(TestExponentialSleepStrategy.scala:158)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
>        at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
>        at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
>        at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
>        at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:76)
>        at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
>        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
>        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
>        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
>        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
>        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
>        at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
>        at
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:86)
>        at
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:49)
>        at
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:69)
>        at
> org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:48)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
>        at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
>        at
> org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
>        at
> org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
>        at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
>        at
> org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:105)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
>        at
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
>        at
> org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:355)
>        at
> org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:64)
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:745)
>
> I am also seeing on the report the following errors:
>
>
> Exception in thread "SAMZA-filereader-" java.lang.Error:
> java.io.FileNotFoundException: empty.txt (No existe el fichero o el
> directorio)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1151)
>
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:615)
>
>        at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.io.FileNotFoundException: empty.txt (No existe el 
> fichero o el directorio)
>
>        at java.io.RandomAccessFile.open(Native Method)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
>
>        at
> org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> n(FileReaderSystemConsumer.scala:121)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1145)
>
>        ... 2 more
>
> Exception in thread "SAMZA-filereader-" java.lang.Error:
> java.io.FileNotFoundException: twoEnter.txt (No existe el fichero o el
> directorio)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1151)
>
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:615)
>
>        at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.io.FileNotFoundException: twoEnter.txt (No existe el 
> fichero o el directorio)
>
>        at java.io.RandomAccessFile.open(Native Method)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
>
>        at
> org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> n(FileReaderSystemConsumer.scala:121)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1145)
>
>        ... 2 more
>
> Exception in thread "SAMZA-filereader-" java.lang.Error:
> java.io.FileNotFoundException: noEnter.txt (No existe el fichero o el
> directorio)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1151)
>
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:615)
>
>        at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.io.FileNotFoundException: noEnter.txt (No existe el 
> fichero o el directorio)
>
>        at java.io.RandomAccessFile.open(Native Method)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
>
>        at
> org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> n(FileReaderSystemConsumer.scala:121)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1145)
>
>        ... 2 more
>
> Exception in thread "SAMZA-filereader-" java.lang.Error:
> java.io.FileNotFoundException: moreEnter.txt (No existe el fichero o 
> el
> directorio)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1151)
>
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:615)
>
>        at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.io.FileNotFoundException: moreEnter.txt (No existe el 
> fichero o el directorio)
>
>        at java.io.RandomAccessFile.open(Native Method)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
>
>        at
> org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> n(FileReaderSystemConsumer.scala:121)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1145)
>
>        ... 2 more
>
> Exception in thread "SAMZA-filereader-" java.lang.Error:
> java.io.FileNotFoundException: oneEnter.txt (No existe el fichero o el
> directorio)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1151)
>
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:615)
>
>        at java.lang.Thread.run(Thread.java:745)
>
> Caused by: java.io.FileNotFoundException: oneEnter.txt (No existe el 
> fichero o el directorio)
>
>        at java.io.RandomAccessFile.open(Native Method)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
>
>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
>
>        at
> org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.ru
> n(FileReaderSystemConsumer.scala:121)
>
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1145)
>
>        ... 2 more
>
> What I am missing? Thanks in advance.
>
> Bye
>
>                 Jordi
> ________________________________
> Jordi Blasi Uribarri
> Área I+D+i
>
> jblasi@nextel.es
> Oficina Bilbao
>
> [http://www.nextel.es/wp-content/uploads/Firma_Nextel_2015.png]
>
Mime
View raw message