samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jordi Blasi Uribarri <jbl...@nextel.es>
Subject RE: testThreadInterruptInOperationSleep on clean installation
Date Tue, 04 Aug 2015 12:32:22 GMT
It has compiled perfectly now. 

Thanks for your help.

Jordi

-----Mensaje original-----
De: Navina Ramesh [mailto:nramesh@linkedin.com.INVALID] 
Enviado el: martes, 04 de agosto de 2015 9:07
Para: dev@samza.apache.org
Asunto: Re: testThreadInterruptInOperationSleep on clean installation

Hi Jordi,
Looks like you are hitting this error:
org.apache.samza.storage.kv.TestRocksDbKeyValueStore > testTTL STANDARD_ERROR
    SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
*/usr/lib/jvm/java-7-openjdk-amd64/bin/java: symbol lookup error:
/tmp/librocksdbjni1871304830042440508..so: undefined symbol: clock_gettime*

This is a known issue when building Samza on Linux and is being tracked in
SAMZA-747 <https://issues.apache.org/jira/browse/SAMZA-747>. This is blocked on the
RocksDB 3.11.1 release and hence, a blocker for the Samza 0.10 release as well.

If the build is just failing on this test, try to comment out testTTL in TestRocksDBKeyValueStore.scala
and give it a try. I hope it solves your build issues.

Thanks!
Navina

On Mon, Aug 3, 2015 at 11:53 PM, Jordi Blasi Uribarri <jblasi@nextel.es>
wrote:

> Hi,
>
> There was no gradle process and I have tried to run it increasing the 
> log level. It seems that the test that is failing is the one related to Rocksdb.
>
> How can I run the test on eclipse?
>
> This is what I get:
>
> Executing task ':samza-kv-rocksdb_2.10:sourcesJar' (up-to-date check 
> took
> 0.005 secs) due to:
>   Output file
> /opt/samza/samza-kv-rocksdb/build/libs/samza-kv-rocksdb_2.10-0.10.0-SN
> APSHOT-sources.jar
> has changed.
>   Output file
> /opt/samza/samza-kv-rocksdb/build/libs/samza-kv-rocksdb_2.10-0.10.0-SN
> APSHOT-sources.jar
> has been removed.
> :samza-kv-rocksdb_2.10:sourcesJar (Thread[Daemon,5,main]) completed. 
> Took
> 0.019 secs.
> :samza-kv-rocksdb_2.10:signArchives (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:signArchives
> Skipping task ':samza-kv-rocksdb_2.10:signArchives' as task onlyIf is 
> false.
> :samza-kv-rocksdb_2.10:signArchives SKIPPED 
> :samza-kv-rocksdb_2.10:signArchives (Thread[Daemon,5,main]) completed.
> Took 0.003 secs.
> :samza-kv-rocksdb_2.10:assemble (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:assemble
> Skipping task ':samza-kv-rocksdb_2.10:assemble' as it has no actions.
> :samza-kv-rocksdb_2.10:assemble (Thread[Daemon,5,main]) completed. 
> Took
> 0.001 secs.
> :samza-kv-rocksdb_2.10:compileTestJava (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:compileTestJava
> Skipping task ':samza-kv-rocksdb_2.10:compileTestJava' as it has no 
> source files.
> :samza-kv-rocksdb_2.10:compileTestJava UP-TO-DATE 
> :samza-kv-rocksdb_2.10:compileTestJava (Thread[Daemon,5,main]) completed.
> Took 0.001 secs.
> :samza-kv-rocksdb_2.10:compileTestScala (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:compileTestScala
> Executing task ':samza-kv-rocksdb_2.10:compileTestScala' (up-to-date 
> check took 0.068 secs) due to:
>   Output file /opt/samza/samza-kv-rocksdb/build/classes/test has changed.
>   Output file
> /opt/samza/samza-kv-rocksdb/build/classes/test/org/apache/samza/storag
> e/kv/TestRocksDbKeyValueStore.class
> has been removed.
>   Output file
> /opt/samza/samza-kv-rocksdb/build/classes/test/org/apache/samza/storag
> e/kv/TestRocksDbKeyValueStore$$anonfun$testTTL$2.class
> has been removed.
> Compiling with Ant scalac task.
> [ant:scalac] Compiling 1 source file to 
> /opt/samza/samza-kv-rocksdb/build/classes/test
> [ant:scalac] Element '/opt/samza/samza-kv-rocksdb/build/resources/main'
> does not exist.
> :samza-kv-rocksdb_2.10:compileTestScala (Thread[Daemon,5,main]) completed.
> Took 1.158 secs.
> :samza-kv-rocksdb_2.10:processTestResources (Thread[Daemon,5,main]) 
> started.
> :samza-kv-rocksdb_2.10:processTestResources
> Skipping task ':samza-kv-rocksdb_2.10:processTestResources' as it has 
> no source files.
> :samza-kv-rocksdb_2.10:processTestResources UP-TO-DATE 
> :samza-kv-rocksdb_2.10:processTestResources (Thread[Daemon,5,main]) 
> completed. Took 0.003 secs.
> :samza-kv-rocksdb_2.10:testClasses (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:testClasses
> Skipping task ':samza-kv-rocksdb_2.10:testClasses' as it has no actions.
> :samza-kv-rocksdb_2.10:testClasses (Thread[Daemon,5,main]) completed. 
> Took
> 0.001 secs.
> :samza-kv-rocksdb_2.10:test (Thread[Daemon,5,main]) started.
> :samza-kv-rocksdb_2.10:test
> Executing task ':samza-kv-rocksdb_2.10:test' (up-to-date check took 
> 0.11
> secs) due to:
>   No history is available.
> Starting process 'Gradle Test Executor 16'. Working directory:
> /opt/samza/samza-kv-rocksdb Command:
> /usr/lib/jvm/java-7-openjdk-amd64/bin/java
> -Djava.security.manager=jarjar.org.gradle.process.internal.child.Boots
> trapSecurityManager
> -Dfile.encoding=UTF-8 -ea -cp
> /root/.gradle/caches/2.0/workerMain/gradle-worker.jar
> jarjar.org.gradle.process.internal.launcher.GradleWorkerMain
> Successfully started process 'Gradle Test Executor 16'
> Gradle Test Executor 16 started executing tests.
>
> org.apache.samza.storage.kv.TestRocksDbKeyValueStore > testTTL 
> STANDARD_ERROR
>     SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
>     SLF4J: Defaulting to no-operation (NOP) logger implementation
>     SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for 
> further details.
> /usr/lib/jvm/java-7-openjdk-amd64/bin/java: symbol lookup error:
> /tmp/librocksdbjni1871304830042440508..so: undefined symbol: 
> clock_gettime :samza-kv-rocksdb_2.10:test FAILED 
> :samza-kv-rocksdb_2.10:test (Thread[Daemon,5,main]) completed. Took 
> 2.36 secs.
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Execution failed for task ':samza-kv-rocksdb_2.10:test'.
> > Process 'Gradle Test Executor 16' finished with non-zero exit value 
> > 127
>
> Thanks,
>
>     Jordi
>
> -----Mensaje original-----
> De: Yan Fang [mailto:yanfang724@gmail.com] Enviado el: martes, 04 de 
> agosto de 2015 0:29
> Para: dev@samza.apache.org
> Asunto: Re: testThreadInterruptInOperationSleep on clean installation
>
> Hi Jordi,
>
> Those two exceptions seems like caused by the race condition. Since I 
> can not reproduce it, can you try 1) kill all the GradleDaemon and 
> GradleWrapperMain processes when you rerun the build ? 2) can you try 
> to run those two tests in the eclipse (or some other ways) without 
> gradle ? I doubt both are related to the gradle.
>
> Thanks,
>
> Fang, Yan
> yanfang724@gmail.com
>
> On Sun, Aug 2, 2015 at 11:45 PM, Jordi Blasi Uribarri 
> <jblasi@nextel.es>
> wrote:
>
> > Hi,
> >
> > I am trying to do a clean installation of Samza on a newly installed 
> > Debian 7.8 box. Following the stpes I collected in a previous 0.8.2 
> > Samza installation I have performed the following steps:
> >
> > apt-get install openjdk-7-jdk openjdk-7-jre git maven curl vi 
> > /root/.bashrc export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
> > export CLASSPATH=$CLASSPATH:/usr/share/java
> >
> > cd /opt
> > git clone http://git-wip-us.apache.org/repos/asf/samza.git
> > cd samza
> > ./gradlew clean build
> >
> >
> > Every time I run it I get an error on the test the script runs:
> > testThreadInterruptInOperationSleep
> > va.lang.AssertionError: expected:<1> but was:<0>
> >        at org.junit.Assert.fail(Assert.java:91)
> >        at org.junit.Assert.failNotEquals(Assert.java:645)
> >        at org.junit.Assert.assertEquals(Assert.java:126)
> >        at org.junit.Assert.assertEquals(Assert.java:470)
> >        at org.junit.Assert.assertEquals(Assert.java:454)
> >        at
> >
> org.apache.samza.util.TestExponentialSleepStrategy.testThreadInterrupt
> InOperationSleep(TestExponentialSleepStrategy.scala:158)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:57)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:43)
> >        at java.lang.reflect.Method.invoke(Method.java:606)
> >        at
> >
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkM
> ethod.java:44)
> >        at
> >
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCall
> able.java:15)
> >        at
> >
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMet
> hod.java:41)
> >        at
> >
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMeth
> od.java:20)
> >        at
> >
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunn
> er.java:76)
> >        at
> >
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunn
> er.java:50)
> >        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:193)
> >        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:52)
> >        at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:191)
> >        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:42)
> >        at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:184)
> >        at org.junit.runners.ParentRunner.run(ParentRunner.java:236)
> >        at
> >
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.run
> TestClass(JUnitTestClassExecuter.java:86)
> >        at
> >
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.exe
> cute(JUnitTestClassExecuter.java:49)
> >        at
> >
> org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.pr
> ocessTestClass(JUnitTestClassProcessor.java:69)
> >        at
> >
> org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processT
> estClass(SuiteTestClassProcessor.java:48)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:57)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:43)
> >        at java.lang.reflect.Method.invoke(Method.java:606)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDi
> spatch.java:35)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDi
> spatch.java:24)
> >        at
> >
> org.gradle.messaging.dispatch.ContextClassLoaderDispatch.dispatch(Cont
> extClassLoaderDispatch.java:32)
> >        at
> >
> org.gradle.messaging.dispatch.ProxyDispatchAdapter$DispatchingInvocati
> onHandler.invoke(ProxyDispatchAdapter.java:93)
> >        at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
> >        at
> >
> org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestCla
> ss(TestWorker.java:105)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
> ava:57)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccess
> orImpl.java:43)
> >        at java.lang.reflect.Method.invoke(Method.java:606)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDi
> spatch.java:35)
> >        at
> >
> org.gradle.messaging.dispatch.ReflectionDispatch.dispatch(ReflectionDi
> spatch.java:24)
> >        at
> >
> org.gradle.messaging.remote.internal.hub.MessageHub$Handler.run(Messag
> eHub.java:355)
> >        at
> >
> org.gradle.internal.concurrent.DefaultExecutorFactory$StoppableExecuto
> rImpl$1.run(DefaultExecutorFactory.java:64)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j
> ava:1145)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:615)
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > I am also seeing on the report the following errors:
> >
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: empty.txt (No existe el fichero o el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: empty.txt (No existe el 
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.
> > ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: twoEnter.txt (No existe el fichero o 
> > el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: twoEnter.txt (No existe el 
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.
> > ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: noEnter.txt (No existe el fichero o 
> > el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: noEnter.txt (No existe el 
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.
> > ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: moreEnter.txt (No existe el fichero o 
> > el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: moreEnter.txt (No existe 
> > el fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.
> > ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1145)
> >
> >        ... 2 more
> >
> > Exception in thread "SAMZA-filereader-" java.lang.Error:
> > java.io.FileNotFoundException: oneEnter.txt (No existe el fichero o 
> > el
> > directorio)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1151)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:615)
> >
> >        at java.lang.Thread.run(Thread.java:745)
> >
> > Caused by: java.io.FileNotFoundException: oneEnter.txt (No existe el 
> > fichero o el directorio)
> >
> >        at java.io.RandomAccessFile.open(Native Method)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:241)
> >
> >        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:122)
> >
> >        at
> > org.apache.samza.system.filereader.FileReaderSystemConsumer$$anon$1.
> > ru
> > n(FileReaderSystemConsumer.scala:121)
> >
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor
> > .j
> > ava:1145)
> >
> >        ... 2 more
> >
> > What I am missing? Thanks in advance.
> >
> > Bye
> >
> >                 Jordi
> > ________________________________
> > Jordi Blasi Uribarri
> > Área I+D+i
> >
> > jblasi@nextel.es
> > Oficina Bilbao
> >
> > [http://www.nextel.es/wp-content/uploads/Firma_Nextel_2015.png]
> >
>



--
Navina R.
Mime
View raw message