beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré (JIRA) <j...@apache.org>
Subject [jira] [Commented] (BEAM-1829) MQTT message compression not working on Rapsberry Pi
Date Thu, 30 Mar 2017 04:16:42 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948398#comment-15948398
] 

Jean-Baptiste Onofré commented on BEAM-1829:
--------------------------------------------

By the way, the {{MqttIO}} doesn't explicitly define {{snappy}} dependency as it doesn't
use it directly. So, {{snappy}} comes as a transitive dependency of the {{beam-sdks-java-core}}.
So it means we have to update in the SDK and be careful on the side effects.

> MQTT message compression not working on Rapsberry Pi
> ----------------------------------------------------
>
>                 Key: BEAM-1829
>                 URL: https://issues.apache.org/jira/browse/BEAM-1829
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-extensions
>    Affects Versions: 0.6.0
>            Reporter: Vassil Kolarov
>            Assignee: Jean-Baptiste Onofré
>              Labels: MQTT, Snappy
>
> Most probably due to this bug: https://github.com/xerial/snappy-java/issues/147, the
following exception is raised, when running on Raspberry Pi:
> Exception in thread "main" java.lang.UnsatisfiedLinkError: /root/~/tmp/snappy-1.1.2-3c6134d1-26c5-4fb0-b6c9-669d4848d15b-libsnappyjava.so:
/root/~/tmp/snappy-1.1.2-3c6134d1-26c5-4fb0-b6c9-669d4848d15b-libsn
> appyjava.so: cannot open shared object file: No such file or directory
>         at java.lang.ClassLoader$NativeLibrary.load(Native Method)
>         at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1929)
>         at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1814)
>         at java.lang.Runtime.load0(Runtime.java:809)
>         at java.lang.System.load(System.java:1083)
>         at org.xerial.snappy.SnappyLoader.loadNativeLibrary(SnappyLoader.java:174)
>         at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:152)
>         at org.xerial.snappy.Snappy.<clinit>(Snappy.java:46)
>         at org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:97)
>         at org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:89)
>         at org.xerial.snappy.SnappyOutputStream.<init>(SnappyOutputStream.java:79)
>         at org.apache.beam.sdk.util.SerializableUtils.serializeToByteArray(SerializableUtils.java:48)
>         at org.apache.beam.sdk.util.SerializableUtils.ensureSerializable(SerializableUtils.java:83)
>         at org.apache.beam.sdk.io.Read$Unbounded.<init>(Read.java:141)
>         at org.apache.beam.sdk.io.Read$Unbounded.<init>(Read.java:136)
>         at org.apache.beam.sdk.io.Read.from(Read.java:56)
>         at org.apache.beam.sdk.io.mqtt.MqttIO$Read.expand(MqttIO.java:274)
>         at org.apache.beam.sdk.io.mqtt.MqttIO$Read.expand(MqttIO.java:221)
>         at org.apache.beam.sdk.runners.PipelineRunner.apply(PipelineRunner.java:76)
>         at org.apache.beam.runners.direct.DirectRunner.apply(DirectRunner.java:296)
>         at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:388)
>         at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:302)
>         at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:47)
>         at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:152)
>         at org.blah.beam.MqttPipeline.main(MqttPipeline.java:37)
> Increasing the snappy version to 1.1.4 will probably fix the issue.
> Best regards,
> Vassil



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message