beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Groh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1653) Error when using PubsubIO with the DirectRunner
Date Fri, 17 Mar 2017 22:43:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930846#comment-15930846
] 

Thomas Groh commented on BEAM-1653:
-----------------------------------

This should be fixed in HEAD. There are future changes to {{PubsubIO}} to make it more resilient
to runner behaviors.

> Error when using PubsubIO with the DirectRunner 
> ------------------------------------------------
>
>                 Key: BEAM-1653
>                 URL: https://issues.apache.org/jira/browse/BEAM-1653
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-direct, sdk-java-extensions
>    Affects Versions: 0.5.0
>            Reporter: FĂ©lix Mattrat
>            Assignee: Thomas Groh
>
> Reading a source with a `org.apache.beam.sdk.io.PubsubIO` and running the pipeline with
`DirectRunner` result in an error.
> The error occur usually after reading ~200 messages from pubsub at the moment where 
`PubsubIO` try to ack the messages. 
> The error:
> ```
> Exception in thread "main" java.lang.IllegalStateException: Cannot finalize a restored
checkpoint
>         at org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkState(Preconditions.java:174)
>         at org.apache.beam.sdk.io.PubsubUnboundedSource$PubsubCheckpoint.finalizeCheckpoint(PubsubUnboundedSource.java:293)
>         at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.finishRead(UnboundedReadEvaluatorFactory.java:205)
>         at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.processElement(UnboundedReadEvaluatorFactory.java:142)
>         at org.apache.beam.runners.direct.TransformExecutor.processElements(TransformExecutor.java:139)
>         at org.apache.beam.runners.direct.TransformExecutor.run(TransformExecutor.java:107)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> ```



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message