beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Félix Mattrat (JIRA) <j...@apache.org>
Subject [jira] [Created] (BEAM-1653) Error when using PubsubIO with the DirectRunner
Date Wed, 08 Mar 2017 15:39:37 GMT
Félix Mattrat created BEAM-1653:
-----------------------------------

             Summary: Error when using PubsubIO with the DirectRunner 
                 Key: BEAM-1653
                 URL: https://issues.apache.org/jira/browse/BEAM-1653
             Project: Beam
          Issue Type: Bug
          Components: runner-direct, sdk-java-extensions
    Affects Versions: 0.5.0
            Reporter: Félix Mattrat
            Assignee: Thomas Groh


Reading a source with a `org.apache.beam.sdk.io.PubsubIO` and running the pipeline with `DirectRunner`
result in an error.

The error occur usually after reading ~200 messages from pubsub at the moment where  `PubsubIO`
try to ack the messages. 

The error:
```
Exception in thread "main" java.lang.IllegalStateException: Cannot finalize a restored checkpoint
        at org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkState(Preconditions.java:174)
        at org.apache.beam.sdk.io.PubsubUnboundedSource$PubsubCheckpoint.finalizeCheckpoint(PubsubUnboundedSource.java:293)
        at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.finishRead(UnboundedReadEvaluatorFactory.java:205)
        at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.processElement(UnboundedReadEvaluatorFactory.java:142)
        at org.apache.beam.runners.direct.TransformExecutor.processElements(TransformExecutor.java:139)
        at org.apache.beam.runners.direct.TransformExecutor.run(TransformExecutor.java:107)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
```



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message