beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-1594) JOB_STATE_DRAINED should be terminal for waitUntilFinish()
Date Mon, 13 Mar 2017 18:26:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15922674#comment-15922674
] 

ASF GitHub Bot commented on BEAM-1594:
--------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/beam/pull/2146


> JOB_STATE_DRAINED should be terminal for waitUntilFinish()
> ----------------------------------------------------------
>
>                 Key: BEAM-1594
>                 URL: https://issues.apache.org/jira/browse/BEAM-1594
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-dataflow
>            Reporter: Eugene Kirpichov
>            Assignee: Eugene Kirpichov
>
> Dataflow runner supports pipeline draining for streaming pipelines, which stops consuming
input and waits for all watermarks to progress to infinity and then declares the pipeline
complete. When watermarks progress to infinity after a drain request, the Dataflow runner
will mark the job DRAINED (In the future, when watermarks progress to infinity without a drain
request, it will mark the job DONE instead). JOB_STATE_DRAINED is logically a terminal state
- no more data will be processed and the pipeline's resources are torn down - and waitUntilFinish()
should terminate if the job enters this state.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message