beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Luke Cwik (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner
Date Tue, 30 Aug 2016 15:49:21 GMT

     [ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Luke Cwik updated BEAM-604:
---------------------------
    Issue Type: Improvement  (was: Bug)

> Use Watermark Check Streaming Job Finish in TestDataflowRunner 
> ---------------------------------------------------------------
>
>                 Key: BEAM-604
>                 URL: https://issues.apache.org/jira/browse/BEAM-604
>             Project: Beam
>          Issue Type: Improvement
>            Reporter: Mark Liu
>            Assignee: Mark Liu
>
> Currently, streaming job with bounded input can't be terminated automatically and TestDataflowRunner
can't handle this case. Need to update TestDataflowRunner so that streaming integration test
such as WindowedWordCountIT can run with it.
> Implementation:
> Query watermark of each step and wait until all watermarks set to MAX then cancel the
job.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message