beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-819) The DirectRunner can complete before reporting the results of all ModelEnforcements
Date Mon, 03 Apr 2017 17:13:41 GMT

    [ https://issues.apache.org/jira/browse/BEAM-819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953841#comment-15953841
] 

Daniel Halperin commented on BEAM-819:
--------------------------------------

Still an issue?

> The DirectRunner can complete before reporting the results of all ModelEnforcements
> -----------------------------------------------------------------------------------
>
>                 Key: BEAM-819
>                 URL: https://issues.apache.org/jira/browse/BEAM-819
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-direct
>            Reporter: Thomas Groh
>            Assignee: Thomas Groh
>
> The termination condition in the ExecutorServiceParallelExecutor.MonitorRunnable checks
to see if the evaluation context is done, among other things. Due to the signatures of ModelEnforcement,
output is committed before ModelEnforcement runs to ensure that the enforcement has access
to the final elements. If the transform that performs ModelEnforcement completes, and all
PTransforms are done, the pipeline can shutdown before model enforcement fails.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message