beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Groh (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (BEAM-819) The DirectRunner can complete before reporting the results of all ModelEnforcements
Date Tue, 11 Apr 2017 17:27:42 GMT

     [ https://issues.apache.org/jira/browse/BEAM-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Thomas Groh reassigned BEAM-819:
--------------------------------

    Assignee:     (was: Thomas Groh)

> The DirectRunner can complete before reporting the results of all ModelEnforcements
> -----------------------------------------------------------------------------------
>
>                 Key: BEAM-819
>                 URL: https://issues.apache.org/jira/browse/BEAM-819
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-direct
>            Reporter: Thomas Groh
>
> The termination condition in the ExecutorServiceParallelExecutor.MonitorRunnable checks
to see if the evaluation context is done, among other things. Due to the signatures of ModelEnforcement,
output is committed before ModelEnforcement runs to ensure that the enforcement has access
to the final elements. If the transform that performs ModelEnforcement completes, and all
PTransforms are done, the pipeline can shutdown before model enforcement fails.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message