beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Bingham (JIRA)" <>
Subject [jira] [Created] (BEAM-2438) Need option to run pipeline without stable unique names
Date Sun, 11 Jun 2017 15:27:18 GMT
Jonathan Bingham created BEAM-2438:

             Summary: Need option to run pipeline without stable unique names
                 Key: BEAM-2438
             Project: Beam
          Issue Type: Bug
          Components: beam-model-runner-api
            Reporter: Jonathan Bingham
            Assignee: Kenneth Knowles
            Priority: Critical

When a PTransform does not have a stable unique name, the python DirectRunner raises a RuntimeError
that prevents pipeline execution. In the Java SDK, this is a warning by default, which allows
the pipeline to run.

RuntimeError: Transform XYZ does not have a stable unique label. This will prevent updating
of pipelines. To apply a transform with a specified label write pvalue | "label" >>

Documented way to change from RuntimeError to warning, or a documented workaround.

This is a blocker for my project, since I'm dynamically constructing a pipeline graph at runtime.
I'm porting from Java, where it works by default with just a warning message, to Python, where
it raises a runtime error and can't proceed.

This message was sent by Atlassian JIRA

View raw message