beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Halperin (JIRA)" <>
Subject [jira] [Commented] (BEAM-1107) Display user names for steps in the Flink Web UI
Date Wed, 07 Dec 2016 22:58:59 GMT


Daniel Halperin commented on BEAM-1107:

Also copying [~aljoscha]'s response :)

I think we can get it down to "Data Source (ReadLines/Read)" (and similarly for other operators).
The problem is that the String parameter is not the correct way to set the name of the operator
but some other (admittedly weird) thing called "location name". To set the name we have to
call .name(String) on the created operator after creating it.

> Display user names for steps in the Flink Web UI
> ------------------------------------------------
>                 Key: BEAM-1107
>                 URL:
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Daniel Halperin
>            Assignee: Aljoscha Krettek
> [copying in-person / email discussion at Strata Singapore to JIRA]
> The FlinkBatchTransformTranslators use transform.getName() [1] -- this is the "SDK name"
for the transform.
> The "user name" for the transform is not available here, it is in fact on the TransformHierarchy.Node
as node.getFullName() [2].
> getFullName() is used some in Flink, but not when setting step names.
> I drafted a quick commit that sort of propagates the user names to the web UI (but only
for DataSource, and still too verbose:
> Before this change, the "ReadLines" step showed up as: "DataSource (at Read(CompressedSource)
> With this change, it shows up as "DataSource (at ReadLines/Read (org.apache.beam.runners.flink.translation.wrappers.SourceInputFormat))"
> which I think is closer. [I'd still like it to JUST be "ReadLines/Read" e.g.].
> Thoughts?
> [1]
> [2]

This message was sent by Atlassian JIRA

View raw message