beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (BEAM-2958) Expose a top level user agent PipelineOption which can be communicated to external services
Date Tue, 03 Oct 2017 18:48:00 GMT

    [ https://issues.apache.org/jira/browse/BEAM-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190137#comment-16190137
] 

ASF GitHub Bot commented on BEAM-2958:
--------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/beam/pull/3915


> Expose a top level user agent PipelineOption which can be communicated to external services
> -------------------------------------------------------------------------------------------
>
>                 Key: BEAM-2958
>                 URL: https://issues.apache.org/jira/browse/BEAM-2958
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-apex, runner-dataflow, runner-direct, runner-flink, runner-gearpump,
runner-jstorm, runner-mapreduce, runner-spark, runner-tez, sdk-java-core, sdk-java-gcp, sdk-py-core
>            Reporter: Luke Cwik
>            Assignee: Daniel Oliveira
>            Priority: Minor
>
> This concept is used by Bigtable and Dataflow service to specify what version of the
SDK is being used and is currently available through ReleaseInfo as a static property.
> The Dataflow distribution attempts to override this but is unable to propagate this user
agent to dependent modules cleanly. Having dependent modules get the user agent from a PipelineOption
would make it possible for a runner to modify the user agent during execution to be able to
identify its flavor.
> It seems likely that Flink/Spark/... would like to modify the user agent as well for
the same purpose.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message