flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aljoscha Krettek <aljos...@apache.org>
Subject Re: Configuring UDFs with user defined parameters
Date Sun, 06 Sep 2015 20:51:22 GMT
I think the possibility to use a Configuration object is a legacy from the
past where the API was a bit closer to how Hadoop works. In my opinion this
is not necessary anymore since User Code objects can just contain
configuration settings in fields.

The feature for the Storm API could probably be implemented by just storing
a Configuration object in the user code function.


On Sun, 6 Sep 2015 at 18:29 Matthias J. Sax <mjsax@apache.org> wrote:

> Hi,
> I observed, that DataSet API offers a nice way to configure
> UDF-Operators by providing the method ".withParameters()". However,
> Streaming API does not offer such a method.
> For a current PR (https://github.com/apache/flink/pull/1046) this
> feature would be very helpful.
> As a workaround, PR #1046 can also be finished using JobConfiguration.
> However, this seems to be somewhat unnatural. Furthermore, I think that
> this feature would be nice to have in general. What do you think about it?
> If we introduce this feature, we can either open a new JIRA of just
> include it into the current PR #1046. What would be the better way?
> -Matthias

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message