flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gábor Gévay <gga...@gmail.com>
Subject Adding flink-scala as a dependency to flink-streaming-core
Date Wed, 10 Jun 2015 12:12:35 GMT

I would like to ask if it would be OK if I added flink-scala as a
dependency to flink-streaming-core. An alternative would be to move
the Scala typeutils to flink-core (to where the Java typeutils are).
Why I need this:

While I am implementing the fast median calculation for windows as
part of my Google Summer of Code project, I am refactoring the way
sum, min, max, etc. are accessing the user-specified field
(https://github.com/apache/flink/pull/684). Currently both the logic
of their aggregators are duplicated for the different kinds of types
(tuple, pojo, array, Scala case class, simple), and also the field
access logic is duplicated across the different aggregators. In my
GSoC project I will implement some further methods (avg, variance,
etc.) that take the same kind of parameters as sum, min, etc., so it
will be neccassary to have the field access logic centralized (this is
the FieldAccessor class in the PR). It would be convenient if this
could also handle Scala case classes, for which CaseClassTypeInfo is
needed which is currently in flink-scala.

Best regards,

View raw message