flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephan Ewen <se...@apache.org>
Subject Fixing the ExecutionConfig
Date Wed, 11 Nov 2015 10:59:56 GMT
Hi all!

The ExecutionConfig is a bit of a strange thing right now. It looks like it
became the place where everyone just put the stuff they want to somehow
push from the client to runtime, plus a random assortment of conflig flags.

As a result:

  - The ExecutionConfig is available in batch and streaming, but has a
number of fields that are very streaming specific, like the watermark
interval, etc.

  - Several fields that are purely pre-flight time relevant are in there,
like whether to use the closure cleaner, or whether to force Avro or Kryo
serializers for POJOs.

Any interest in cleaning this up? Because these messy classes simply grow
ever more messy unless we establish a proper definition of what its
concerns and non-concerns are...

Greetings,
Stephan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message