flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jared Stehler <jared.steh...@intellifylearning.com>
Subject Best practices for assigning operator UIDs
Date Sun, 09 Jul 2017 16:35:50 GMT
I have some confusion around how best to assign UIDs to operators. The documentation states
simply that they are important, but stops short of recommending what if any stateful information
should go into the name. For example, if the same code is used to create two separate job
graphs, should the operator UIDs contain information specific to each job instance?

Example: for a kafka source, should the UID contain the subscribed topic name / pattern?

Example: if I have a custom mapping function which reshapes a JSON field based on an expression,
should that expression (or a hash thereof) be contained in that operator’s UID?

Basically, is the UID similar to overriding hashcode and equals for POJOs, or is it more like
overriding serializableVersionUID?

Jared Stehler
Chief Architect - Intellify Learning
o: 617.701.6330 x703

View raw message