flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bashar Abdul-Jawad <amma...@gmail.com>
Subject Flink checkStateMappingCompleteness doesn't include UserDefinedOperatorIDs
Date Wed, 18 Mar 2020 04:18:20 GMT
StateAssignmentOperation.checkStateMappingCompleteness
<https://github.com/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/StateAssignmentOperation.java#L555>
doesn't
check for UserDefinedOperatorIDs (specified using setUidHash), causing the
exception:

 java.lang.IllegalStateException: There is no operator for the state {}

to be thrown when a savepoint can't be mapped to an ExecutionJobVertex,
even when the operator hash is explicitly specified.

I believe this logic should be extended to also include
UserDefinedOperatorIDs as so:

for (ExecutionJobVertex executionJobVertex : tasks) {
  allOperatorIDs.addAll(executionJobVertex.getOperatorIDs());
  allOperatorIDs.addAll(executionJobVertex.getUserDefinedOperatorIDs());
}

I filed https://issues.apache.org/jira/browse/FLINK-16638, please let me
know if I am missing something here.

Mime
View raw message