flink-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vasiliki Kalavri <vasilikikala...@gmail.com>
Subject CompactingHashTable question
Date Tue, 15 Sep 2015 15:41:24 GMT
Hello to my squirrels,

I ran into an NPE for some iterations code and it looks like what's
described in FLINK-2443 <https://issues.apache.org/jira/browse/FLINK-2443>.
I'm trying to understand the problem and I could really use your help :)

So far, it seems that the exception is caused by a null value returned by
CompactingHashTable.*getMatchFor*(PT probeSideRecord).

This method returns null in the following cases:
- when the hash table is "closed"
- when the segment is done
- if the serializer actually returns a null record

It seems that on the join/cogroup driver side there is no check or special
handling when the build side record is null, i.e. the null record is still
passed to the join function.
Is this correct and if not, what should the driver do in this case?

Thank you!

Cheers,
Vasia.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message