spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lakshmi Rajagopalan <laks...@indix.com>
Subject Deep Equals support on Maptype
Date Mon, 26 Sep 2016 10:09:58 GMT
Hi,

 We wanted to extend the existing '===' on Column to support deep equals on
Maps.


Currently it checks for == which does referential checks for maps.

https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala#L420

Is there any possible work around for this? I have a patch in my mind to
fix Equals for MapType also. Any thoughts?

Thanks,
Lakshmi Rajagopalan

Mime
View raw message