spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "assaf.mendelson" <assaf.mendel...@rsa.com>
Subject how does isDistinct work on expressions
Date Sun, 13 Nov 2016 11:03:06 GMT
Hi,
I am trying to understand how aggregate functions are implemented internally.
I see that the expression is wrapped using toAggregateExpression using isDistinct.
I can't figure out where the code that makes the data distinct is located. I am trying to
figure out how the input data is converted into a distinct version.
Thanks,
                Assaf.




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/how-does-isDistinct-work-on-expressions-tp19836.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
Mime
View raw message