spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dilip Biswal (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-25416) ArrayPosition may return incorrect result when right expression is downcasted.
Date Wed, 12 Sep 2018 21:14:01 GMT
Dilip Biswal created SPARK-25416:
------------------------------------

             Summary: ArrayPosition may return incorrect result when right expression is downcasted.
                 Key: SPARK-25416
                 URL: https://issues.apache.org/jira/browse/SPARK-25416
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.4.0
            Reporter: Dilip Biswal


In ArrayPosition, we currently cast the right hand side expression to match the element type
of the left hand side Array. This may result in down casting and may return wrong result or
questionable result.

Example :
spark-sql> select array_position(array(1), 1.34);
1

spark-sql> select array_position(array(1), 'foo');
null

We should safely coerce both left and right hand side expressions.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message