spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wenchen Fan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-25454) Division between operands with negative scale can cause precision loss
Date Thu, 27 Sep 2018 01:03:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-25454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wenchen Fan updated SPARK-25454:
--------------------------------
    Fix Version/s:     (was: 2.3.3)
                       (was: 2.4.0)

> Division between operands with negative scale can cause precision loss
> ----------------------------------------------------------------------
>
>                 Key: SPARK-25454
>                 URL: https://issues.apache.org/jira/browse/SPARK-25454
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.3.0, 2.3.1
>            Reporter: Marco Gaido
>            Priority: Major
>
> The issue was originally reported by [~bersprockets] here: https://issues.apache.org/jira/browse/SPARK-22036?focusedCommentId=16618104&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16618104.
> The problem consist in a precision loss when the second operand of the division is a
decimal with a negative scale. It was present also before 2.3 but it was harder to reproduce:
you had to do something like {{lit(BigDecimal(100e6))}}, while now this can happen more frequently
with SQL constants.
> The problem is that our logic is taken from Hive and SQLServer where decimals with negative
scales are not allowed. We might also consider enforcing this too in 3.0 eventually. Meanwhile
we can fix the logic for computing the result type for a division.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message