spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marco Gaido (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.
Date Wed, 14 Nov 2018 11:36:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-26054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marco Gaido updated SPARK-26054:
--------------------------------
    Affects Version/s:     (was: 2.4.0)
                       2.2.0

> Creating a computed column applying the spark sql rounding on a column of type decimal
affects the orginal column as well.
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-26054
>                 URL: https://issues.apache.org/jira/browse/SPARK-26054
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.2.0
>            Reporter: Jaya Krishna
>            Priority: Minor
>         Attachments: sparksql-rounding.png
>
>
> When a computed column that rounds the value is added to a data frame, it is affecting
the value of the original column as well. The behavior depends on the database column type
- If it is either float or double, the result is as expected - the original column will have
its own formatting and the computed column will be rounded as per the rounding definition
specified for it. However if the column type in the database is decimal, then Spark SQL is
applying the rounding even to the original column. Attached image has the spark sql code that
shows the issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message