spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [spark] cloud-fan commented on a change in pull request #26595: [SPARK-29956][SQL] A literal number with an exponent should be parsed to Double
Date Tue, 26 Nov 2019 14:30:54 GMT
cloud-fan commented on a change in pull request #26595: [SPARK-29956][SQL] A literal number
with an exponent should be parsed to Double
URL: https://github.com/apache/spark/pull/26595#discussion_r350774439
 
 

 ##########
 File path: docs/sql-migration-guide.md
 ##########
 @@ -225,6 +225,8 @@ license: |
   - Since Spark 3.0, when casting string value to integral types, including tinyint, smallint,
int and bigint type, the leading and trailing white spaces(<= ACSII 32) will be trimmed
before convert to integral values, e.g. `cast(' 1 ' as int)` results `1`. In Spark version
2.4 and earlier, the result will be `null`.
 
   - Since Spark 3.0, when casting string value to date, timestamp and interval values, the
leading and trailing white spaces(<= ACSII 32) will be trimmed before casing, e.g. `cast('2019-10-10\t
as date)` results the date value `2019-10-10`. In Spark version 2.4 and earlier, only the
trailing space will be removed, thus, the result is `null`.
+  
+  - Since Spark 3.0, the scientific decimal literal(e.g. `1E2`) would be parsed as Double
while in Spark version 2.4 it's parsed as Decimal. To restore the behavior before Spark 3.0,
you can set `spark.sql.legacy.exponentLiteralAsDecimal.enabled` to `true`.
 
 Review comment:
   And please follow the style of other migration guides
   ```
   Since Spark 3.0, .... In Spark version 2.4 and earlier, ...
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message