spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gatorsmile <>
Subject [GitHub] spark pull request #18853: [SPARK-21646][SQL] Add new type coercion to compa...
Date Wed, 06 Dec 2017 21:19:45 GMT
Github user gatorsmile commented on a diff in the pull request:
    --- Diff: docs/ ---
    @@ -1490,6 +1490,16 @@ that these options will be deprecated in future release as more
optimizations ar
           Configures the number of partitions to use when shuffling data for joins or aggregations.
    +  <tr>
    +    <td><code>spark.sql.typeCoercion.mode</code></td>
    +    <td><code>default</code></td>
    +    <td>
    +      The <code>default</code> type coercion mode was used in spark prior
to 2.3.0, and so it
    +      continues to be the default to avoid breaking behavior. However, it has logical
    +      inconsistencies. The <code>hive</code> mode is preferred for most new
applications, though
    +      it may require additional manual casting.
    --- End diff --
    > Since Spark 2.3, the <code>hive</code> mode is introduced for Hive compatiblity.
Spark SQL has its native type cocersion mode, which is enabled by default.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message