spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Li (JIRA)" <>
Subject [jira] [Commented] (SPARK-22722) Test Coverage for Type Coercion Compatibility
Date Tue, 12 Dec 2017 23:03:00 GMT


Xiao Li commented on SPARK-22722:

We need to run the same test cases in Hive. Thus, please ensure the queries you added can
be executed in Hive with very trivial changes. 

> Test Coverage for Type Coercion Compatibility
> ---------------------------------------------
>                 Key: SPARK-22722
>                 URL:
>             Project: Spark
>          Issue Type: Umbrella
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: Xiao Li
>            Assignee: Yuming Wang
> Hive compatibility is pretty important for the users who run or migrate both Hive and
Spark SQL. 
> We plan to add a SQLConf for type coercion compatibility (spark.sql.typeCoercion.mode).
Users can choose Spark's native mode (default) or Hive mode (hive). 
> Before we deliver the Hive compatibility mode, we plan to write a set of test cases that
can be easily run in both Spark and Hive sides. We can easily compare whether they are the
same or not. When new typeCoercion rules are added, we also can easily track the changes.
These test cases can also be backported to the previous Spark versions for determining the
changes we made. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message