spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wenchen Fan (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-30125) Remove PostgreSQL dialect
Date Tue, 10 Dec 2019 17:26:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-30125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wenchen Fan resolved SPARK-30125.
---------------------------------
    Fix Version/s: 3.0.0
       Resolution: Fixed

Issue resolved by pull request 26763
[https://github.com/apache/spark/pull/26763]

> Remove PostgreSQL dialect
> -------------------------
>
>                 Key: SPARK-30125
>                 URL: https://issues.apache.org/jira/browse/SPARK-30125
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Yuanjian Li
>            Assignee: Yuanjian Li
>            Priority: Major
>             Fix For: 3.0.0
>
>
> As the discussion in [http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-PostgreSQL-dialect-td28417.html],
we need to remove PostgreSQL dialect form code base for several reasons:
> 1. The current approach makes the codebase complicated and hard to maintain.
> 2. Fully migrating PostgreSQL workloads to Spark SQL is not our focus for now.
>  
> Curently we have 3 features under PostgreSQL dialect:
> 1. SPARK-27931: when casting string to boolean, `t`, `tr`, `tru`, `yes`, .. are also
allowed as true string.
> 2. SPARK-29364: `date - date`  returns interval in Spark (SQL standard behavior), but
return int in PostgreSQL
> 3. SPARK-28395: `int / int` returns double in Spark, but returns int in PostgreSQL. (there
is no standard)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message