spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Li (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-23553) Tests should not assume the default value of `spark.sql.sources.default`
Date Fri, 16 Mar 2018 16:38:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-23553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiao Li resolved SPARK-23553.
-----------------------------
       Resolution: Fixed
         Assignee: Dongjoon Hyun
    Fix Version/s: 2.4.0
                   2.3.1

> Tests should not assume the default value of `spark.sql.sources.default`
> ------------------------------------------------------------------------
>
>                 Key: SPARK-23553
>                 URL: https://issues.apache.org/jira/browse/SPARK-23553
>             Project: Spark
>          Issue Type: Improvement
>          Components: Tests
>    Affects Versions: 2.3.0
>            Reporter: Dongjoon Hyun
>            Assignee: Dongjoon Hyun
>            Priority: Major
>             Fix For: 2.3.1, 2.4.0
>
>
> Currently, some tests have an assumption that `spark.sql.sources.default=parquet`. In
fact, that is a correct assumption, but that assumption makes it difficult to test new data
source format. This issue improves test suites more robust and makes it easy to test new data
sources. As an example, the PR will use `spark.sql.sources.default=orc` during reviews.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message