spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-23553) Tests should not assume the default value of `spark.sql.sources.default`
Date Thu, 01 Mar 2018 18:53:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-23553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382448#comment-16382448
] 

Apache Spark commented on SPARK-23553:
--------------------------------------

User 'dongjoon-hyun' has created a pull request for this issue:
https://github.com/apache/spark/pull/20705

> Tests should not assume the default value of `spark.sql.sources.default`
> ------------------------------------------------------------------------
>
>                 Key: SPARK-23553
>                 URL: https://issues.apache.org/jira/browse/SPARK-23553
>             Project: Spark
>          Issue Type: Improvement
>          Components: Tests
>    Affects Versions: 2.3.0
>            Reporter: Dongjoon Hyun
>            Priority: Major
>
> Currently, some tests have an assumption that `spark.sql.sources.default=parquet`. In
fact, that is a correct assumption, but that assumption makes it difficult to test new data
source format. This issue improves test suites more robust and makes it easy to test new data
sources. As an example, the PR will use `spark.sql.sources.default=orc` during reviews.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message