spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <>
Subject [jira] [Commented] (SPARK-23553) Tests should not assume the default value of `spark.sql.sources.default`
Date Thu, 01 Mar 2018 18:53:00 GMT


Apache Spark commented on SPARK-23553:

User 'dongjoon-hyun' has created a pull request for this issue:

> Tests should not assume the default value of `spark.sql.sources.default`
> ------------------------------------------------------------------------
>                 Key: SPARK-23553
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Tests
>    Affects Versions: 2.3.0
>            Reporter: Dongjoon Hyun
>            Priority: Major
> Currently, some tests have an assumption that `spark.sql.sources.default=parquet`. In
fact, that is a correct assumption, but that assumption makes it difficult to test new data
source format. This issue improves test suites more robust and makes it easy to test new data
sources. As an example, the PR will use `spark.sql.sources.default=orc` during reviews.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message