spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-25971) Ignore partition byte-size statistics in SQLQueryTestSuite
Date Thu, 08 Nov 2018 08:01:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-25971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-25971:
------------------------------------

    Assignee: Apache Spark

> Ignore partition byte-size statistics in SQLQueryTestSuite
> ----------------------------------------------------------
>
>                 Key: SPARK-25971
>                 URL: https://issues.apache.org/jira/browse/SPARK-25971
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.0
>            Reporter: Dongjoon Hyun
>            Assignee: Apache Spark
>            Priority: Minor
>
> Currently, `SQLQueryTestSuite` is sensitive in terms of the bytes of parquet files in
table partitions. If we change the default file format (from Parquet to ORC) or update the
metadata of them, the test case should be changed accordingly. This issue aims to make `SQLQueryTestSuite`
more robust by ignoring the partition byte statistics.
> {code}
> -Partition Statistics   1144 bytes, 2 rows
> +Partition Statistics   [not included in comparison] bytes, 2 rows
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message