spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (JIRA)" <>
Subject [jira] [Created] (SPARK-23691) Use sql_conf util in PySpark tests where possible
Date Thu, 15 Mar 2018 04:16:00 GMT
Hyukjin Kwon created SPARK-23691:

             Summary: Use sql_conf util in PySpark tests where possible
                 Key: SPARK-23691
             Project: Spark
          Issue Type: Improvement
          Components: PySpark
    Affects Versions: 2.3.0
            Reporter: Hyukjin Kwon added an useful

def sql_conf(self, pairs):

to allow configuration set/unset within a block:

with self.sql_conf({"spark.blah.blah.blah", "blah"})
    # test codes

It would be nicer if we use it. 

Note that there look already few places affecting tests without restoring the original value
back in unittest classes.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message