spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [spark] fuwhu opened a new pull request #26356: [SPARK-29707][SQL] Add configuration 'spark.sql.maxDataSourceScanMetadataStringLength'
Date Fri, 01 Nov 2019 08:52:21 GMT
fuwhu opened a new pull request #26356: [SPARK-29707][SQL] Add configuration 'spark.sql.maxDataSourceScanMetadataStringLength'
URL: https://github.com/apache/spark/pull/26356
 
 
   ### What changes were proposed in this pull request?
   Add configuration 'spark.sql.maxDataSourceScanMetadataStringLength' to set the max string
length of one metadata in DataSourceScanExec.
   
   
   
   ### Why are the changes needed?
   To make the max length of metadata string of `DataSourceScanExec` configurable, please
see [SPARK-29707](https://issues.apache.org/jira/browse/SPARK-29707) for details.
   
   
   ### Does this PR introduce any user-facing change?
   Yes, user can configure the parameter to get more information about data source scan metadata.
   
   
   ### How was this patch tested?
   Manual test.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message