spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From RussellSpitzer <...@git.apache.org>
Subject [GitHub] spark pull request #22576: [SPARK-25560][SQL] Allow FunctionInjection in Spa...
Date Fri, 28 Sep 2018 02:05:34 GMT
GitHub user RussellSpitzer opened a pull request:

    https://github.com/apache/spark/pull/22576

    [SPARK-25560][SQL] Allow FunctionInjection in SparkExtensions

    This allows an implementer of Spark Session Extensions to utilize a
    method "injectFunction" which will add a new function to the default
    Spark Session Catalogue.
    
    ## What changes were proposed in this pull request?
    
    Adds a new function to SparkSessionExtensions 
    
        def injectFunction(functionDescription: FunctionDescription)
    
    Where function description is a new type
    
      type FunctionDescription = (FunctionIdentifier, FunctionBuilder)
    
    The functions are loaded in BaseSessionBuilder when the function registry does not have
a parent
    function registry to get loaded from.
    
    ## How was this patch tested?
    
    New unit tests are added for the extension in SparkSessionExtensionSuite


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/RussellSpitzer/spark SPARK-25560

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/22576.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #22576
    
----
commit 5fdca38e21448ccf2f24a68fbadc221c87195581
Author: Russell Spitzer <russell.spitzer@...>
Date:   2018-09-28T01:58:21Z

    [SPARK-25560][SQL] Allow FunctionInjection in SparkExtensions
    
    This allows an implementer of Spark Session Extensions to utilize a
    method "injectFunction" which will add a new function to the default
    Spark Session Catalogue.

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org


Mime
View raw message