spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From zsxwing <>
Subject [GitHub] spark pull request #19687: [SPARK-19644][SQL]Clean up Scala reflection garba...
Date Wed, 08 Nov 2017 00:37:46 GMT
GitHub user zsxwing opened a pull request:

    [SPARK-19644][SQL]Clean up Scala reflection garbage after creating Encoder

    ## What changes were proposed in this pull request?
    Because of the memory leak issue in `scala.reflect.api.Types.TypeApi.<:<` (,
creating an encoder may leak memory.
    This PR adds `cleanUpReflectionObjects` to clean up these leaking objects for methods
calling `scala.reflect.api.Types.TypeApi.<:<`.
    ## How was this patch tested?
    The updated unit tests.

You can merge this pull request into a Git repository by running:

    $ git pull SPARK-19644

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #19687
commit c03811ff006058987fa8d5fb9f7d097b9acc9ac5
Author: Shixiong Zhu <>
Date:   2017-11-08T00:33:55Z

    Clean up Scala reflection garbage after creating Encoder



To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message