Mailing-List: contact reviews-help@spark.apache.org; run by ezmlm
Precedence: bulk
From: mpjlu <git@git.apache.org>
To: reviews@spark.apache.org
Reply-To: reviews@spark.apache.org
Message-ID: <git-pr-18868-spark@git.apache.org>
Subject: [GitHub] spark pull request #18868: [SPARK-21638][ML]Fix RF/GBT Warning message error
Content-Type: text/plain
Date: Mon,  7 Aug 2017 08:17:04 +0000 (UTC)
archived-at: Mon, 07 Aug 2017 08:17:06 -0000

GitHub user mpjlu opened a pull request:

    https://github.com/apache/spark/pull/18868

    [SPARK-21638][ML]Fix RF/GBT Warning message error

    ## What changes were proposed in this pull request?
    
    When train RF model, there are many warning messages like this:
    
    > WARN  RandomForest: Tree learning is using approximately 268492800 bytes per iteration, which exceeds requested limit maxMemoryUsage=268435456. This allows splitting 2622 nodes in this iteration.
    
    This warning message is unnecessary and the data is not accurate.
    
    Actually, if all the nodes cannot split in one iteration, it will show this warning. For most of the case, all the nodes cannot split just in one iteration, so for most of the case, it will show this warning for each iteration.
    
    ## How was this patch tested?
    The existing UT


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mpjlu/spark fixRFwarning

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/18868.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #18868
    
----
commit f15f35e53115babd48357ec256f81e92e3480a6e
Author: Peng Meng <peng.meng@intel.com>
Date:   2017-08-07T08:05:24Z

    fix RF warning

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org