spark-reviews mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From feynmanliang <>
Subject [GitHub] spark pull request: [SPARK-9940][MLlib] Add hyperparameters to Loc...
Date Wed, 29 Jul 2015 23:23:45 GMT
GitHub user feynmanliang reopened a pull request:

    [SPARK-9940][MLlib] Add hyperparameters to LocalLDAModel save/load

    @jkbradley @MechCoder 
    Resolves blocking issue for SPARK-6793. Please review after #7705 is merged.

You can merge this pull request into a Git repository by running:

    $ git pull SPARK-9940-localSaveLoad

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #7757
commit aead650cc2f36c8781b70ef6b377395440688837
Author: Feynman Liang <>
Date:   2015-07-16T23:50:03Z

    Range slice, in-place update, reduce transposes

commit c62cb1e46d3950226251bad3cfb3cb18ab012e50
Author: Feynman Liang <>
Date:   2015-07-17T00:28:58Z

    Outer product for stats, revert Range slicing

commit 7f62a55a43544b6eca31afaf0fe8f4d0abbaa3b8
Author: Feynman Liang <>
Date:   2015-07-17T08:16:50Z


commit cd521d61ce40d174971590973b536c9edd72f469
Author: Feynman Liang <>
Date:   2015-07-18T20:25:27Z

    Refactor methods into companion class

commit f8adc483647ab1dd45cbe44b6a3015fc58e6ece4
Author: Feynman Liang <>
Date:   2015-07-18T20:34:43Z

    Add logPerplexity, refactor variationalBound into a method

commit 11e7c336ac4f1ecbd2b7eac6b5231e55fc705067
Author: Feynman Liang <>
Date:   2015-07-27T23:20:16Z

    Merge remote-tracking branch 'apache/master' into SPARK-6793-perplexity
    * apache/master: (218 commits)
      [SPARK-9385] [PYSPARK] Enable PEP8 but disable installing pylint.
      [SPARK-4352] [YARN] [WIP] Incorporate locality preferences in dynamic allocation requests
      [SPARK-9385] [HOT-FIX] [PYSPARK] Comment out Python style check
      [SPARK-8988] [YARN] Make sure driver log links appear in secure cluste…
      [SPARK-9355][SQL] Remove InternalRow.get generic getter call in columnar cache code
      [SPARK-9378] [SQL] Fixes test case "CTAS with serde"
      [SPARK-9349] [SQL] UDAF cleanup
      Closes #7690 since it has been merged into branch-1.4.
      [HOTFIX] Disable pylint since it is failing master.
      [SPARK-9369][SQL] Support IntervalType in UnsafeRow
      [SPARK-9351] [SQL] remove literals from grouping expressions in Aggregate
      [SPARK-7423] [MLLIB] Modify ClassificationModel and Probabalistic model to use Vector.argmax
      [SPARK-9376] [SQL] use a seed in RandomDataGeneratorSuite
      [SPARK-9366] use task's stageAttemptId in TaskEnd event
      [SPARK-9364] Fix array out of bounds and use-after-free bugs in UnsafeExternalSorter
      Pregel example type fix
      [SPARK-4176] [SQL] Supports decimal types with precision > 18 in Parquet
      [SPARK-8405] [DOC] Add how to view logs on Web UI when yarn log aggregation is enabled
      [SPARK-7943] [SPARK-8105] [SPARK-8435] [SPARK-8714] [SPARK-8561] Fixes multi-database
      [SPARK-9371][SQL] fix the support for special chars in column names for hive context

commit 7415e96d906f7f934620d1575ca0ba8532015b8c
Author: Feynman Liang <>
Date:   2015-07-28T01:28:31Z

    Pick changes from big PR

commit 2f049ce8242ab44e95c9c64eacdcdbb9e934c782
Author: Feynman Liang <>
Date:   2015-07-28T01:34:14Z

    Fix failing save/load tests

commit 4f171f75f198e45eaed2a9bf189f0fb8091f64ce
Author: Feynman Liang <>
Date:   2015-07-28T01:37:17Z

    Fix indendation

commit 4362daa0fb7d00618cbef7f332bb13e919320fe2
Author: Feynman Liang <>
Date:   2015-07-28T01:45:23Z

    Organize imports

commit 1cbb67d1fc441f7c48e0c7f42048489ae6bda522
Author: Feynman Liang <>
Date:   2015-07-28T02:31:39Z

    Fix access modifier bug

commit 998c03e1a80eba708ed6be6aa7ce995a62c07f41
Author: Feynman Liang <>
Date:   2015-07-28T02:32:52Z

    Fix style

commit 5a327a05b94dff0719c58166b17ca474040ffd2b
Author: Feynman Liang <>
Date:   2015-07-29T18:16:50Z

    Code review quick fixes

commit afecb4687345810d4b64390a8bf074bd6c0dc427
Author: Feynman Liang <>
Date:   2015-07-29T18:37:34Z

    Fix regression bug in sstats accumulator

commit 06d02d9e7213aa62f1a8f85dacc81ea2c3516fdf
Author: Feynman Liang <>
Date:   2015-07-29T21:05:48Z

    Remove deprecated LocalLDAModel constructor

commit a27591457d9c6370fac044b2a7af7108a0449d31
Author: Feynman Liang <>
Date:   2015-07-29T21:09:58Z

    Prevent empty counts calls to variationalInference

commit 2f452a44f4171892ea11c32932d1e28b52df63d8
Author: Feynman Liang <>
Date:   2015-07-29T21:19:28Z

    Remove auxillary DistributedLDAModel constructor

commit 17f70009128d8949d9cd8cbe1d0e45a21b03b191
Author: Feynman Liang <>
Date:   2015-07-29T22:03:04Z

    Documentation typo fixes

commit 8381da6bb517d71eaac09a9e9d8cb94bf2a6856b
Author: Feynman Liang <>
Date:   2015-07-29T22:26:54Z

    Code review comments

commit 6da2c99de37b21fe29e7dde3344918eaff827f55
Author: Feynman Liang <>
Date:   2015-07-29T22:30:10Z

    Remove get* from LDAModel public API

commit e81823a2c8b85f501966f1cc44ce0a5e17803769
Author: Feynman Liang <>
Date:   2015-07-29T21:47:07Z

    Add hyperparams to LocalLDAModel save/load

commit 4988c52697c55decf64d73d1918427155f3549a6
Author: Feynman Liang <>
Date:   2015-07-29T22:33:22Z

    Fix tests after changing LDAModel public API


If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at or file a JIRA ticket
with INFRA.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message