spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wayne Zhang (JIRA)" <>
Subject [jira] [Created] (SPARK-18929) Add Tweedie distribution in GLM
Date Mon, 19 Dec 2016 23:35:58 GMT
Wayne Zhang created SPARK-18929:

             Summary: Add Tweedie distribution in GLM
                 Key: SPARK-18929
             Project: Spark
          Issue Type: New Feature
          Components: ML
    Affects Versions: 2.0.2
            Reporter: Wayne Zhang

I propose to add the full Tweedie family into the GeneralizedLinearRegression model. The Tweedie
family is characterized by a power variance function. Currently supported distributions such
as Gaussian,  Poisson and Gamma families are a special case of the [Tweedie|].

I propose to add support for the other distributions:
* compound Poisson: 1 < variancePower < 2. This one is widely used to model zero-inflated
continuous distributions. 
* positive stable: variancePower > 2 and variancePower != 3. Used to model extreme values.
* inverse Gaussian: variancePower = 3.

 The Tweedie family is supported in most statistical packages such as R (statmod), SAS, h2o

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message