Mailing-List: contact issues-help@spark.apache.org; run by ezmlm
Precedence: bulk
Date: Mon, 19 Dec 2016 23:35:58 +0000 (UTC)
From: "Wayne Zhang (JIRA)" <jira@apache.org>
To: issues@spark.apache.org
Message-ID: <JIRA.13029291.1482190516000.558123.1482190558312@Atlassian.JIRA>
In-Reply-To: <JIRA.13029291.1482190516000@Atlassian.JIRA>
References: <JIRA.13029291.1482190516000@Atlassian.JIRA> <JIRA.13029291.1482190516874@arcas>
Subject: [jira] [Created] (SPARK-18929) Add Tweedie distribution in GLM
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Mon, 19 Dec 2016 23:35:59 -0000

Wayne Zhang created SPARK-18929:
-----------------------------------

             Summary: Add Tweedie distribution in GLM
                 Key: SPARK-18929
                 URL: https://issues.apache.org/jira/browse/SPARK-18929
             Project: Spark
          Issue Type: New Feature
          Components: ML
    Affects Versions: 2.0.2
            Reporter: Wayne Zhang


I propose to add the full Tweedie family into the GeneralizedLinearRegression model. The Tweedie family is characterized by a power variance function. Currently supported distributions such as Gaussian,  Poisson and Gamma families are a special case of the [Tweedie|https://en.wikipedia.org/wiki/Tweedie_distribution]. 

I propose to add support for the other distributions:
* compound Poisson: 1 < variancePower < 2. This one is widely used to model zero-inflated continuous distributions. 
* positive stable: variancePower > 2 and variancePower != 3. Used to model extreme values.
* inverse Gaussian: variancePower = 3.

 The Tweedie family is supported in most statistical packages such as R (statmod), SAS, h2o etc. 


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org