Return-Path: X-Original-To: apmail-mahout-dev-archive@www.apache.org Delivered-To: apmail-mahout-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 764ED104F4 for ; Thu, 5 Dec 2013 05:20:42 +0000 (UTC) Received: (qmail 76743 invoked by uid 500); 5 Dec 2013 05:20:40 -0000 Delivered-To: apmail-mahout-dev-archive@mahout.apache.org Received: (qmail 76387 invoked by uid 500); 5 Dec 2013 05:20:39 -0000 Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mahout.apache.org Delivered-To: mailing list dev@mahout.apache.org Received: (qmail 75945 invoked by uid 99); 5 Dec 2013 05:20:36 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 05 Dec 2013 05:20:36 +0000 Date: Thu, 5 Dec 2013 05:20:36 +0000 (UTC) From: "Hudson (JIRA)" To: dev@mahout.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (MAHOUT-1368) Convert OnlineSummarizer to use the new TDigest MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/MAHOUT-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13839835#comment-13839835 ] Hudson commented on MAHOUT-1368: -------------------------------- SUCCESS: Integrated in Mahout-Quality #2352 (See [https://builds.apache.org/job/Mahout-Quality/2352/]) MAHOUT-1368: Convert OnlineSummarizer to use the new TDigest (smarthi: rev 1547911) * /mahout/trunk/CHANGELOG * /mahout/trunk/examples/src/main/java/org/apache/mahout/clustering/streaming/tools/ClusterQualitySummarizer.java * /mahout/trunk/math/src/main/java/org/apache/mahout/math/stats/OnlineSummarizer.java * /mahout/trunk/math/src/test/java/org/apache/mahout/math/stats/OnlineSummarizerTest.java > Convert OnlineSummarizer to use the new TDigest > ----------------------------------------------- > > Key: MAHOUT-1368 > URL: https://issues.apache.org/jira/browse/MAHOUT-1368 > Project: Mahout > Issue Type: Bug > Reporter: Ted Dunning > Assignee: Suneel Marthi > Fix For: 0.9 > > Attachments: MAHOUT-1368.patch > > > The new TDigest provides better accuracy for quartile estimation as well as producing any other quantile you might like. The current quartile estimation of the OnlineSummarizer fails for highly skewed distributions and can't really be extended to provide other quantiles. The TDigest handles all of this. -- This message was sent by Atlassian JIRA (v6.1#6144)