Mailing-List: contact dev-help@flink.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@flink.apache.org
Date: Wed, 3 Jun 2015 09:36:49 +0000 (UTC)
From: "Gabor Gevay (JIRA)" <jira@apache.org>
To: dev@flink.apache.org
Message-ID: <JIRA.12834979.1433324150000.7145.1433324209531@Atlassian.JIRA>
In-Reply-To: <JIRA.12834979.1433324150000@Atlassian.JIRA>
References: <JIRA.12834979.1433324150000@Atlassian.JIRA>
 <JIRA.12834979.1433324150790@arcas>
Subject: [jira] [Created] (FLINK-2142) GSoC project: Exact and Approximate
 Statistics for Data Streams and Windows
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Gabor Gevay created FLINK-2142:
----------------------------------

             Summary: GSoC project: Exact and Approximate Statistics for Data Streams and Windows
                 Key: FLINK-2142
                 URL: https://issues.apache.org/jira/browse/FLINK-2142
             Project: Flink
          Issue Type: New Feature
          Components: Streaming
            Reporter: Gabor Gevay
            Assignee: Gabor Gevay
            Priority: Minor


The goal of this project is to implement basic statistics of data streams and windows (like average, median, variance, correlation, etc.) in a computationally efficient manner. This involves designing custom preaggregators.

The exact calculation of some statistics (eg. frequencies, or the number of distinct elements) would require memory proportional to the number of elements in the input (the window or the entire stream). However, there are efficient algorithms and data structures using less memory for calculating the same statistics only approximately, with user-specified error bounds.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)