Return-Path: 
 <dev-return-47760-apmail-kafka-dev-archive=kafka.apache.org@kafka.apache.org>
X-Original-To: apmail-kafka-dev-archive@www.apache.org
Delivered-To: apmail-kafka-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id BEAD2188BE
	for <apmail-kafka-dev-archive@www.apache.org>;
 Mon, 18 Jan 2016 20:15:40 +0000 (UTC)
Received: (qmail 52352 invoked by uid 500); 18 Jan 2016 20:15:40 -0000
Delivered-To: apmail-kafka-dev-archive@kafka.apache.org
Received: (qmail 52227 invoked by uid 500); 18 Jan 2016 20:15:40 -0000
Mailing-List: contact dev-help@kafka.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@kafka.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@kafka.apache.org>
List-Post: <mailto:dev@kafka.apache.org>
List-Id: <dev.kafka.apache.org>
Reply-To: dev@kafka.apache.org
Delivered-To: mailing list dev@kafka.apache.org
Received: (qmail 52061 invoked by uid 99); 18 Jan 2016 20:15:39 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 18 Jan 2016 20:15:39 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id CFC712C1F58
	for <dev@kafka.apache.org>; Mon, 18 Jan 2016 20:15:39 +0000 (UTC)
Date: Mon, 18 Jan 2016 20:15:39 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: dev@kafka.apache.org
Message-ID: <JIRA.12930010.1452734839000.142279.1453148139849@Atlassian.JIRA>
In-Reply-To: <JIRA.12930010.1452734839000@Atlassian.JIRA>
References: <JIRA.12930010.1452734839000@Atlassian.JIRA>
 <JIRA.12930010.1452734839037@arcas>
Subject: [jira] [Commented] (KAFKA-3104) Windowed Stream Aggregation
 Implementation
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


    [ https://issues.apache.org/jira/browse/KAFKA-3104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15105775#comment-15105775 ] 

ASF GitHub Bot commented on KAFKA-3104:
---------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/kafka/pull/781


> Windowed Stream Aggregation Implementation
> ------------------------------------------
>
>                 Key: KAFKA-3104
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3104
>             Project: Kafka
>          Issue Type: Sub-task
>            Reporter: Guozhang Wang
>            Assignee: Guozhang Wang
>             Fix For: 0.9.1.0
>
>
> Proposed approach:
> 1. Add a K-V store with format <key, window> : <agg-value> with Windowed<K> ser-de and <T> ser-de.
> 2. Upon receiving a record forwarded from the upstream processor:
> 2.1. First get the mapping window(s) from the context timestamp.
> 2.2. For each window, first try fetch from the store, if not exist call initialValue().
> 2.2. Only call add(..), and never call remove(..)
> 2.3. Forward the aggregate value with key Windowed<agg-key> and value Change<agg-value>.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)