Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BCC65200BF7 for ; Mon, 9 Jan 2017 15:27:22 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id BB791160B3E; Mon, 9 Jan 2017 14:27:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id DC456160B3B for ; Mon, 9 Jan 2017 15:27:21 +0100 (CET) Received: (qmail 87703 invoked by uid 500); 9 Jan 2017 14:27:21 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 87693 invoked by uid 99); 9 Jan 2017 14:27:20 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 09 Jan 2017 14:27:20 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 544141A0651 for ; Mon, 9 Jan 2017 14:27:20 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.629 X-Spam-Level: ** X-Spam-Status: No, score=2.629 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id DDyqOfz6xeEk for ; Mon, 9 Jan 2017 14:27:19 +0000 (UTC) Received: from mail-ua0-f180.google.com (mail-ua0-f180.google.com [209.85.217.180]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 283065F4A6 for ; Mon, 9 Jan 2017 14:27:19 +0000 (UTC) Received: by mail-ua0-f180.google.com with SMTP id 35so28818802uak.1 for ; Mon, 09 Jan 2017 06:27:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=nwReTk4DDg7hCERmxSfIOKSgiOLqmJueDBS9/EY3S/4=; b=IIlqE8xg33dbtzlZgxTu5ZRE3aX21f9P9Dtk4CpBvzuR1/hihhFxihOdgrw32Q+vPg xRhsQIuvyj7aYDwWS+FIDzkSikaRuGzcV5k9xVBH0TmDUKBxYtAp+gfuoiu4SCQvRd1X hZ+IF/LiyqceALb1rDMvovkU86WMPffRCwdrM22jG4AhUsnRcovADn39MoQmUJ0He/a9 61Z3IdqxBmqQkGx4Fto1KvbWHFaKMZw5EjxMs4n4Ms7YuK8L5bvT9B5UcQD+RvE7zRPh y2VEAhZsogYQRv8+y1LLMoYqJcVeh2lfW3rQPSfVqywW4nmwPzNXE7dD8CfFWnqiCJ3j sn0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=nwReTk4DDg7hCERmxSfIOKSgiOLqmJueDBS9/EY3S/4=; b=E+eQywYHElTtDTkYggWXVnz/tlJbGtugYeFPkNZbPNF0XHLt0ksR2tPhQAB3s8lyIw RRs/HCF2EawSKTqSw0hyVt++1d8B3WNa348r7h6w5L6nGFEbNI8Cq6Rw5vDI2i+KwCAY dX+vWaYIza3BclQ122O3wJrotW/IHFoMOhxVCK9Ka615yTPTejBW+oe+cuuGNzNdulUa BnRLche0GDu6zd7emI0nOvrBK3NRGJMSsq8SkwqFoiGVZwqo3VM/qcD1zclWwSqlOtgL 10kJNmYP9nTyj1NpMD+s3s/D1osfKzDU0fpS1Sp36MDcuQwW2wz1QpphKmDe4MgJjODN I7Ew== X-Gm-Message-State: AIkVDXI4XO4Suc0XZxCaD8LJx6Xg1cjVUbDK3nMvz2S1CpVUmaZ0MAOoZJodZvBJtROcJpGLfbzbpQMsPtScmA== X-Received: by 10.176.67.193 with SMTP id l59mr7903384ual.0.1483972033252; Mon, 09 Jan 2017 06:27:13 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: tao xiao Date: Mon, 09 Jan 2017 14:27:02 +0000 Message-ID: Subject: Re: window function outputs two different values To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a114bd270e611fd0545aa298f archived-at: Mon, 09 Jan 2017 14:27:22 -0000 --001a114bd270e611fd0545aa298f Content-Type: text/plain; charset=UTF-8 Hi team, any suggestions on below topic? I have a requirement that wants to output two different values from a time window reduce function. Here is basic workflow 1. fetch data from Kafka 2. flow the data to a event session window. kafka source -> keyBy -> session window -> reduce 3. inside the reduce function, count the number of data and also emit the data itself to another operator for further processing As the reduce function can only emit the count, I want to know how to also emit the data as well? On Sat, 7 Jan 2017 at 20:30 tao xiao wrote: > Hi team, > > I have a requirement that wants to output two different values from a time > window reduce function. Here is basic workflow > > 1. fetch data from Kafka > 2. flow the data to a event session window. kafka source -> keyBy -> > session window -> reduce > 3. inside the reduce function, count the number of data and also emit the > data itself to another operator for further processing > > As the reduce function can only emit the count, I want to know how to also > emit the data as well? > > --001a114bd270e611fd0545aa298f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi team,

any suggestions on below topic= ?

=
I have a requ= irement that wants to output two different values from a time window reduce= function. Here is basic workflow

1. fetch data from Kafka
2. flow the data to a event session window. kafka= source -> keyBy -> session window -> reduce
3. inside the reduce function, count the number of data and also e= mit the data itself to another operator for further processing

As= the reduce function can only emit the count, I want to know how to also em= it the data as well?

=


On Sat, 7 Jan 2017 at 20:30 tao xiao <xiaotao183@gmail.com> wrote:
= Hi team,

I have a requirement that wants to output two different valu= es from a time window reduce function. Here is basic workflow

1. = fetch data from Kafka
2. flow the data to a e= vent session window. kafka source -> keyBy -> session window -> re= duce
3. inside the reduce function, count the= number of data and also emit the data itself to another operator for furth= er processing

<= div class=3D"gmail_msg">As the reduce function can only emit the count, I w= ant to know how to also emit the data as well?

--001a114bd270e611fd0545aa298f--