Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E68BC172A5 for ; Wed, 5 Nov 2014 17:38:12 +0000 (UTC) Received: (qmail 53064 invoked by uid 500); 5 Nov 2014 17:38:12 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 53005 invoked by uid 500); 5 Nov 2014 17:38:12 -0000 Mailing-List: contact dev-help@flink.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.incubator.apache.org Delivered-To: mailing list dev@flink.incubator.apache.org Received: (qmail 52994 invoked by uid 99); 5 Nov 2014 17:38:12 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Nov 2014 17:38:12 +0000 X-ASF-Spam-Status: No, hits=-1998.4 required=5.0 tests=ALL_TRUSTED,HTML_MESSAGE,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 05 Nov 2014 17:37:50 +0000 Received: (qmail 52808 invoked by uid 99); 5 Nov 2014 17:37:48 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Nov 2014 17:37:48 +0000 Received: from localhost (HELO mail-wg0-f44.google.com) (127.0.0.1) (smtp-auth username gyfora, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Wed, 05 Nov 2014 17:37:48 +0000 Received: by mail-wg0-f44.google.com with SMTP id x12so1481131wgg.17 for ; Wed, 05 Nov 2014 09:37:46 -0800 (PST) MIME-Version: 1.0 X-Received: by 10.180.81.102 with SMTP id z6mr31806608wix.69.1415209066072; Wed, 05 Nov 2014 09:37:46 -0800 (PST) Received: by 10.27.1.216 with HTTP; Wed, 5 Nov 2014 09:37:46 -0800 (PST) Date: Wed, 5 Nov 2014 18:37:46 +0100 Message-ID: Subject: Streaming groupby and aggregation by field expressions From: =?UTF-8?Q?Gyula_F=C3=B3ra?= To: dev@flink.incubator.apache.org Content-Type: multipart/alternative; boundary=f46d04428fb4aa9072050720099a X-Virus-Checked: Checked by ClamAV on apache.org --f46d04428fb4aa9072050720099a Content-Type: text/plain; charset=UTF-8 Hey guys, Just a quick note on some upcoming API updates for the Streaming api. Now it will be possible to use field expressions for both grouping and aggregations in the streaming api. You can check it out here . Or in a concise form: DataStream counts = text.flatMap(new Tokenizer()).groupBy("word") .sum("frequency"); I will still do some more testing before it will be available in the master branch. I am also planning to extend aggregations to more fields at the same time like sum(1,2,2) or max("a","c"). Regards, Gyula --f46d04428fb4aa9072050720099a--