From dev-return-5926-archive-asf-public=cust-asf.ponee.io@edgent.apache.org Thu Mar 22 18:06:35 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 5482C180676 for ; Thu, 22 Mar 2018 18:06:34 +0100 (CET) Received: (qmail 44397 invoked by uid 500); 22 Mar 2018 17:06:33 -0000 Mailing-List: contact dev-help@edgent.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@edgent.apache.org Delivered-To: mailing list dev@edgent.apache.org Received: (qmail 44380 invoked by uid 99); 22 Mar 2018 17:06:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 22 Mar 2018 17:06:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 4B05A1A051F for ; Thu, 22 Mar 2018 17:06:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.12 X-Spam-Level: X-Spam-Status: No, score=-0.12 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, KAM_SHORT=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id x6dH48IFITj1 for ; Thu, 22 Mar 2018 17:06:30 +0000 (UTC) Received: from mail-ua0-f173.google.com (mail-ua0-f173.google.com [209.85.217.173]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 409285FDF9 for ; Thu, 22 Mar 2018 17:06:30 +0000 (UTC) Received: by mail-ua0-f173.google.com with SMTP id c14so6035490uak.7 for ; Thu, 22 Mar 2018 10:06:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:subject:date:references :to:in-reply-to:message-id; bh=Qabzj+v9P7Dt3J74RmjJmfUbCnq5SQ2OVaEuwNgmwkI=; b=KOUcRUjIc6S4n0uCG7p3tAdvahy7BLNNPxE+0WU3YIAYbnT45snMf4BIHNoPYR2nh4 dMZRe+WQ2QNhJXMu6jUPTJfP01BXCFUa2aawqGNHjdBC9N/J5+WMqNXmeZmoHqF0d6n5 6p2N7pdPMjEe62ahA7pg0Jb0x7qQ+TlKXjtjfinGwFxGwrqqrGPUA2celwVFYLyHOXfu JK+LLAypf0zs/5FWwPx6WoRuAad0fVHGCgjXgaE4qt6ZdzasH0ZzPOqLW4ibPJFUNHIO XiqMdusdhv2ITD8QCQe7JTGaHav9Tjek6x8fs8Me+Oo4A8mMK6FrwC+2qxJbOmnuNv7C qHLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version :subject:date:references:to:in-reply-to:message-id; bh=Qabzj+v9P7Dt3J74RmjJmfUbCnq5SQ2OVaEuwNgmwkI=; b=ju1uweRde9S3b90uVu1M7HSXlcwymGUKQWajSb1MdbH02eOMLNIXUMBOm+YYLhyv2J J6XeR8O5lYEk+KF4Pu4Ri7wzLA+gsfUUaRxFTCiW0iYpCC8LOXuDbybBnq7b4ANLKL3B R9xXEVVOBDpSzitSsI9TdpsD7YmvvOolHGW/J69MT1Nf/meDDrPZ0oU171+o36G3pPbu Qrr9PKAmCgb7phsG4RcfozsGMHvx00LziTdnfqUN0oYx1e/ToAmJeGQd3aVYTJSUhokk TzrxlvgsaV64kfXYaAOu0H0ZG07lMhUnbAr2mLyE4EiDmzzcXdJhc6QqyDGZzhRaF2qI mXNg== X-Gm-Message-State: AElRT7GuTX8CwIZeewhogwvCvjkRmPo6uVT8uXrSlEG33Ze+gHXEAcTP o8K4uxk5n8MhKVE3cukavK/EweBZ X-Google-Smtp-Source: AG47ELvcEMOXqrwmyAWjuZGzbDSAop+DWvu37BoTCkbGpnAbA4QyB/xx3JljLEwb0GmNAwWjytQ05w== X-Received: by 10.176.27.87 with SMTP id n23mr15800646uai.113.1521738383550; Thu, 22 Mar 2018 10:06:23 -0700 (PDT) Received: from ?IPv6:2601:347:101:1c3:cfc:c10:1e35:13e4? ([2601:347:101:1c3:cfc:c10:1e35:13e4]) by smtp.gmail.com with ESMTPSA id d36sm1767294uai.32.2018.03.22.10.06.22 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 22 Mar 2018 10:06:22 -0700 (PDT) From: Dale LaBossiere Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: [disscuss] make TStream support groupBy operator? Date: Thu, 22 Mar 2018 13:06:21 -0400 References: <53852417-0D83-4AB7-AD28-F59BD4FBEB1E@c-ware.de> To: dev@edgent.apache.org In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3445.5.20) Hi, (I=E2=80=99ve been in my first month of retirement, yeah it would = be helpful if other original Edgent developers chimed in) Edgent provides count or time based Windows of tuples. A window = inherently supports multiple independently managed partitions by a key. = Continuous or batch aggregations can be performed on each partition. See TStream.last() and TWindow. Additionally, see = edgent.analytics.math3.* in particular the javadoc for = edgent.analytics.math3.Aggregations. Hope that helps. =E2=80=94 Dale > On Mar 20, 2018, at 5:28 AM, vino yang wrote: >=20 > Hi Chris, >=20 > My background is BigData (MapReduce, Spark, Flink, Kafka Stream) those = data > processing frameworks all provide the groupBy / keyBy operation and > aggregation operator. It comes from traditional RDBMS. Edgent like a = single > JVM's Flink / Kafka Stream works on edges(gateway or IoT). > They are similar with each other in some ways. >=20 > Vino yang. > Thanks! >=20 > 2018-03-20 17:05 GMT+08:00 Christofer Dutz = : >=20 >> Hi Vino, >>=20 >> unfortunately I can't contribute any opinion on this as I don't yet >> understand the consequences. >> I know that in an asynchronous event processing system some = operations >> that might be useful have to be sacrificed for the sake of = asynchonisity. >>=20 >> For me Kafka Stream sort of feeling like the cloud-brother of Edgent, = it >> does seem to support groupBy. >>=20 >> Would be really cool if some of the formerly active people could at = least >> leave some comments on questions like this. You don't have to = actually work >> on things, but giving us new guys some guidance would be awesome. >>=20 >> I don't want to ruin thing you built over years, just because I'm not = that >> into the topic ... yet. >>=20 >> Chris >>=20 >>=20 >>=20 >>=20 >> =EF=BB=BFAm 16.03.18, 13:02 schrieb "Christofer Dutz" = : >>=20 >> I'm currently at a conference, so I can't be as responsive as I = used >> to be ... All will be back to normal next Tuesday ;-) >>=20 >> Chris >>=20 >> Outlook for Android herunterladen >>=20 >> ________________________________ >> From: vino yang >> Sent: Friday, March 16, 2018 2:26:10 AM >> To: dev@edgent.apache.org >> Subject: Re: [disscuss] make TStream support groupBy operator? >>=20 >> Hi all, >>=20 >> Anyone can give some opinion? Chris ? I think we should support = some >> reduce >> operation(aggregation function, such as max / avg / min sum) for = both >> stream and windowed stream, these features based on the keyBy or >> groupBy >> operation. >>=20 >> Vino yang >> Thanks! >>=20 >> 2018-03-13 12:52 GMT+08:00 vino yang : >>=20 >>> Hi guys, >>>=20 >>> Does Edgent current support groupBy operator? >>>=20 >>> Vino yang >>> Thanks. >>>=20 >>=20 >>=20 >>=20