Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2643C19520 for ; Thu, 28 Apr 2016 15:51:08 +0000 (UTC) Received: (qmail 52589 invoked by uid 500); 28 Apr 2016 15:51:07 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 52484 invoked by uid 500); 28 Apr 2016 15:51:07 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 52474 invoked by uid 99); 28 Apr 2016 15:51:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Apr 2016 15:51:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 0D7C2180233 for ; Thu, 28 Apr 2016 15:51:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id FQMoAKlliPve for ; Thu, 28 Apr 2016 15:51:06 +0000 (UTC) Received: from mail-lf0-f50.google.com (mail-lf0-f50.google.com [209.85.215.50]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id AD5DF5F23A for ; Thu, 28 Apr 2016 15:51:05 +0000 (UTC) Received: by mail-lf0-f50.google.com with SMTP id c126so100786007lfb.2 for ; Thu, 28 Apr 2016 08:51:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=PbkcdUOVvuiANki8/NkcgQRz/g2bsRvQH4R53+pP7ms=; b=DVm0Y/yUlQ5so65shhzysDsU03T4t7cnEzRQsV3wNNBDN/gjSfJZdV5mgm4tXs+NVF wSg+hsYwlz1vHaWwMGM/p1dklLkDdNnVrgHc7rfliPgHYd6Y1D3dl7l/cQksrlIJQgNu eT3czAnPi1D8qdQDneOH0tpmm/WzJLy+AHZlMmFCnwSMlomokUo3HmczN93YturBn5xK E+euOkxt6JhPXo0fVsC4gQaE7FCiox0Tl1pKNMnbhH8V8KZjT4Fyw1l2UStW4r+4Z53W 4/HKr582wV3UXmPyaZJISgmE5xfWbDwvE+yCfHPa7dHDMLKNRXhdhhOHjPtYgmYKHPet 55GA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=PbkcdUOVvuiANki8/NkcgQRz/g2bsRvQH4R53+pP7ms=; b=lqmI6pGj5rmBvoX1vX65fPhVVib/Y4rSt3tXv1p6WHrHgFBTFpinUxfndy19atHhIl 1FPrxafczNUPr+0SndyP/LR0E5fsQhUPckkIPnwJRN+cHoJUm3ZYmgAPWKIeWFi9kHaP AwZ/oDoosMWn/C2lKkxcqnUsVwLQ+cyMgfXyXCyC+kdvH9oIoQcB7gs5NjKyjPmjnQfk 8CKmoH8ngYbY4kZXTAd6S1H1yaHzCighe3ErTuZpMJ1a02xbI6TR3YdkXMvrN8r+iRPr nP7vhSwKgBTx+FFuthQ3jlUXqCLtsYHVJ0KQF22t6AJDpufbOPIlg2n/UFIHJTTLqjyO qNGA== X-Gm-Message-State: AOPr4FWlzxRSBKLf+wOZBAzriC47Y/jFITYWCEfbFIz0BGcRLihd54bdrwEzZIsl0Zm6riLn1f0vHW0ZqKRB+w== MIME-Version: 1.0 X-Received: by 10.112.50.107 with SMTP id b11mr6782844lbo.15.1461858659456; Thu, 28 Apr 2016 08:50:59 -0700 (PDT) Received: by 10.25.215.83 with HTTP; Thu, 28 Apr 2016 08:50:59 -0700 (PDT) In-Reply-To: <947E9838-FDE6-4C43-AD1E-7BCF39790A67@gmail.com> References: <947E9838-FDE6-4C43-AD1E-7BCF39790A67@gmail.com> Date: Thu, 28 Apr 2016 17:50:59 +0200 Message-ID: Subject: Re: aggregation problem From: Vasiliki Kalavri To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a11336c961be27305318d7eb2 --001a11336c961be27305318d7eb2 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Riccardo, can you please be a bit more specific? What do you mean by "it didn't work"? Did it crash? Did it give you a wrong value? Something else? -Vasia. On 28 April 2016 at 16:52, Riccardo Diomedi wrote: > Hi everybody > > In a DeltaIteration I have a DataSet>> where, at = a > certain point of the iteration, i need to count the total number of tuple= s > and the total number of elements in the HashSet of each tuple, and then > send both value to the ConvergenceCriterion function. > > Example: > > this is the content of my DataSet: > (*1*,2,*[2,3]*) > (*2*,1,*[3,4]*) > (*3*,2,[*4,5]*) > > i should have: > first count: *3* (1,2,3) > second count: *4* (2,3,4,5) > > i tried to iterate the dataset through a flatMap and exploit so an > aggregator, putting an HashSet into it(Aggregator), but it didn=E2=80=99t= work! > > Do you have any suggestion?? > > thanks > > Riccardo > --001a11336c961be27305318d7eb2 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Riccardo,

can you please be a bit more s= pecific? What do you mean by "it didn't work"? Did it crash? = Did it give you a wrong value? Something else?

-Vasia.

On 28 April 2016 at 16:52, Riccardo = Diomedi <riccardo.diomedi91@gmail.com> wrote:
=
Hi every= body

In a DeltaIteration I have a DataSet<Tuple3<K= , V, HashSet<K>>> where, at a certain point of the iteration, i= need to count the total number of tuples and the total number of elements = in the HashSet of each tuple, and then send both value to the ConvergenceCr= iterion function.

Example:

this is the content of my DataSet:
(1,2,[2,3])
(2,1,[3,4])
(3,2,[4,5])
=

i should have:
first count: 3 (1,2,3)<= /div>
second count: 4=C2=A0(2,3,4,5)

i = tried to iterate the dataset through a flatMap and exploit so an aggregator= , putting an HashSet into it(Aggregator), but it didn=E2=80=99t work!
=

Do you have any suggestion??

t= hanks=C2=A0

Riccardo

--001a11336c961be27305318d7eb2--