Return-Path: X-Original-To: apmail-gearpump-user-archive@minotaur.apache.org Delivered-To: apmail-gearpump-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F36F719B03 for ; Sat, 23 Apr 2016 17:37:52 +0000 (UTC) Received: (qmail 55825 invoked by uid 500); 23 Apr 2016 17:37:52 -0000 Delivered-To: apmail-gearpump-user-archive@gearpump.apache.org Received: (qmail 55788 invoked by uid 500); 23 Apr 2016 17:37:52 -0000 Mailing-List: contact user-help@gearpump.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@gearpump.incubator.apache.org Delivered-To: mailing list user@gearpump.incubator.apache.org Received: (qmail 55778 invoked by uid 99); 23 Apr 2016 17:37:52 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 23 Apr 2016 17:37:52 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id DDBFD1A10E3 for ; Sat, 23 Apr 2016 17:37:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.189 X-Spam-Level: * X-Spam-Status: No, score=1.189 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 53Xo73Es6Ahw for ; Sat, 23 Apr 2016 17:37:50 +0000 (UTC) Received: from mail-lf0-f50.google.com (mail-lf0-f50.google.com [209.85.215.50]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 48E605FAFA for ; Sat, 23 Apr 2016 17:37:49 +0000 (UTC) Received: by mail-lf0-f50.google.com with SMTP id c126so95413671lfb.2 for ; Sat, 23 Apr 2016 10:37:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=gLHuk0CUBOhBmjckUY9TV7TzCeZXGOeF2cMzvqdof7Q=; b=Vt0o8JjxrLHo4IIP8VQH4hL8XIRhEMWINmUGVln9KPdvIL6r+zNhLNV1JYTdSnjJ96 pH+IRCGJeScYWSCTNlZRztjp4A9MI0KSMy9vDTAENCaa9W7v07PoBSJqIVPdwq2fyFBq 6/4Nl7eU2X3pMHsZJWL5UEpOxzyoEtW4V2XuyS3rE0dqWPbZf2IKZAnaSCI34cBFdFPy q2uo18G/SV1r1TQsqby9xIBzHWzgUcc+N8loArB/5t1FHzNAzb1EKci0SihYFw3d93u5 hrQwZ4MZw4BBBIW7X/ux6CeN2eM/fSdyQXbEkdhnabKgjI28oDZ49AfjBJ7Jn82ArD4T gRdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=gLHuk0CUBOhBmjckUY9TV7TzCeZXGOeF2cMzvqdof7Q=; b=DQ4jIBauFc3yiE6DgxE6VWZnBtZr8Rbks0Gvm6Hn1BZLzlMDwxh46SRQEjsoCkRPsF 38p2hvWrHvPbGKrTTDRS2l1UQIpK729bsp/XsT/G7JMo6uWmJBqw0xoV1HXoKCVbm3cZ tN2pIqcap63nnp+zR8k1bEATtHX6+51lATHuE/DYMt8TZtcea0yz6NPnPeBLVam9CK4O suJ1/f8l4kXlo435GfnZ5EvIJHI4a0pX/ruurB9+R6RIfX1ayr5lGnDubEbixqGVezoY WL/+NfIku1YC8ghZHDYm5QYWDZKpwfGG/vasyrxbWfOwol7tYsoGcKT7pqZn/mP9+XTd zshw== X-Gm-Message-State: AOPr4FXYw8ZB0Ucn1sM7RT35zRe+mk7BeZ6CouHIEw9xhigB9AG9EWPBGtjU1fLl+GVu+W+a1XVAaQcARPIwuQ== MIME-Version: 1.0 X-Received: by 10.25.218.75 with SMTP id r72mr10857873lfg.139.1461433061702; Sat, 23 Apr 2016 10:37:41 -0700 (PDT) Received: by 10.25.168.75 with HTTP; Sat, 23 Apr 2016 10:37:41 -0700 (PDT) In-Reply-To: <917F8BFD-942E-46ED-B477-F28025C4149B@developmentalmadness.com> References: <917F8BFD-942E-46ED-B477-F28025C4149B@developmentalmadness.com> Date: Sat, 23 Apr 2016 10:37:41 -0700 Message-ID: Subject: Re: Get 1st app output From: Kam Kasravi To: user@gearpump.incubator.apache.org Content-Type: multipart/alternative; boundary=001a11401f3681861605312a66de --001a11401f3681861605312a66de Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Mark The word count pipeline's "sink" (or endpoint of the pipeline) is sum (spli= t ~ partitioner ~> sum) which doesn't persist or materialize these values anywhere. Other examples provide "sink's" like kafka or hdfs where the results can be queried (results are persisted to storage somewhere). This is similar to other frameworks like Spark ( http://spark.apache.org/examples.html). However Flink (and Spark interactive) provide a way to materialize results within the client. We should provide this capability as well. See https://issues.apache.org/jira/browse/GEARPUMP-105. Thanks for bringing this up. Kam On Sat, Apr 23, 2016 at 7:13 AM, Mark Miller wrote: > I=E2=80=99ve got the =E2=80=9Cwrite your 1st app=E2=80=9D ( > http://www.gearpump.io/releases/latest/dev-write-1st-app.html) working > both in local mode and in the latest docker image. Where can I see the > output from the word count example? I can see the app running in the UI o= n > localhost:8090, but how do I view or consume the results? > > Thanks > --001a11401f3681861605312a66de Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Mark

The word count pipeline's "sink" (or endpoint of= the pipeline) is sum (split ~= p= artitioner ~> sum)
which doesn't persist or materialize these values anywhe= re. Other examples provide "sink's" like
=
kafka or hdfs where the results can be querie= d (results are persisted to storage somewhere).
Thi= s is similar to other frameworks like Spark (http://spark.apache.org/examples.html).
However Flink (and Spark interactive) provide a way to materialize resul= ts within the client.
We should provide this capability as well. = See=C2=A0htt= ps://issues.apache.org/jira/browse/GEARPUMP-105.

Thanks for bringing this up.

Kam

=

On Sat, Apr= 23, 2016 at 7:13 AM, Mark Miller <mark@developmentalmadness.c= om> wrote:
I=E2=80=99ve got the =E2=80=9Cwrite your 1st app=E2=80=9D (http://www.gearpump.io/releases/latest/dev-write-1st-app.html)=C2= =A0working both in local mode and in the latest docker image. Where can I s= ee the output from the word count example? I can see the app running in the UI on= localhost:8090, but how do I view or consume the results?

Thanks

--001a11401f3681861605312a66de--