Mailing-List: contact dev-help@streams.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@streams.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: <etPan.58333098.5661ca63.252b@apache.org>
References: <CAOtpBjisPS=2JBdR+sFat+LK=tYP8yXX4U=mKp8SX48TuXBsqQ@mail.gmail.com>
 <etPan.580fc4ce.4a2ca734.824@apache.org> <etPan.58220b2f.3d17afc5.33d@apache.org>
 <etPan.58333098.5661ca63.252b@apache.org>
From: Trevor Grant <trevor.d.grant@gmail.com>
Date: Mon, 21 Nov 2016 14:14:27 -0600
Message-ID: <CAN2fLa8CsAEm=kK40h3q0A6Sj_g2LvG7Ppheu-FAAz-3F_cZAQ@mail.gmail.com>
Subject: Re: [DISCUSS] Beam
To: dev@streams.incubator.apache.org
Content-Type: multipart/alternative; boundary=001a11406c2283fbc10541d54d3d
archived-at: Mon, 21 Nov 2016 20:14:49 -0000

--001a11406c2283fbc10541d54d3d
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

IMHO, Beam is too immature and the API is to unstable at this time to
integrate, however I am in favor of watching the Beam project develop and
starting to think through what an integration might look like.

Just my .02, based on some fairly lack-luster experiences with Apache Beam.

tg


Trevor Grant
Data Scientist
https://github.com/rawkintrevo
http://stackexchange.com/users/3002022/rawkintrevo
http://trevorgrant.org

*"Fortunate is he, who is able to know the causes of things."  -Virgil*


On Mon, Nov 21, 2016 at 11:36 AM, sblackmon <sblackmon@apache.org> wrote:

> Beam appears to be on it=E2=80=99s way to being the de-facto standard for=
 data
> pipelines.
>
> I=E2=80=99d like to start a real discussion about whether and how to alig=
n streams
> interfaces with Beam interfaces.
>
> To pose a straw-man theory for discussion:
>
> Hypothesis: Streams would benefit by replacing the interfaces in
> streams-core entirely with beam interfaces.
>
> a) Do we agree that the flexibility and performance gains from doing so,
> presuming it=E2=80=99s possible, would be significant?
> b) Are there any inevitable flexiblility, performance, complexity, or
> other, blockers or compromises we should discuss?
> c) What arguments are there for retaining our interfaces and providing
> beam compatibility in a runtime module binding (within streams) vs
> deprecating our existing interfaces and switching over completely?
> d) Obviously doing this would be a lot of work.  What level of commitment
> is there from the group to work on this?
>
> Steve
> On October 25, 2016 at 3:47:11 PM, sblackmon (sblackmon@apache.org) wrote=
:
>
> Regarding Beam, there have been a number of ideas and theories floated on
> the list and but nothing concrete has been proposed or discussed in depth=
.
>
> Steve
> On October 25, 2016 at 10:21:52 AM, Suneel Marthi (suneel.marthi@gmail.co=
m)
> wrote:
>
> Is support for Kafka Streams and Apache Beam on the roadmap ?
>

--001a11406c2283fbc10541d54d3d--