Return-Path: X-Original-To: apmail-flink-dev-archive@www.apache.org Delivered-To: apmail-flink-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4273F17848 for ; Wed, 22 Apr 2015 14:02:00 +0000 (UTC) Received: (qmail 14934 invoked by uid 500); 22 Apr 2015 14:02:00 -0000 Delivered-To: apmail-flink-dev-archive@flink.apache.org Received: (qmail 14874 invoked by uid 500); 22 Apr 2015 14:02:00 -0000 Mailing-List: contact dev-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list dev@flink.apache.org Received: (qmail 14861 invoked by uid 99); 22 Apr 2015 14:01:59 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Apr 2015 14:01:59 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: message received from 54.76.25.247 which is an MX secondary for dev@flink.apache.org) Received: from [54.76.25.247] (HELO mx1-eu-west.apache.org) (54.76.25.247) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Apr 2015 14:01:32 +0000 Received: from mail-ig0-f171.google.com (mail-ig0-f171.google.com [209.85.213.171]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 5626625F39 for ; Wed, 22 Apr 2015 14:01:31 +0000 (UTC) Received: by igblo3 with SMTP id lo3so42181906igb.0 for ; Wed, 22 Apr 2015 07:01:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=r4rFEYKmpdehgeHqUF7qx19V0/rSqjU8AOIIDlbUUY8=; b=eBlFuIQs+gfWuVruvgDxMHHEoHcC+xAXNMFxNS7+P+AIp2LxLiDjDmtCZ04NKZH8Nc aeTqtVV8J8DvHRYYYDH67eBi3lvXsdrzQQxrjNECzGuj0FEzC9DN0rUddaJ3qtHXeuCs nxlU23X6bE/xPoRvKns+iZD7uAOO+mW5dLlJD4Wfm5M6urbvfTGGfLdRW/9H/Vz0g2dP QkqgwaOwrTWbC2lM4kctwmv5fMgMDtbO5kxZ/rMpdVpJ6ECM7zVoZZRng19dWFPmdqJF mNteCPql5iNgexY69x00H/cJwwr3Uv1jfhujvrs4BtTYB2xubrEtprztW3eo7Ks6sNVC NJlg== MIME-Version: 1.0 X-Received: by 10.50.13.67 with SMTP id f3mr4646126igc.12.1429710923331; Wed, 22 Apr 2015 06:55:23 -0700 (PDT) Sender: ewenstephan@gmail.com Received: by 10.64.25.108 with HTTP; Wed, 22 Apr 2015 06:55:23 -0700 (PDT) In-Reply-To: References: <552F9D41.5000903@apache.org> Date: Wed, 22 Apr 2015 15:55:23 +0200 X-Google-Sender-Auth: DhfspnORTBidRa3tuSRoei7cjQM Message-ID: Subject: Re: About Operator and OperatorBase From: Stephan Ewen To: "dev@flink.apache.org" Content-Type: multipart/alternative; boundary=089e0112ccf2b7855505145083c3 X-Virus-Checked: Checked by ClamAV on apache.org --089e0112ccf2b7855505145083c3 Content-Type: text/plain; charset=UTF-8 I think the main difference to the Java API is right now that the JavaAPI is fluent and the common API is compositional. Otherwise there is not much in the common API any more. Not sure whether this warrants an extra API... On Wed, Apr 22, 2015 at 3:52 PM, Kostas Tzoumas wrote: > I think Stephan meant Meteor, an old API when Flink was Stratosphere. This > was never part of the code that made it to Apache. > > Not sure if we want to remove the common API, as it provides a dataflow > abstraction that is higher level than the JobGraph. Admittedly, I don't > have a better argument other than "it might be useful some day" and happy > to change my opinion :-) > > Kostas > > On Tue, Apr 21, 2015 at 5:49 PM, Henry Saputra > wrote: > > > Thanks for the explanation, Stephan. I always wonder why the extra > > common APIs exist. > > > > Then I think this should be high priority if we want to remove the > > common API to reduce the unnecessary layer and "dead code". As Ufuk > > mentioned before, better doing it now before more stuff build on top > > of Flink. > > > > So removing old Record API [1] and the tests depending on them is step > > one of the process, but what is JSON API? > > > > - Henry > > > > [1] https://issues.apache.org/jira/browse/FLINK-1681 > > > > On Tue, Apr 21, 2015 at 1:10 AM, Stephan Ewen wrote: > > > Originally, we had multiple Apis with different data models: the > current > > > Java API, the record api, a JSON API. The common API was the data model > > > agnostic set of operators on which they built. > > > > > > It has become redundant when we saw how well things can be built in top > > of > > > the Java API, using the TypeInformation. Now, Scala, Python, Dataflow, > > all > > > build on top of the Java API. > > > --089e0112ccf2b7855505145083c3--