Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 22939200B67 for ; Tue, 2 Aug 2016 01:03:56 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 211C0160AA7; Mon, 1 Aug 2016 23:03:56 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 43FD9160A6C for ; Tue, 2 Aug 2016 01:03:55 +0200 (CEST) Received: (qmail 43911 invoked by uid 500); 1 Aug 2016 23:03:54 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 43900 invoked by uid 99); 1 Aug 2016 23:03:54 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 01 Aug 2016 23:03:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D82A2C0CA1 for ; Mon, 1 Aug 2016 23:03:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id f6bqT3cO4hkT for ; Mon, 1 Aug 2016 23:03:52 +0000 (UTC) Received: from mail-it0-f51.google.com (mail-it0-f51.google.com [209.85.214.51]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 60F3D5FAE8 for ; Mon, 1 Aug 2016 23:03:52 +0000 (UTC) Received: by mail-it0-f51.google.com with SMTP id f6so185042104ith.0 for ; Mon, 01 Aug 2016 16:03:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=/B7SDip9dSLfQ5cb+1hlEb/oUlevplTvrHMBN71ih2w=; b=yKyG16mRD7CBhSt7z/7hfoMvo0OlrxYko+wOV5P/CUvGkA/bzjMOrMiyJW20u2Mkub noDEjrlnjgevTYXr4RE2t6JTHEUGPBatMkj96YB5uUGkNY5v1spQaA2beFbhLx7EfuGx QT2lYUe1Ku8RsykJdeaAaBlYyQF7Jv5Sb1oxGB71AIT9zDZ7f2UkZBzs+KP0GB11ijqI NqOD16JYDiwjO+xaFQYod/d/y/CDsHem9dJ2tSkxS5USylcyNTMtP+4L1FxMkwZ04Q1c 8Jljm5Iwgao9VIorbi6cXBLhBff8HtnOyrud4RWSwESOQHm7tazdKIw71P6hOV8VGG6Z 4NgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=/B7SDip9dSLfQ5cb+1hlEb/oUlevplTvrHMBN71ih2w=; b=M/MQCKb6JPo0RRv2xijfuOdwsTMHvM2XNtFSPmrOx5OLlI0j2VSoyfjq9xXON/Or4+ wGB+77yAOAGa2IOb5PIMAJusXABcG98TquMjTXGZn40Crm7u+U7Gul2BanrvkMIufHE+ uN+xNU8o2Y0NGYSfwqxf0IofEKV0+7WNvcLNT1dLP7Yq6BaB5zBgDmMtE51HzLAFdFf+ Hp4ZXamwUchDIOz1Eti3pHJvzD6Ymy3A3BgbdQpPz7tInkWMJ40oNHAkMfCPtduielgo r8yEzMHYuBv8NpI3xPFVo8jXPLwS/XfxJSoGM6Z1eazMsAqHmQuEPd4if8DZQeWEkrtu jnDA== X-Gm-Message-State: AEkoouuZJ2Mv4TcQdY5CQx5E5AwwNZhaIpcqz87JENRowZSsH6YPJ75x8E6MR1EhL/JbwQeVDTxoXk/LfwCL0w== X-Received: by 10.36.53.83 with SMTP id k80mr59485904ita.59.1470092625825; Mon, 01 Aug 2016 16:03:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.211.144 with HTTP; Mon, 1 Aug 2016 16:03:05 -0700 (PDT) In-Reply-To: References: From: Siva Date: Mon, 1 Aug 2016 16:03:05 -0700 Message-ID: Subject: Re: Flink Streaming API To: user@flink.apache.org Content-Type: multipart/alternative; boundary=001a114a9622bfd3f005390a9cbb archived-at: Mon, 01 Aug 2016 23:03:56 -0000 --001a114a9622bfd3f005390a9cbb Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Till, Thanks for your response. I m able to use flink-connector-kafka-0.9-2_11 with Kafka v10 to produce and consume messages. Thanks, Sivakumar Bhavanari. On Mon, Aug 1, 2016 at 6:41 AM, Till Rohrmann wrote: > Hi Siva, > > in version 1.0.0 we=E2=80=99ve added the Scala binary version suffix to a= ll Flink > dependencies which depend on Scala. Thus, you should look for > flink-streaming-scala_2.10 and flink-streaming-java_2.10. For these > artifacts you should be able to find a version 1.0.3 on maven central, fo= r > example. > > The easiest way to setup a project is to use the quickstarts [1]. It will > add the correct dependencies. But usually it should be enough to include > the flink-client_2.10 and the respective API dependency to your project > (e.g. flink-streaming-scala_2.10). > > I think that you should be able to use the Flink Kafka connector 0.9 with > Kafka 0.10.0 as long as Kafka 0.10.0 still supports the consumer API > introduced with Kafka 0.9. But I might be wrong here. So best if you trie= d > it out. > > [1] > https://ci.apache.org/projects/flink/flink-docs-master/quickstart/java_ap= i_quickstart.html > > Cheers, > Till > =E2=80=8B > > On Mon, Aug 1, 2016 at 3:48 PM, Siva wrote: > >> Hello Everyone, >> >> I m new to Flink, wanted to try streaming API using flink-kafka connecto= r >> in scala. >> >> But there are several versions of it. Please could some one help on belo= w >> questions >> >> what are the differences between flink-streaming-core and >> flink-sreaming-scala[java]? >> >> Latest version of flink-streaming-scala of 0.10.2 version, does it mean >> that streaming development in scala can only use Flink 0.10.2 not the >> latest one 1.0.3? >> >> what is difference between flink-connector-kafka-base and >> flink-connector-kafka-0.x.x? Is >> flink-connector-kafka-0.9-2_11 compatible with Kafka 0.10.0? >> >> Thanks in advance. >> >> Thanks >> Siva >> > > --001a114a9622bfd3f005390a9cbb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Till,

Thanks for your response. I m = able to use flink-connector-kafka-0.9-2_11 with Kafka v10 to produce and co= nsume messages.

Thanks,
Sivakumar Bhavanari.

On Mon, Aug 1, 2016 at 6:41 AM, Till Rohrman= n <trohrmann@apache.org> wrote:

= Hi Siva,

in version 1.0.0 we=E2=80=99ve = added the Scala binary version suffix to all Flink dependencies which depen= d on Scala. Thus, you should look for flink-streaming-scal= a_2.10 and flink-streaming-java_2.10. For th= ese artifacts you should be able to find a version 1.0.3 on maven central, = for example.

The easiest way to setup a proj= ect is to use the quickstarts [1]. It will add the correct dependencies. Bu= t usually it should be enough to include the flink-client_= 2.10 and the respective API dependency to your project (e.g. flink-streaming-scala_2.10).

I think that you should be able= to use the Flink Kafka connector 0.9 with Kafka 0.10.0 as long as Kafka 0.= 10.0 still supports the consumer API introduced with Kafka 0.9. But I might= be wrong here. So best if you tried it out.

[1] https://ci.apache.org/projects/flink/flink-docs-master/q= uickstart/java_api_quickstart.html

Cheers,
Till

=E2=80=8B

On Mon, Aug 1, 2016 at 3:= 48 PM, Siva <sbhavanari@gmail.com> wrote:
Hello Everyone,

I m new to Flink, wanted to try streaming API using fli= nk-kafka connector in scala.

But there are several= versions of it. Please could some one help on below questions
what are the differences between flink-streaming-core and flin= k-sreaming-scala[java]?

Latest version of flink-st= reaming-scala of 0.10.2 version, does it mean that streaming development in= scala can only use Flink 0.10.2 not the latest one 1.0.3?

what is difference between flink-connector-kafka-base and flink-co= nnector-kafka-0.x.x? Is flink-connector-kafka-0.9-2_11=C2=A0compatible=C2= =A0with Kafka 0.10.0?

Thanks in advance.

Thanks
S= iva


--001a114a9622bfd3f005390a9cbb--