Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 102FB18CB4 for ; Fri, 12 Feb 2016 11:07:54 +0000 (UTC) Received: (qmail 2896 invoked by uid 500); 12 Feb 2016 11:07:53 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 2803 invoked by uid 500); 12 Feb 2016 11:07:53 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 2793 invoked by uid 99); 12 Feb 2016 11:07:53 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Feb 2016 11:07:53 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 59C5E18027D for ; Fri, 12 Feb 2016 11:07:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id EOxQOX7elzbL for ; Fri, 12 Feb 2016 11:07:52 +0000 (UTC) Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id 8215824EB7 for ; Fri, 12 Feb 2016 11:07:51 +0000 (UTC) Received: by mail-wm0-f48.google.com with SMTP id g62so14725606wme.0 for ; Fri, 12 Feb 2016 03:07:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:subject:message-id:date:to:mime-version; bh=QsTyFZuRQUZqKNEb40UWpadY525Po2DsX7LJ5yzIoFA=; b=Pb8PNVzFU5xdV08gtvyEVPTUniMIcwN9jKdfC1+9+K+a8PdBOwNFtifhZmazw2Ldgp t0jmG5kzV8273A8scgOwN5SdgxeoNIK0rEtM0KyF7oIU2qJpQgEnyLhT2nYVqFcp/7bv Hmkoz2U+LQ73ZJvY4OyNiEI6Pq2v9vMfhNZoc4WrmCZPRwRWBrehvnj4dp/DfSCnHE/q fYUCL1j5Vqk/M9dkswyMvN/qEWefL+lDg+vdzsussTi4PCMsu4vTwNixG/VsnWduf8eB 1OT7AVTjJ5L20sUSRpdHyw7IYCrzsKb2rDrckl1auoCewfyzM17vPauPgc3QRxhnhlkH PXDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:content-type:subject:message-id:date:to :mime-version; bh=QsTyFZuRQUZqKNEb40UWpadY525Po2DsX7LJ5yzIoFA=; b=XhhY89A85tMET5H6GZnLFqUdjjBfC77rmDeNk28ANTvRFjzxc79xjc6mgEihMvnqKb UXMDFwFOYuMK0I10JvM5RJSgSkxQVuWb5cRMBakLjYeBcWiz+3gSoXEviH6UIlHngxs9 /mglwuL8r9a9dsl6YSaOdIEGsSgnIha1aJ+J87S52ab84mdh4P4oDANSlXpITM9g9oYD DHZA0Q+bZr4fnTiNOh6AwjeIe5PcxSJirYtOcg0JL5Roi6OceGlwtuJ/YPvt3PE8V7Gf z3cy/lQKL9bsorRcPchtpczo5yb/ZCNqc/Z9Eg/jq75y4sivRU+4dpCA2C6WpytTiW31 DO0w== X-Gm-Message-State: AG10YORtZC2Z2Wmot9j18nCqeENehm2MecJe42ki6fqCv/blGMrdfC4dCad5zFGfaclWFg== X-Received: by 10.194.7.195 with SMTP id l3mr1028934wja.43.1455275271143; Fri, 12 Feb 2016 03:07:51 -0800 (PST) Received: from [192.168.0.10] (mts78-1-82-235-111-206.fbx.proxad.net. [82.235.111.206]) by smtp.gmail.com with ESMTPSA id 198sm1877720wml.22.2016.02.12.03.07.49 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 12 Feb 2016 03:07:49 -0800 (PST) From: Tanguy Racinet Content-Type: multipart/alternative; boundary="Apple-Mail=_04C77A66-4546-4807-B5B8-D57509B8193E" Subject: consume kafka stream with flink Message-Id: Date: Fri, 12 Feb 2016 12:07:47 +0100 To: user@flink.apache.org Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) X-Mailer: Apple Mail (2.1878.6) --Apple-Mail=_04C77A66-4546-4807-B5B8-D57509B8193E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Hello, I am currently trying to develop am algorithm mining frequent item sets = over a data stream. I am using kafka to generate the stream, however I cannot manage to link = Flink to Kafka. The code presented here is working but only using Flink version 0.9.1 = https://github.com/dataArtisans/kafka-example/blob/master/src/main/java/co= m/dataartisans/ReadFromKafka.java It doesn=92t work for me when using FLink 10-SNAPSHOT or the latest = release. I tried several other things and was hoping someone could help me = understand the differences between kafkaSource, FlinkKafkaConsummer, = FlinkKafkaConsummer081 and FlinkKafkaConsummer082. Which one is the latest API ? Is there another way to consume Kafka = steam with Flink that is even more up to date ? Or should I use = FlinkKafkaConsummer082 and stay with Flink version 9 ? Thank you for your help. Regards, Tanguy R.= --Apple-Mail=_04C77A66-4546-4807-B5B8-D57509B8193E Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=windows-1252 Hello,

I am currently trying to = develop am algorithm mining frequent item sets over a data = stream.
I am using kafka to generate the stream, however I = cannot manage to link Flink to Kafka.

The code = presented here is working but only using Flink version = 0.9.1
It doesn=92t work for me when using FLink 10-SNAPSHOT = or the latest release.

I = tried several other things and was hoping someone could help me = understand the differences between kafkaSource, FlinkKafkaConsummer, = FlinkKafkaConsummer081 and FlinkKafkaConsummer082.

Which one is = the latest API ? Is there another way to consume Kafka steam with Flink = that is even more up to date ? Or should I use FlinkKafkaConsummer082 = and stay with Flink version 9 ?

Thank you for your = help.
Regards,
Tanguy R.
= --Apple-Mail=_04C77A66-4546-4807-B5B8-D57509B8193E--