From user-return-28681-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Jul 19 15:06:25 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id AA012180665 for ; Fri, 19 Jul 2019 17:06:24 +0200 (CEST) Received: (qmail 33092 invoked by uid 500); 19 Jul 2019 15:06:22 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 33082 invoked by uid 99); 19 Jul 2019 15:06:22 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Jul 2019 15:06:22 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B3A9A1A418C for ; Fri, 19 Jul 2019 15:06:21 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.426 X-Spam-Level: *** X-Spam-Status: No, score=3.426 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HK_RANDOM_ENVFROM=0.626, HK_RANDOM_FROM=0.999, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id sxJyPb92Cycd for ; Fri, 19 Jul 2019 15:06:20 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::244; helo=mail-lj1-x244.google.com; envelope-from=zjffdu@gmail.com; receiver= Received: from mail-lj1-x244.google.com (mail-lj1-x244.google.com [IPv6:2a00:1450:4864:20::244]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id D96987DC5E for ; Fri, 19 Jul 2019 15:06:19 +0000 (UTC) Received: by mail-lj1-x244.google.com with SMTP id d24so31099345ljg.8 for ; Fri, 19 Jul 2019 08:06:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=SNEKdsKwa0yRlxM6Jaa088IRFo/KqoE5XJEGRUKtsUc=; b=FfkpHRaBrzAJn57KjGvxOH1DdbQ10Q2LAkMuh2YdAYtGh9aWTjdvZZVvlpLj9TVmuc CPQ2pJmVR8klqn66/x0s6y1ZXRpJOsISdX5zNa3FLJlTeOwic/WrG0Qqhrxv3FYKG4MZ apzEq+58wpxgg3VX3+7/ReQxrJDSoO2A5InSNcI4VXF+hxsrezfidr/JXzmQdp78KGKm iej/QHNgXczmis6OZy09sJtzqJGVnmjcimJenGMLQffz9cWbXFSfdTqfQFb+1TYuq9hM TAQd7HNAXbtnI0fQTyeDR9dVImt+oAAmZomS1QVS0IxryH6tIv2kvTDSLdOVO582ZGpi fICg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SNEKdsKwa0yRlxM6Jaa088IRFo/KqoE5XJEGRUKtsUc=; b=s7LKyjDu2V1DAF/3RyKb8/OpmFUToWdKd0aR4U7ofB7efIDx1NIzGLW8T1aM/YwUCc 5rgWt1C4TUnmqqCOCYo0DzAbqy5P8soKse3Xt5c1lV/mFm85ayVrchlT3b2kCBtz04Eg ia+MB32bZDvV37WfAZ1c7UWfn2kbyZxuz/OU7D1zYiifnMiOg2M9VX3Hrxm9YafPyd0L ruFZaBW1j0xEaMWxhTzy/wJyH/g9dOMlTaFU3OSceL89W7mMuPe4VQuHq3nV4u/UM3eS ID5q7S0lF1GvT2jxJOzv1YSk6J40IoWsGMpmMJpardO4kXxGlFU4MWgSleaqC7VT16Sw BfPA== X-Gm-Message-State: APjAAAVR9Ymuhc5wQRv4ZX0tCgvRAYBGS2w0givQpf264I+Q+RtyAbpS iWGhhktfErYw5ET9INIlA0ILGzDhfbQvEPkp24U= X-Google-Smtp-Source: APXvYqx36Y+VffB6fUI2JRyn1YE05N5PuHRNXVTmwjpAx/3KdAWzXkzhZuMiXOjks3Ga95aIQJp0cJx7ZifcibrxJxs= X-Received: by 2002:a2e:2d12:: with SMTP id t18mr10675419ljt.175.1563548779246; Fri, 19 Jul 2019 08:06:19 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jeff Zhang Date: Fri, 19 Jul 2019 23:06:07 +0800 Message-ID: Subject: Re: Jython support for Flink To: Dante Van den Broeke Cc: "user@flink.apache.org" Content-Type: multipart/alternative; boundary="0000000000009379d6058e0a1112" --0000000000009379d6058e0a1112 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Dante, Flink 1.9 support python api, which may be what you want. See https://ci.apache.org/projects/flink/flink-docs-master/tutorials/python_tab= le_api.html Dante Van den Broeke =E4=BA=8E2019=E5=B9=B47= =E6=9C=8819=E6=97=A5=E5=91=A8=E4=BA=94 =E4=B8=8B=E5=8D=8810:40=E5=86=99=E9= =81=93=EF=BC=9A > Dear, > > > I'm a student currently working on a project involving apache kafka and > flink. The project itself is revolved around path prediction and machine > learning for websites. To test a prove of concept I setup a kafka server > locally (goal is to expend this to a google cloud server or similar later= ) > and a kafka producer (written in java intelliJ idea project). The produce= r > would send JSON data (currently just a local file but later json data fro= m > the website itself) to a flink-kafka connection and the data transformati= on > (key-windowed by user id) would than happen in the flink framework. > > > The problem i'm facing however is that i wrote all the algorithms for > transformation of the data in python and i'm struggling with initializing= a > jython environment to setup the flink-kafka connection. > > I was wondering whether or not there is a working example for this setup = / > some documentation regarding the framework as i'm struggling to find a lo= t > of documentation for my application online. > > > thanks in advance. > > > kind regards, > > Dante Van den Broeke > > --=20 Best Regards Jeff Zhang --0000000000009379d6058e0a1112 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Dante,

Flink 1.9 support python api,= which may be what you want. See=C2=A0https://ci.ap= ache.org/projects/flink/flink-docs-master/tutorials/python_table_api.html


Dante Van den Broeke <Dante.VandenBroeke@ugent.be> =E4=BA=8E2019=E5=B9= =B47=E6=9C=8819=E6=97=A5=E5=91=A8=E4=BA=94 =E4=B8=8B=E5=8D=8810:40=E5=86=99= =E9=81=93=EF=BC=9A

Dear,


I'm a student currently working on a project involving apache kafka and= flink. The project itself is revolved=C2=A0around path prediction and mach= ine learning for websites. To test a prove of concept I setup a kafka serve= r locally (goal is to expend this to a google cloud server or similar later) and a kafka producer (written in java intel= liJ idea project). The producer would send JSON data (currently just a loca= l file but later json=C2=A0data from the website itself) to a flink-kafka c= onnection and the data transformation (key-windowed by user id) would than happen in the flink framework.


The problem i'm facing however is that i wrote all the=C2=A0algorithms = for transformation of the data in python and i'm struggling with initia= lizing a jython environment to setup the flink-kafka connection.

I was wondering whether or not there is a working example for this setup / = some documentation regarding the framework as i'm struggling to find a = lot of documentation for my application online.=C2=A0


thanks in advance.


kind regards,

Dante Van den Broeke




--
Best Regards

Jeff Zhang
--0000000000009379d6058e0a1112--