From user-return-30799-archive-asf-public=cust-asf.ponee.io@flink.apache.org Sun Nov 10 21:46:27 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 86696180661 for ; Sun, 10 Nov 2019 22:46:27 +0100 (CET) Received: (qmail 20895 invoked by uid 500); 10 Nov 2019 21:46:25 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 20876 invoked by uid 99); 10 Nov 2019 21:46:24 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 10 Nov 2019 21:46:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 6C87AC0849; Sun, 10 Nov 2019 21:46:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.861 X-Spam-Level: X-Spam-Status: No, score=0.861 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=0.2, KAM_NUMSUBJECT=0.5, KAM_SHORT=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_KAM_HTML_FONT_INVALID=0.01, URIBL_BLOCKED=0.001, URI_HEX=0.1] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Badg2P9I39fy; Sun, 10 Nov 2019 21:46:21 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.222.52; helo=mail-ua1-f52.google.com; envelope-from=bowenli86@gmail.com; receiver= Received: from mail-ua1-f52.google.com (mail-ua1-f52.google.com [209.85.222.52]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id DFD82BC55E; Sun, 10 Nov 2019 21:46:20 +0000 (UTC) Received: by mail-ua1-f52.google.com with SMTP id s25so3229998uap.1; Sun, 10 Nov 2019 13:46:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=zd+iLq88Dzi4lq5ym6Xon7YswfRBVFgSnsRau3cbea0=; b=gbX8G4rs0GtSqyLWQJ5y7GHRDPawNi5JmuMtD1undX4IBwtdrsDsXkTO4RUodLUguM Fu5HzHTUuRKlhuSSLRV/aR9IOk7me7aHMwElSmcdjpDM57qs9LRs63llQpEMS9Nc2Yns w0VaCyfo+vCQsqvsuITqdk3gzr+MzTytP/seUd1RD4UfGoZGY7F7j1nPUKJ2cKCR7tUj SgVblHH33HYy+94K66z0g2CDkACxRkK3u7oTWB6xUwsTxsU6lNEchGpCmoAQVVVnhYzH WpY8tnpHqg6Dm3JQRx5r64AQJpm/wh6IkrSLBNGOpMfqt7LOfHf+jY+Krf7bv+xdIu3Z pE2Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=zd+iLq88Dzi4lq5ym6Xon7YswfRBVFgSnsRau3cbea0=; b=CatvDmU9Yu5e67LDwcMDMpL2gYrjAKqOmDtv8XhcwEAz4OH9zishsCeff0vea8lBEF SHYPo9LIfP3ifNv5tkHLsGAPku3W8SwHUTZZeNViiKFhnMhxpC7Rof/XRdptcTXtbiQi kDwjBLLYEDnhlw9G8b4C2iZuSlwZdD7oR6C//eOJNw5m/URaQGhHUJVnDmxuRfCGCVqA JbiqDGNMYAaoWRhwuKLcPkzLhUV8JA6IJbIM4hhC+xNuiLAgjAHDOOttqDJ2LEvESvk2 q58aS8rT0eta3chmAX7QcGNiRFNCP+wEdK9Nz4sFFpRhs0ns3VGVLsBqwmOBfe7A0mEc bL7Q== X-Gm-Message-State: APjAAAWr6CxU+Tmve0dxarCt1ynhrRxfodh4zw5bKJRlaN9ktVMkrOqy TCjq0WlUlduvZhXxDCau/ZQVuf8W3TBuiWhgSjwq1Vu40UA= X-Google-Smtp-Source: APXvYqxTQlyPl6ERUVGMJLF7lawHuE5S5yMpXVNDwMzPt5gE4xueOgbSOU+ObjI8uQ7a2yKf2JUTMX14qNdBHUdOuB4= X-Received: by 2002:ab0:2b08:: with SMTP id e8mr15662198uar.138.1573422373962; Sun, 10 Nov 2019 13:46:13 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Bowen Li Date: Sun, 10 Nov 2019 13:45:37 -0800 Message-ID: Subject: Re: [ANNOUNCE] Weekly Community Update 2019/45 To: user , dev Cc: Konstantin Knauf Content-Type: multipart/alternative; boundary="000000000000ae8677059704f1ed" --000000000000ae8677059704f1ed Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable FYI, I'll be at the ScaleByTheBay conference in Oakland on 11/14-15 to give a Flink talk (https://sched.co/RoSY). Shoot me an email if anyone is also there and would like to meet in person and talk about Flink, data, AI/ML, etc. On Sun, Nov 10, 2019 at 8:17 AM Konstantin Knauf wrote: > Dear community, > > happy to share this week's community digest with updates on stateful > functions & Flink 1.8.3, a discussion on a connector for > Hortonworks/Cloudera's schema registry, a couple of meetups and a bit mor= e. > > Flink Development > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > * [stateful functions] After the successful vote to accept* Stateful > Function*s into Flink Igal has started a thread to discuss a few details > of the contribution like repository name, mailing lists, component name, > etc. [1] > > * [releases] Jingcheng has started a conversation about the release of *F= link > 1.8.3*. Probably still waiting for a few fixes to come in, but looks like > there could be a first RC soon. [2] > > * [connectors] =C5=90rhidi M=C3=A1ty=C3=A1s and Gyula propose to contribu= te a connector > for *Hortonworks/Cloudera Schema Registry*, which can be used during > de-/serialization in Flink's Kafka Connector. [3] > > * [python] Apache Flink will start Python processes to execute *Python > UDFs* in the Table API, planned for 1.10. Dian Fu has published a > proposal how to integrate the resource requirements of these Python > processes into the unified memory configuration framework, which is > currently introduced in FLIP-49. [4] > > [1] > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-St= ateful-Functions-Contribution-Details-tp34737.html > [2] > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Re= leasing-Flink-1-8-3-tp34811.html > [3] > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Fl= ink-Avro-Cloudera-Registry-FLINK-14577-tp34647.html > [4] > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Py= Flink-User-Defined-Function-Resource-Management-tp34631.html > > Notable Bugs > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > * [FLINK-14382] [1.9.1] [1.8.2] [yarn] In Flink 1.9+ filesystem > dependencies can be loaded via a plugin mechanism, each with its own > classloader. This does currently not work on YARN, where the plugin > directory is directly added to the classpath instead. [5] > > [5] https://issues.apache.org/jira/browse/FLINK-14382 > > Events, Blog Posts, Misc > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > * *Jark Wu *is now a member of the Apache Flink PMC. Congratulations! [6] > * This blog post by *Sreekanth Krishnavajjala & Vinod Kataria (AWS)* > includes a hands-on introduction to Apache Flink on AWS EMR. [7] > * Upcoming Meetups > * At the next Athens Big Data Group on the 14th of November *Chaoran > Yu *of Lightbend will talk about Flink and Spark on Kubernetes. [8] > * *Bowen Li* will speak about "The Rise of Apache and Stream > Processing" at the next Big Data Bellevue in Seattle on the 20th of > November. [9] > * The next edition of the Bay Area Apache Flink meetup will happen on > the 20th of November with talks by *Gyula Fora (Cloudera)* and *Lakshmi > Rao (Lyft)*.[10] > * We will have our next Apache Flink Meetup in Munich on November 27t= h > with talks by *Heiko Udluft & Giuseppe Sirigu*, Airbus, and *Konstantin > Knauf* (on Stateful Functions). [11] > > [6] > http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-J= ark-Wu-is-now-part-of-the-Flink-PMC-tp34768.html > [7] > https://idk.dev/extract-oracle-oltp-data-in-real-time-with-goldengate-and= -query-from-amazon-athena/ > [8] https://www.meetup.com/Athens-Big-Data/events/265957761/ > [9] https://www.meetup.com/Big-Data-Bellevue-BDB/events/fxbnllyzpbbc/ > [10] https://www.meetup.com/Bay-Area-Apache-Flink-Meetup/events/266226960= / > [11] https://www.meetup.com/Apache-Flink-Meetup-Munich/events/266072196/ > > Cheers, > > Konstantin (@snntrable) > > -- > > Konstantin Knauf | Solutions Architect > > +49 160 91394525 > > > Follow us @VervericaData Ververica > > > -- > > Join Flink Forward - The Apache Flink > Conference > > Stream Processing | Event Driven | Real Time > > -- > > Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany > > -- > Ververica GmbH > Registered at Amtsgericht Charlottenburg: HRB 158244 B > Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji > (Tony) Cheng > --000000000000ae8677059704f1ed Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
FYI= ,=C2=A0

I'll be at th= e ScaleByTheBay conference in Oakland on 11/14-15 to give a Flink talk (https://sched.co/RoSY). Shoot me an emai= l if anyone is also there and would like to meet in person and talk about F= link, data, AI/ML, etc.

<= br>

On Sun, Nov 10, 2019 at 8:17 AM= Konstantin Knauf <konstanti= n@ververica.com> wrote:
Dear community,

happy to share this week's community digest with updates on sta= teful functions & Flink 1.8.3, a discussion on a connector for Hortonwo= rks/Cloudera's schema registry, a couple of meetups and a bit more.
=

Flink Development
=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D

* [stateful functions]= After the successful vote to accept Stateful Functions into Flink I= gal has started a thread to discuss a few details of the contribution like = repository name, mailing lists, component name, etc. [1]

* [releases] Jingcheng has started a conversation about the release = of Flink 1.8.3. Probably still waiting for a few fixes to come in, b= ut looks like there could be a first RC soon. [2]

=
* [connectors] =C5= =90rhidi M= =C3=A1ty=C3=A1s and Gyula propose to contribute a connector for Hortonwo= rks/Cloudera Schema Registry, which can be used during de-/serializatio= n in Flink's Kafka Connector. [3]

* [python] Apache Flink will start Python processes to execute Pyt= hon UDFs in the Table API, planned for 1.10. Dian Fu has published a pr= oposal how to integrate the resource requirements of these Python processes= into the unified memory configuration framework, which is currently introd= uced in FLIP-49. [4]


* [FLINK-1438= 2] [1.9.1] [1.8.2] [yarn] In Flink 1.9+ filesystem dependencies can be load= ed via a plugin mechanism, each with its own classloader. This does current= ly not work on YARN, where the plugin directory is directly added to the cl= asspath instead. [5]


Events,= Blog Posts, Misc
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D

* Jark Wu is now a member o= f the Apache Flink PMC. Congratulations! [6]
* This blog post by = Sreekanth Krishnavajjala & Vinod Kataria (AWS)= includes a hands-on introduction to Apache Flink on AWS EMR. [7]<= br>
* Upcoming Meetups
=C2=A0=C2=A0=C2=A0= * At the next Athens Big Data Group=20 on the 14th of November Chaoran Yu of Lightbend will talk about Flin= k and Spark on Kubernetes. [8]
=C2=A0=C2=A0=C2=A0 * Bowen Li will speak about "The Rise of Apache and Stream Processing" at= the next Big Data Bellevue in Seattle on the 20th of November. [9]
=C2=A0=C2=A0=C2=A0 * The next edition of the Bay Area Apache Flink m= eetup will happen on the 20th of November with talks by Gyula Fora (Clou= dera) and Lakshmi Rao (Lyft).[10]
=C2=A0=C2=A0=C2=A0 *= We will have our next Apache Flink Meetup in Munich on November 27th with = talks by Heiko Udluft & Giuseppe Sirigu, Airbus, and Konstant= in Knauf (on Stateful Functions). [11]

=

Cheers,

Konstantin (@snntrable)

--
<= div dir=3D"ltr">

Konstantin Knauf | Solutions Archi= tect

+49 160 91394525


Fo= llow us @VervericaData Ververica=


--

Join Flink Forw= ard - The Apache Flink Conference

Stream Processing | Event Dri= ven | Real Time

--

Ververica GmbH | Invalidenstr= asse 115, 10115 Berlin, Germany

--

Ververica G= mbH
Registered at Amtsgericht Charlottenburg: HRB 1582= 44 B
Managing Directors: Timothy Alexander Steinert, Y= ip Park Tung Jason, Ji (Tony) Cheng
--000000000000ae8677059704f1ed--