From user-return-30076-archive-asf-public=cust-asf.ponee.io@flink.apache.org Fri Sep 27 19:49:36 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 93F8C180638 for ; Fri, 27 Sep 2019 21:49:36 +0200 (CEST) Received: (qmail 15381 invoked by uid 500); 27 Sep 2019 19:49:35 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 15371 invoked by uid 99); 27 Sep 2019 19:49:35 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 27 Sep 2019 19:49:35 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id A5639C2281 for ; Fri, 27 Sep 2019 19:49:34 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.801 X-Spam-Level: * X-Spam-Status: No, score=1.801 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ZfFAR188EPVs for ; Fri, 27 Sep 2019 19:49:32 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2a00:1450:4864:20::22e; helo=mail-lj1-x22e.google.com; envelope-from=java.dev.mtl@gmail.com; receiver= Received: from mail-lj1-x22e.google.com (mail-lj1-x22e.google.com [IPv6:2a00:1450:4864:20::22e]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 190FB7DDA3 for ; Fri, 27 Sep 2019 19:42:38 +0000 (UTC) Received: by mail-lj1-x22e.google.com with SMTP id m7so3633504lji.2 for ; Fri, 27 Sep 2019 12:42:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ihd7fRbCieu98kLrBMXq4BrLqfgrPQg5IUrBdDteZsA=; b=ibwHhrAWJeiIGZLZiYBtv35imU7G1sKKQrNrUwXkKyMTXodLEwo2Ydj8kemCckloGW 9mt+ym37+h2cxFpA70i+jFgJZoCvQ/+xzwiro0I8t6gRhhwND4fFeU0R/c0/BVBqgQg3 6CDxjuoE/JIqBrfMJifctwbh+ji+HYeDsV8A3wT5kAadyDYHWxN2cmsv1luq6/li0Svw 3jkSq2KEcVaS+sExsgcqw36FPGLs7WuIHPBogh44PTV8XJfdsjTTzsnFMwEqsV/F/wed extn472M9miW1yhfOZxtLgSdzFsBBHO3izr1xArj7m9hn7B8ShONbqr4l6cj+5rAiwbA FCYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ihd7fRbCieu98kLrBMXq4BrLqfgrPQg5IUrBdDteZsA=; b=bjzmchE80rvIouDgxE5ZJ3efMmQUkEPJ6R7fF7v/WnhpF8W4nyWQvkELLz2ywdQsA7 TsCTmDpu5Xz6o+PX2z5AtCFI5U8v+EbOmYRtZyc86K2aSYKZ02/CSg+1bA5rcTgcBYG3 3NVC+pDodUdOwfS9Xpo8Y3RYNojPa4PFsNT1uWT6bbNXyf5LMsRFBoo3D/rfaLxoQ/Fz Jm0/q+d7eayP0WOGz/co8h3I5KPRwz3x6tYjFyXA3UjIA43Kd4+vqkEDHgK9Qy1wYgV0 8EiAdx9rYHW1jUziGPug+ZPBmlfzVekFE8BTMwXO6G3jTVWS4CFV4lzoq0pibJ8QepiC cpYg== X-Gm-Message-State: APjAAAVBqUtE756LbmxHgR7XUZWG1AMOvdVizxj9cNYIIE4Uan6p/ie2 ojE4aHmp+yHNxMjaaVYfauERu5gqyCen+ZdbI1M= X-Google-Smtp-Source: APXvYqyIBPemyIMORQEFQwYLLHGA9Mie+y2JtTx/d233nIiKOwW7zoFb+H4628+nO3iXSOn87eqqb+d4vnG3hP24UI4= X-Received: by 2002:a2e:81c5:: with SMTP id s5mr4071465ljg.124.1569613357181; Fri, 27 Sep 2019 12:42:37 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: John Smith Date: Fri, 27 Sep 2019 15:42:00 -0400 Message-ID: Subject: Re: Best way to link static data to event data? To: Oytun Tez Cc: user Content-Type: multipart/alternative; boundary="00000000000096f11705938e16df" --00000000000096f11705938e16df Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I don't think I need state for this... I need to load a CSV. I'm guessing as a table and then filter my events parse the number, transform the event into geolocation data and sink that downstream data source. So I'm guessing i need a CSV source and my Kafka source and somehow join those transform the event... On Fri, 27 Sep 2019 at 14:43, Oytun Tez wrote: > Hi, > > You should look broadcast state pattern in Flink docs. > > --- > Oytun Tez > > *M O T A W O R D* > The World's Fastest Human Translation Platform. > oytun@motaword.com =E2=80=94 www.motaword.com > > > On Fri, Sep 27, 2019 at 2:42 PM John Smith wrote= : > >> Using 1.8 >> >> I have a list of phone area codes, cities and their geo location in CSV >> file. And my events from Kafka contain phone numbers. >> >> I want to parse the phone number get it's area code and then associate >> the phone number to a city, geo location and as well count how many numb= ers >> are in that city/geo location. >> > --00000000000096f11705938e16df Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I don't think I need state for this...

I need t= o load a CSV. I'm guessing as a table and then filter my events parse t= he number, transform the event into geolocation data and sink that downstre= am data source.

So I'm guessing i need a CSV source and my Kafka= source and somehow join those transform the event...

On Fri, 27 Sep 2019 = at 14:43, Oytun Tez <oytun@motawor= d.com> wrote:
Hi,

You should look broadcast stat= e pattern in Flink docs.

---
Oytun Tez

<= /div>
M O T A W O R D
The World's Faste= st Human Translation Platform.
oytun@motaword.com=C2=A0=E2=80=94=C2=A0= www.motaword.com


On Fri, Sep 27, 2019 at 2:4= 2 PM John Smith <java.dev.mtl@gmail.com> wrote:
Using 1.8

I = have a list of phone area codes, cities and their geo location in CSV file.= And my events from Kafka contain phone numbers.

I= want to parse the phone number get it's area code and then associate t= he phone number to a city, geo location and as well count how many numbers = are in that city/geo location.
--00000000000096f11705938e16df--