Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 792CC200CA7 for ; Wed, 31 May 2017 04:10:51 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 77B68160BDC; Wed, 31 May 2017 02:10:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id BC214160BC9 for ; Wed, 31 May 2017 04:10:50 +0200 (CEST) Received: (qmail 84780 invoked by uid 500); 31 May 2017 02:10:49 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 84767 invoked by uid 99); 31 May 2017 02:10:48 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 31 May 2017 02:10:48 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 20E8FC006E for ; Wed, 31 May 2017 02:10:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id H-fpZkqMdjmx for ; Wed, 31 May 2017 02:10:46 +0000 (UTC) Received: from mail-lf0-f50.google.com (mail-lf0-f50.google.com [209.85.215.50]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id A7BCC5F36B for ; Wed, 31 May 2017 02:10:45 +0000 (UTC) Received: by mail-lf0-f50.google.com with SMTP id a5so1429435lfh.2 for ; Tue, 30 May 2017 19:10:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=/j5Vng4fQDsE6lfWHTS+CKgiQM9FuwR618cAsuatrRQ=; b=t02+IcM85PHZqdghwCPh8AEzAOSECgreTKNlNujM+xf1JZLTtRRLVxMnLnzK6gOHuN wyyZ2tW0OYgHJ0xRh4ObGf0AvXYZqZ6dhO6V0doxowvj3ETRFNky9muEPEWoOvvjSBqG NSFwC3jO6yCMRR55PK4JeCItg1v7RocvADDvrYRrwohJ3IgHJrWCDcGjLJkUrpUGuizN u62tUy2X+skAdgj7dib2XzSJYhSBxXaQvOUkxFMGb8wjvPYGwyCKol2XmWnHqddXI2eA b0UMBLSjisBTmUyEe0ufYMPCNkqK4DxXv+gqvcZtqePUJACu62EFiFwyvZ39Dg3s7Bdx xZLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=/j5Vng4fQDsE6lfWHTS+CKgiQM9FuwR618cAsuatrRQ=; b=I2wljJCIkYo+3vlOp5oa3wUG+Cvs9q2vHDWCA8bczf44Lsw+HxRC9azyXs98AOR5QO GGeS0MmDZ4WhKewz+k1EDRiS+WUTYBD4uZ+tE61SG8YEUDOToJTu1y7HXPSTF9sw2j8K qKFJibqHfYMF9ZNAMifCdDO6d8ZUmIVLUjfy3r6uslJ2U3BEUPI2xGLUNX0QXHm6sR50 i4IYPu17LiPAZuSOB8splK0vVXjnn4HhQQhCqhx38NlKU1TPr/fpPz5YAywxVkhicitf iwS9AXlpU24jGQ/SIT6BzBZMZQIkJl6CeyIWu0d9qJ6zV8zPay2jmGEzM6zcFCtR6bjW 1wwg== X-Gm-Message-State: AODbwcBuVWSTFhWTCHZ0SxYab5TFJexqSg1/hs2SSUffg3eNvmBL0u1V TGODqn8WK95exBB53kIt1JzCHA81yQ== X-Received: by 10.25.24.151 with SMTP id 23mr6812658lfy.106.1496196644306; Tue, 30 May 2017 19:10:44 -0700 (PDT) MIME-Version: 1.0 Received: by 10.25.215.24 with HTTP; Tue, 30 May 2017 19:10:43 -0700 (PDT) From: Madhukar Thota Date: Tue, 30 May 2017 22:10:43 -0400 Message-ID: Subject: Amazon Athena To: user@flink.apache.org Content-Type: multipart/alternative; boundary="001a113f254a7f85810550c86d3f" archived-at: Wed, 31 May 2017 02:10:51 -0000 --001a113f254a7f85810550c86d3f Content-Type: text/plain; charset="UTF-8" Anyone used used Amazon Athena with Apache Flink? I have use case where I want to write streaming data ( which is in Avro format) from kafka to s3 by converting into parquet format and update S3 location with daily partitions on Athena table. Any guidance is appreciated. --001a113f254a7f85810550c86d3f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Anyone used used Amazon Athena with Apache Flink?

I have= use case where I want to write streaming data (=C2=A0which is in=C2=A0Avro= format) from kafka to s3 by converting into parquet format and update S3 l= ocation with daily partitions on Athena table.

Any= guidance is appreciated.

--001a113f254a7f85810550c86d3f--