Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 8A4E520049B for ; Mon, 14 Aug 2017 11:14:35 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 86DD8164BAA; Mon, 14 Aug 2017 09:14:35 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7CD6E164BA7 for ; Mon, 14 Aug 2017 11:14:34 +0200 (CEST) Received: (qmail 2935 invoked by uid 500); 14 Aug 2017 09:14:32 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 2914 invoked by uid 99); 14 Aug 2017 09:14:32 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Aug 2017 09:14:32 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 15E8F180234 for ; Mon, 14 Aug 2017 09:14:32 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.442 X-Spam-Level: **** X-Spam-Status: No, score=4.442 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id fVZ2ACCNYVRW for ; Mon, 14 Aug 2017 09:14:30 +0000 (UTC) Received: from mail-wm0-f65.google.com (mail-wm0-f65.google.com [74.125.82.65]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 3D5605F24E for ; Mon, 14 Aug 2017 09:14:30 +0000 (UTC) Received: by mail-wm0-f65.google.com with SMTP id d40so13707039wma.3 for ; Mon, 14 Aug 2017 02:14:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=32mlU+gs2NxrUlFQ+ly5sJtuWA6gck9cq+Fj20CdYz0=; b=Mgg14fX1SQ5VrDQScXT9nO5RCjJNgZuISMEwVfXqIwPrHnJumv/hUbrbrQdi62hF57 xs+qvUe7/ZwG9MOdaP8WLAO39fZ8brziTN8esv2zhdV0cyrp3t2+I0LvPVnBLOH2zQXn Aorv2RKshd+6WI/4km95waM8DfhZcr7TQxeuwT4B4qZQZe8YSEk0IYjRnO+O2RFBqiEU Yffx0epgBgSwgsuGFO+256jmAX2YAT59X9fFfV5GwFmVZ2qlegUe2FdwAMpE+pCd75US 33Iffqq468z3w3mmJjuymhG2Xe2i3gtAZrUOsx+wq9//6nSuux0kwY0BPrUvb0bYCw1O a1ew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=32mlU+gs2NxrUlFQ+ly5sJtuWA6gck9cq+Fj20CdYz0=; b=oDMLaM+rU/J/aSurSM3Ok6dC4Odo3dgV+Ce5Qv1dB6mZz23qvM43FbSCKgbqRJ8Mkj hOM/boyplROmCL6xZmHLWpxlQbXXhW7vRmFNLueGx06Y3nWvBcKHZlqwRwA3rflmONIA Zvcs4o213yMTAIkecwPTPZJE069DyV/7BoLgbVBFKk5hNiCKPqSiT6wWzpPdvqiok8Sk q0RUcxTEL7+9Q00gOjryGm28L43pqTOZbdOBIZ44NlDMgBIPNEPC44PF+5JvqP+68DJr iAY6WA9A6WG7+pwHlZ/OKbAZyunrSpJ+s48LkXjXW21dfpOutxdM8N0TnuST66FwjlBW /zSw== X-Gm-Message-State: AHYfb5hWUqEAjLwiGovq8xPVPK1iaiTZBmykRgSYf0LBuHzT8dd8LPcs 5LB5y8QNRak4Kg== X-Received: by 10.28.52.207 with SMTP id b198mr3365840wma.31.1502702064608; Mon, 14 Aug 2017 02:14:24 -0700 (PDT) Received: from [192.168.1.133] ([164.39.5.133]) by smtp.gmail.com with ESMTPSA id 9sm6240977wrl.57.2017.08.14.02.14.23 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 14 Aug 2017 02:14:24 -0700 (PDT) From: ant burton Message-Id: Content-Type: multipart/alternative; boundary="Apple-Mail=_A913D513-0D3A-437A-87D6-653D3CEEB216" Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Flink Data Streaming to S3 Date: Mon, 14 Aug 2017 10:14:23 +0100 In-Reply-To: Cc: user@flink.apache.org To: vinay patil References: X-Mailer: Apple Mail (2.3273) archived-at: Mon, 14 Aug 2017 09:14:35 -0000 --Apple-Mail=_A913D513-0D3A-437A-87D6-653D3CEEB216 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Thanks Vinay, After jar xf jar-file the JAR file, and then find . -name "*.xml", I can = only locate ./core-default.xml, updating this file does not resolve the = issue, am I missing something? Should the core-site.xml be placed in the root of the jar or else where? :-) > On 14 Aug 2017, at 07:32, vinay patil wrote: >=20 > Hi, >=20 > Yes, I am able to write to S3 using DataStream API. >=20 > I have answered you the approach on SO >=20 > Regards, > Vinay Patil >=20 > On Mon, Aug 14, 2017 at 4:21 AM, ant burton [via Apache Flink User = Mailing List archive.] <[hidden email] = > wrote: > Hello, >=20 > Has anybody been able to write to S3 when using the data streaming API = ? >=20 > I=E2=80=99m having this problem = https://stackoverflow.com/questions/45655850/flink-s3-write-fails-unable-t= o-load-aws-credentials-from-any-provider-in-the-cha = >=20 > Thanks >=20 >=20 > If you reply to this email, your message will be added to the = discussion below: > = http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-= Data-Streaming-to-S3-tp14871.html = > To start a new topic under Apache Flink User Mailing List archive., = email [hidden email] = =20 > To unsubscribe from Apache Flink User Mailing List archive., click = here . > NAML = >=20 > View this message in context: Re: Flink Data Streaming to S3 = > Sent from the Apache Flink User Mailing List archive. mailing list = archive = = at Nabble.com. --Apple-Mail=_A913D513-0D3A-437A-87D6-653D3CEEB216 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8
Thanks Vinay,

After jar xf jar-file the JAR file, = and then find . -name "*.xml", I can only locate = ./core-default.xml, updating this file does not resolve the issue, am I = missing something?

Should = the core-site.xml be placed in the root of the jar or else = where?

:-)

On = 14 Aug 2017, at 07:32, vinay patil <vinay18.patil@gmail.com> wrote:

Hi,

Yes, I am able to write to = S3 using DataStream API.

I have answered you the approach on SO

Regards,
Vinay = Patil

On Mon, Aug 14, 2017 at 4:21 = AM, ant burton [via Apache Flink User Mailing List archive.] <[hidden = email]> wrote:
Hello,

Has = anybody been able to write to S3 when using the data streaming API = ?


Thanks
=09 =09 =09


If you reply = to this email, your message will be added to the discussion below:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Data-Streaming-to-S3-tp14871.html
To start a new topic under Apache Flink User Mailing = List archive., email [hidden = email]
To unsubscribe from Apache Flink User Mailing List = archive., click here.
NAML

=09 =09 =09

View this message in context: Re: Flink = Data Streaming to S3
Sent from the Apache Flink User Mailing List archive. mailing list = archive at Nabble.com.

= --Apple-Mail=_A913D513-0D3A-437A-87D6-653D3CEEB216--