Return-Path: X-Original-To: apmail-flink-user-archive@minotaur.apache.org Delivered-To: apmail-flink-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AF99817A1E for ; Tue, 31 Mar 2015 09:18:00 +0000 (UTC) Received: (qmail 40604 invoked by uid 500); 31 Mar 2015 09:18:00 -0000 Delivered-To: apmail-flink-user-archive@flink.apache.org Received: (qmail 40536 invoked by uid 500); 31 Mar 2015 09:18:00 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flink.apache.org Delivered-To: mailing list user@flink.apache.org Received: (qmail 40522 invoked by uid 99); 31 Mar 2015 09:18:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 Mar 2015 09:18:00 +0000 X-ASF-Spam-Status: No, hits=-1996.5 required=5.0 tests=ALL_TRUSTED,HTML_MESSAGE,T_RP_MATCHES_RCVD,URI_HEX X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 31 Mar 2015 09:17:59 +0000 Received: (qmail 40082 invoked by uid 99); 31 Mar 2015 09:17:39 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 31 Mar 2015 09:17:39 +0000 Received: from mail-la0-f42.google.com (mail-la0-f42.google.com [209.85.215.42]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id BBCA71A046D for ; Tue, 31 Mar 2015 09:17:38 +0000 (UTC) Received: by lagg8 with SMTP id g8so7902201lag.1 for ; Tue, 31 Mar 2015 02:17:37 -0700 (PDT) X-Gm-Message-State: ALoCoQm7WRgVO64NGTru/Rir4tN60vuvp4lIPfARn1W0uYYM+lzDbGjVyzxmNr+23XZAwdwOrTAm X-Received: by 10.152.207.40 with SMTP id lt8mr23370135lac.52.1427793456999; Tue, 31 Mar 2015 02:17:36 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.46.130 with HTTP; Tue, 31 Mar 2015 02:16:56 -0700 (PDT) In-Reply-To: <1427792023387-946.post@n4.nabble.com> References: <1427792023387-946.post@n4.nabble.com> From: Ufuk Celebi Date: Tue, 31 Mar 2015 11:16:56 +0200 Message-ID: Subject: Re: Problem with Amazon S3 To: user@flink.apache.org Cc: user@flink.incubator.apache.org Content-Type: multipart/alternative; boundary=001a113478f0d14ba7051292117f X-Virus-Checked: Checked by ClamAV on apache.org --001a113478f0d14ba7051292117f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hey Pietro! You have to add the following lines to your flink-conf.yaml: fs.s3.accessKey: fs.s3.secretKey: I will fix the error message to include a hint on how to configure this correctly. =E2=80=93 Ufuk On Tue, Mar 31, 2015 at 10:53 AM, pietro wrote: > Dear all, > I have been developing a Flink application that has to run on Amazon > Elastic > Map Reduce. > > For convenience the data that the application has to read and write are o= n > the S3. > > But, I have not been able to access S3 .This is the error I got: > org.apache.flink.client.program.ProgramInvocationException: The program > execution failed: Cannot initialize task 'DataSink > (LowLevel.FlinkImplementation.MyWriter@826539e)': Cannot determine access > key to Amazon S3 > > What shall I do? > > Many thanks in advance > > > > -- > View this message in context: > http://apache-flink-incubator-user-mailing-list-archive.2336050.n4.nabble= .com/Problem-with-Amazon-S3-tp946.html > Sent from the Apache Flink (Incubator) User Mailing List archive. mailing > list archive at Nabble.com. > --001a113478f0d14ba7051292117f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hey Pietro!

You have= to add the following lines to your flink-conf.yaml:

fs.s3.acc= essKey: <YOUR ACCESS KEY>
fs.s3.secretKey: <YOUR SECRET K= EY>

I will fix the error message to include a hint on how t= o configure this correctly.

=E2=80=93 Ufuk
<= br>

On Tue, Mar 31, 2015 at 10:53 AM, pietro <pietro.pinoli@gm= ail.com> wrote:
Dear all, I have been developing a Flink application that has to run on Amazon Elasti= c
Map Reduce.

For convenience the data that the application has to read and write are on<= br> the S3.

But, I have not been able to access S3 .This is the error I got:
org.apache.flink.client.program.ProgramInvocationException: The program
execution failed: Cannot initialize task 'DataSink
(LowLevel.FlinkImplementation.MyWriter@826539e)': Cannot determine acce= ss
key to Amazon S3

What shall I do?

Many thanks in advance



--
View this message in context: http://apache-flink-incubator-user-mailing-list-archi= ve.2336050.n4.nabble.com/Problem-with-Amazon-S3-tp946.html
Sent from the Apache Flink (Incubator) User Mailing List archive. mailing l= ist archive at Nabble.com.

--001a113478f0d14ba7051292117f--