Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id B9142200C8C for ; Tue, 23 May 2017 03:54:19 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id B7A7C160BD4; Tue, 23 May 2017 01:54:19 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B0B1D160BBF for ; Tue, 23 May 2017 03:54:18 +0200 (CEST) Received: (qmail 42784 invoked by uid 500); 23 May 2017 01:54:17 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 42774 invoked by uid 99); 23 May 2017 01:54:17 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 May 2017 01:54:17 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 3B8B9190A20 for ; Tue, 23 May 2017 01:54:17 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.396 X-Spam-Level: X-Spam-Status: No, score=-0.396 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_NUMSUBJECT=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.796, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 4rkr2YdkLYZm for ; Tue, 23 May 2017 01:54:15 +0000 (UTC) Received: from mail-wr0-f172.google.com (mail-wr0-f172.google.com [209.85.128.172]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id DAC5E5F36B for ; Tue, 23 May 2017 01:54:14 +0000 (UTC) Received: by mail-wr0-f172.google.com with SMTP id l9so48016948wre.1 for ; Mon, 22 May 2017 18:54:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=kbkUSY+j1OthMHMvVAcEYraumOlvlWM+urKVW3N0/9s=; b=mEzHBl1wO1AXWDv/0xa9WFSlnDVZDj5Kcx2MqJ7F9+tAOzzDwJuWh4WfYRVX2UrS7u jtq1dX+aEE4aeD5dk9nolhi3/G+WmC546z3zt3JRxSubUnV4PbE0kEa2yfj1y4XaCtvy hnGgeVoXgAXtMKzH5J8bvxpGHgHNVobGzdMAw97Olnhl6LJpQIV32T+iirn85mmezK5P FROcIiRxebPWvZo/TK8QOa5qrTQJSC6XJNrzplqomX3LqEyNaZf/arANeedUO6iXbwKT IbF7MSBH89g3xESJ9/nf9+XPKSy2IiQp5jcW9mir1CAS9++ZeGyzxiygTpRP+mSBxNkg DZdw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=kbkUSY+j1OthMHMvVAcEYraumOlvlWM+urKVW3N0/9s=; b=Rd3XS2IKRFBh4/sMKPzaW4wFyHMnLxz/5N9CZpFMsaKjVu0QEF6XwdSrql54uiimXW 7LlB1AA8DvgeVLZeM7Jb30tKuL6Urk/ZlptalHrT7MqNgLuCQK1FKvyrXz2IW9V734Ax F3DBRGO5xBxXSpYvglrfhwxiJjiW6uUeLD0oDlyWQgkptSpDccD/1zMY3987sZYicW2z GTVGnd1ysc4W8Bl2ikJYkRHfWU1xHRxdASoyeZqzfAjJbst0O3lRSQBAlEK3JnK/8iXg LOE86GoqKbaSgxUhYrHA+0NzmmJvKehOsWBAC1sdY5BRe+0qOht1EleDkwXEeb10rfSp WlWg== X-Gm-Message-State: AODbwcBpqimcTjubj/cFfiwE5st1Vyl3Y/p+hsOICFhIH2je9AMQ92Ve hSU5aP8O7+7inS1/NDo70G6EHuEyNA== X-Received: by 10.223.173.131 with SMTP id w3mr13354526wrc.125.1495504448496; Mon, 22 May 2017 18:54:08 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.179.210 with HTTP; Mon, 22 May 2017 18:54:08 -0700 (PDT) In-Reply-To: <3CB7CE86-676F-4A44-AF4A-C65B1781F85B@elliemae.com> References: <3CB7CE86-676F-4A44-AF4A-C65B1781F85B@elliemae.com> From: SHI Xiaogang Date: Tue, 23 May 2017 09:54:08 +0800 Message-ID: Subject: Re: trying to externalize checkpoint to s3 To: Sathi Chowdhury Cc: "user@flink.apache.org" Content-Type: multipart/alternative; boundary="f403045cf7b069a9860550274343" archived-at: Tue, 23 May 2017 01:54:19 -0000 --f403045cf7b069a9860550274343 Content-Type: text/plain; charset="UTF-8" Hi Sathi, According to the format specification of URI, "abc-checkpoint" is the host name in the given uri and the path is null. Therefore, FsStateBackend are complaining about the usage of the root directory. Maybe "s3:///abc-checkpoint" ("///" instead of "//") is the uri that you want to use. It will put all checkpoints under the path "/abc-checkpoint". Regards, Xiaogang 2017-05-23 9:34 GMT+08:00 Sathi Chowdhury : > We are running flink 1.2 in pre production > > I am trying to test checkpoint stored in external location in s3 > > > > I have set these below in flink-conf.yaml > > > > state.backend: filesystem > > state.checkpoints.dir: s3://abc-checkpoint > > state.backend.fs.checkpointdir: s3://abc-checkpoint > > > > I get this failure in job manager log > > java.lang.Exception: Cannot initialize File System State Backend with URI > 's3://abc-checkpoint. > > at org.apache.flink.runtime.state.filesystem. > FsStateBackendFactory.createFromConfig(FsStateBackendFactory.java:57) > > at org.apache.flink.streaming.runtime.tasks.StreamTask. > createStateBackend(StreamTask.java:719) > > at org.apache.flink.streaming.runtime.tasks.StreamTask. > invoke(StreamTask.java:223) > > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: java.lang.IllegalArgumentException: Cannot use the root > directory for checkpoints. > > at org.apache.flink.runtime.state.filesystem.FsStateBackend. > validateAndNormalizeUri(FsStateBackend.java:225) > > at org.apache.flink.runtime.state.filesystem. > FsStateBackend.(FsStateBackend.java:153) > > at org.apache.flink.runtime.state.filesystem. > FsStateBackendFactory.createFromConfig(FsStateBackendFactory.java:5 > > Any clue? I thought as I am using EMR Hadoop to s3 integration is already > working. > > Thanks > Sathi > =============Notice to Recipient: This e-mail transmission, and any > documents, files or previous e-mail messages attached to it may contain > information that is confidential or legally privileged, and intended for > the use of the individual or entity named above. If you are not the > intended recipient, or a person responsible for delivering it to the > intended recipient, you are hereby notified that you must not read this > transmission and that any disclosure, copying, printing, distribution or > use of any of the information contained in or attached to this transmission > is STRICTLY PROHIBITED. If you have received this transmission in error, > please immediately notify the sender by telephone or return e-mail and > delete the original transmission and its attachments without reading or > saving in any manner. Thank you. ============= > --f403045cf7b069a9860550274343 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Sathi,

According to the format speci= fication of URI, "abc-checkpoint" is the host name in the given u= ri and the path is null. Therefore, FsStateBackend are complaining about th= e usage of the root directory.=C2=A0

Maybe "s= 3:///abc-checkpoint" ("///" instead of "//") is th= e uri that you want to use. It will put all checkpoints under the path &quo= t;/abc-checkpoint".

Regards,
Xiaoga= ng


2017-05-23 9:34 GMT+08:00 Sathi Chowdhury <= ;Sathi.Ch= owdhury@elliemae.com>:

We are =C2=A0running flink 1.2 in pre production

I am trying to test checkpoint stored in external lo= cation in s3

=C2=A0

I have set these below in flink-conf.yaml

=C2=A0

state.backend: filesystem

state.checkpoints.dir: s3://abc-checkpoint=

state.backend.fs.checkpointdir: s3://abc-checkp= oint

=C2=A0

I get this failure in job manager log

java.lang.= Exception: Cannot initialize File System State Backend with URI 's3://a= bc-checkpoint.

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.state.fi= lesystem.FsStateBackendFactory.createFromConfig(FsStateBacke= ndFactory.java:57)

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.streaming.runtim= e.tasks.StreamTask.createStateBackend(StreamTask.java:719)=

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.streaming.runtim= e.tasks.StreamTask.invoke(StreamTask.java:223)

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.taskmana= ger.Task.run(Task.java:655)

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at java.lang.Thread.run(Thread.java:= 745)

Caused by:= java.lang.IllegalArgumentException: Cannot use the root directory for= checkpoints.

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.state.fi= lesystem.FsStateBackend.validateAndNormalizeUri(FsStateBacke= nd.java:225)

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.state.fi= lesystem.FsStateBackend.<init>(FsStateBackend.java:153)<= /u>

=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 at org.apache.flink.runtime.state.fi= lesystem.FsStateBackendFactory.createFromConfig(FsStateBacke= ndFactory.java:5

Any clue? I thought as I am using EMR Hadoop to s3 i= ntegration is already working.

Thanks
Sathi

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3DNotice to Recipient: This e-mail tra= nsmission, and any documents, files or previous e-mail messages attached to= it may contain information that is confidential or legally privileged, and= intended for the use of the individual or entity named above. If you are not the intended recipient, or a person responsible for deliver= ing it to the intended recipient, you are hereby notified that you must not= read this transmission and that any disclosure, copying, printing, distrib= ution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If y= ou have received this transmission in error, please immediately notify the = sender by telephone or return e-mail and delete the original transmission a= nd its attachments without reading or saving in any manner. Thank you. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D

--f403045cf7b069a9860550274343--