From user-return-25952-archive-asf-public=cust-asf.ponee.io@flink.apache.org Thu Feb 14 19:44:00 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 127E5180626 for ; Thu, 14 Feb 2019 20:43:59 +0100 (CET) Received: (qmail 44286 invoked by uid 500); 14 Feb 2019 19:43:58 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 44276 invoked by uid 99); 14 Feb 2019 19:43:58 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Feb 2019 19:43:58 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 6491D1819FD for ; Thu, 14 Feb 2019 19:43:58 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.8 X-Spam-Level: * X-Spam-Status: No, score=1.8 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id bI5Jd5WODvoR for ; Thu, 14 Feb 2019 19:43:56 +0000 (UTC) Received: from mail-ot1-f46.google.com (mail-ot1-f46.google.com [209.85.210.46]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 432465F19A for ; Thu, 14 Feb 2019 19:43:56 +0000 (UTC) Received: by mail-ot1-f46.google.com with SMTP id 98so12636698oty.1 for ; Thu, 14 Feb 2019 11:43:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=GMBov0PilRoE7juZb19gWdxPpsuuU6+BAOLsUTEeEOs=; b=YOQsUO1qpQfCgJ0C9eidycnl1RGhXHNnxf95eXCW0EzXod4vp6cGsxcItgQ0XSGPiM T1waBOC90NVlNxK0PboZg3MsDNkgYRzQ8gH5CtENRI6dhmaIB9Ar0P5+v52rPJLDJA6D 9Ps6wJD3I9ZmbGOAUeTrPYHnqzSi+DlYpgCl7B4M8fhAgREN9binMBdS2nyRCqYXu60R jlg9TbOT2I+nV+DXqBT8/FfX+6yqrkCYoYq9IbH13wKDdrbe6Zt9fYXkTmpCqyujNDHj 0XR917srmHu9MBx6nANG275ZbURaSMvbYSx4oHsCoV7uItsEySh0OcEL0dugpTJ1jTLw a0/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=GMBov0PilRoE7juZb19gWdxPpsuuU6+BAOLsUTEeEOs=; b=S8xeIe0tN2EhTnAW3yvw2d+KIVnalsSlOUaesSwahiIKlP8u2z6RPiJbPUwCDcCt/1 Vojg6QaKbZwGYgVbdj16AhRsoYz0T7Thn/w3MdI5QXupjwjswpuandDRK3z446KewA7i nAHDivOyjby8790JSarYJVYwEE7Yn23s6y5L2nz3tUP6Hxgne3Ra5763e3vIH5P4S72l dLhFcVvDvwD94ye7jxAgGFmIk1hVseGDgxk1MYOPDbS0Wb91mbw4Fmd9woU+IvEZIu3M dD+E1tibdYnnNg3ZuU/ODJ8qcS12Y65zHcciXc05BsM2YTFLmvoU2hLYSMFJ+0Sb1I4w N2/g== X-Gm-Message-State: AHQUAuYky5263mm/jvmjVHNZ2xqv0DgcEUQ5d1WVHtvr9qY5aLwXSbcM hUX9JY5xXqDjW9yOBLgv5uvn4HAhtmvcZi3OMFOmwy3Y1/w= X-Google-Smtp-Source: AHgI3IbtkCVmNsX0/BPtoA4yJpaH5WyOYcKXNSlelqLLOVuqsdCLHU+XFKXYEu/WMmkYdqnT59Mq3CIbJPxUX5qq1Nw= X-Received: by 2002:a9d:7e87:: with SMTP id m7mr3611838otp.225.1550173435245; Thu, 14 Feb 2019 11:43:55 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Vishal Santoshi Date: Thu, 14 Feb 2019 14:43:44 -0500 Message-ID: Subject: Re: StandAlone job on k8s fails with "Unknown method truncate" on restore To: user Content-Type: multipart/alternative; boundary="000000000000f2bab00581dfe064" --000000000000f2bab00581dfe064 Content-Type: text/plain; charset="UTF-8" And yes cannot work with RollingFleSink for hadoop 2.6 release of 1.7.1 b'coz of this. java.lang.UnsupportedOperationException: Recoverable writers on Hadoop are only supported for HDFS and for Hadoop version 2.7 or newer at org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter.(HadoopRecoverableWriter.java:57) at org.apache.flink.runtime.fs.hdfs.HadoopFileSystem.createRecoverableWriter(HadoopFileSystem.java:202) at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69) at org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.(Buckets.java:112) Any work around ? On Thu, Feb 14, 2019 at 1:42 PM Vishal Santoshi wrote: > The job uses a RolllingFileSink to push data to hdfs. Run an HA standalone > cluster on k8s, > > * get the job running > * kill the pod. > > The k8s deployment relaunches the pod but fails with > > java.io.IOException: Missing data in tmp file: > hdfs://nn-crunchy:8020/tmp/kafka-to-hdfs/ls_kraken_events/dt=2019-02-14/evt=ad_fill/.part-2-16.inprogress.449e8668-e886-4f89-b5f6-45ac68e25987 > > > Unknown method truncate called on > org.apache.hadoop.hdfs.protocol.ClientProtocol protocol. > > > The file does exist. We work with hadoop 2.6 , which does no have > truncate. The previous version would see that "truncate" was not supported > and drop a length file for the ,inprogress file and rename it to a valid > part file. > > > > Is this a known issue ? > > > Regards. > > > > > --000000000000f2bab00581dfe064 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
And yes=C2=A0 cannot work with RollingFleSink for hadoop 2= .6 release of 1.7.1 b'coz of this.=C2=A0

java.lang.UnsupportedOperati=
onException: Recoverable writers on Hadoop are only supported for HDFS and =
for Hadoop version 2.7 or newer
	at org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter.<init>(H=
adoopRecoverableWriter.java:57)
	at org.apache.flink.runtime.fs.hdfs.HadoopFileSystem.createRecoverableWrit=
er(HadoopFileSystem.java:202)
	at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWr=
iter(SafetyNetWrapperFileSystem.java:69)
	at org.apache.flink.streaming.api.functions.sink.filesystem.Buckets.<in=
it>(Buckets.java:112)

Any work around ?

On Thu, Feb 14, 2019 at 1:42 PM Vishal San= toshi <vishal.santoshi@gmai= l.com> wrote:
The job us= es a RolllingFileSink to push data to hdfs. Run an HA standalone cluster on= k8s,=C2=A0

* get the job running= =C2=A0
* kill the po= d.=C2=A0

=
The k8s deployment relaunc= hes the pod but fails with

java.io.IOException: Missing d= ata in tmp file: hdfs://nn-crunchy:8020/tmp/kafka-to-hdfs/ls_kraken_events/= dt=3D2019-02-14/evt=3Dad_fill/.part-2-16.inprogress.449e8668-e886-4f89-b5f6= -45ac68e25987


Unknown method truncate called= on org.apache.hadoop.hdfs.protocol.ClientProtocol protocol.<= /p>


The file does exist. We = work with hadoop 2.6 , which does no have truncate. The previous version wo= uld see that "truncate" was not supported and drop a length file = for the ,inprogress file and rename it to a valid part file.



Is this a known issue ?


Rega= rds.




--000000000000f2bab00581dfe064--