Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 85913200498 for ; Tue, 29 Aug 2017 08:59:32 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 83E27166254; Tue, 29 Aug 2017 06:59:32 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id A450C16624B for ; Tue, 29 Aug 2017 08:59:31 +0200 (CEST) Received: (qmail 2116 invoked by uid 500); 29 Aug 2017 06:59:30 -0000 Mailing-List: contact user-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@flink.apache.org Received: (qmail 2103 invoked by uid 99); 29 Aug 2017 06:59:30 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Aug 2017 06:59:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id B32741A48EC; Tue, 29 Aug 2017 06:59:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.379 X-Spam-Level: ** X-Spam-Status: No, score=2.379 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id opD8Fq444dQE; Tue, 29 Aug 2017 06:59:28 +0000 (UTC) Received: from mail-qk0-f195.google.com (mail-qk0-f195.google.com [209.85.220.195]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 612835F6D3; Tue, 29 Aug 2017 06:59:28 +0000 (UTC) Received: by mail-qk0-f195.google.com with SMTP id o63so2219731qkb.5; Mon, 28 Aug 2017 23:59:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=vbo/BzbCPBlrJ3b5iG1u0s+BI6v+U595lLXcEWU5k34=; b=a7R1omQll1+dAlf+/eRdr8Z9y7YzJu2qIdDpPQwjR70lhqYa7LIyHsweZxxFIOu+LN 8NJnZa+L5sI9y2xYr8RsFam9sb4XcEgUjcexKIT2vnkj10e1PRoxSlKWWQ2w2qd5ZSx2 SCzJ3gQsO0R92X7eblVnXJyPxMv68uIEg3TPpGkzKiMWco/lKf+m/YUuByFHCeK7MCh3 O+8se5CMUs7GI3Rc4hIcUI6pA4e3umOn6ujaSUB9AVMoOTFUDT9H1kYIZeGaQPUee+ma ZNeDd+5ZjHoKZX6tcQ7e4O3yAOpSu+e9wNMBy6IcXRtf7h8OqQUtJx8GbccbS4/3cNFM lEHg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=vbo/BzbCPBlrJ3b5iG1u0s+BI6v+U595lLXcEWU5k34=; b=cuC9d7t56u+6avz/x5nrAj+wJbe4AUi5LDVB1Lrqb42CKTvRAX8NTuvmrziw9WuemW pNer6ZzCMiyPXVNBehut+xuSR+aeX09AB9KqY8x+JUYrGUAxXfuea9vH/CB4xXgVU3rZ NIeNYb04mCXLF8Dc8V70bOhqk/tXgXr4D/7JFAOJGxButqt/ti0TCeIhC2Orwg+vOj+o ysomP+1PcGVDyzX3oqXtnN8LdVja40EsiF6Z8BgZr90D+3qWkvxE10hsueTnMJ6WXDWu 9gKIMoWOUWmZgBe6E5ZjbS3jcZSr8VQxEOPKwpSYt6DxFFLfE4vY5JL5EugT9hRYISeO du5A== X-Gm-Message-State: AHYfb5is2Rz4KliZVevWBDE6q1fydcPkWIjWws/NLypaOptUiFMJpwOX O8Niwcf/PS8bOdQsHjGKdhveO+FaQbE4 X-Received: by 10.55.72.73 with SMTP id v70mr4464847qka.89.1503989962352; Mon, 28 Aug 2017 23:59:22 -0700 (PDT) MIME-Version: 1.0 Received: by 10.200.44.119 with HTTP; Mon, 28 Aug 2017 23:59:21 -0700 (PDT) From: "P. Ramanjaneya Reddy" Date: Tue, 29 Aug 2017 12:29:21 +0530 Message-ID: Subject: "Unable to find registrar for hdfs" on Flink cluster To: user@flink.apache.org, dev@beam.apache.org, dev@flink.apache.org Content-Type: multipart/alternative; boundary="001a114a9a5e73ad4e0557def3ea" archived-at: Tue, 29 Aug 2017 06:59:32 -0000 --001a114a9a5e73ad4e0557def3ea Content-Type: text/plain; charset="UTF-8" Hi All, build jar file from the beam quickstart. while run the jar on Flinkcluster got below error.? anybody got this error? Could you please help how to resolve this? root1@master:~/NAI/Tools/flink-1.3.0$ *bin/flink run -c org.apache.beam.examples.WordCount /home/root1/NAI/Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar --runner=FlinkRunner --filesToStage=/home/root1/NAI/Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar --inputFile=hdfs://master:9000/test/wordcount_input.txt --output=hdfs://master:9000/test/wordcount_output919* This is the output I get: Caused by: java.lang.IllegalStateException: Unable to find registrar for hdfs at org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.java:447) at org.apache.beam.sdk.io.FileSystems.matchNewResource(FileSystems.java:517) at org.apache.beam.sdk.io.FileBasedSink.convertToFileResourceIfPossible(FileBasedSink.java:204) at org.apache.beam.sdk.io.TextIO$Write.to(TextIO.java:296) at org.apache.beam.examples.WordCount.main(WordCount.java:182) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:528) ... 13 more Thanks & Regards, Ramanji. --001a114a9a5e73ad4e0557def3ea Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi All,

build jar file from the beam quickstart. while run the j= ar on Flinkcluster got below error.?

anybody got this error?
Could you please help how to resolve this?

root1@master:~/NAI/Tools/flink-1.= 3.0$ bin/flink run -c org.apache.beam.examples.WordCount /home/root1/NAI= /Tools/word-count-beam/target/word-count-beam-bundled-0.1.jar --runner=3DFl= inkRunner --filesToStage=3D/home/root1/NAI/Tools/word-count-beam/target/wor= d-count-beam-bundled-0.1.jar --inputFile=3Dhdfs://master:9000/test/wordcoun= t_input.txt =C2=A0--output=3Dhdfs://master:9000/test/wordcount_output919


This is the output I get:

Caused= by: java.lang.IllegalStateException: Unable to find registrar for hdfs
at org.apache.beam.sdk.io.FileSystems.getFileSystemInternal(FileSystems.= java:447)
at org.apache.beam.sdk.io.FileSystems.matchNewResource(File= Systems.java:517)
at org.apache.beam.sdk.io.FileBasedSink.convertToFi= leResourceIfPossible(FileBasedSink.java:204)
at org.apache.beam.sdk.i= o.TextIO$Write.to(TextIO.java:296)
at org.apache.beam.examples.WordCo= unt.main(WordCount.java:182)
at sun.reflect.NativeMethodAccessorImpl.= invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke= (NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAcc= essorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.r= eflect.Method.invoke(Method.java:498)
at org.apache.flink.client.prog= ram.PackagedProgram.callMainMethod(PackagedProgram.java:528)
... 13 m= ore


Thanks & Regards,
Ramanji.
--001a114a9a5e73ad4e0557def3ea--