Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 8F8FD200CBD for ; Thu, 22 Jun 2017 01:03:39 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 8CA65160BF0; Wed, 21 Jun 2017 23:03:39 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7C743160BD5 for ; Thu, 22 Jun 2017 01:03:38 +0200 (CEST) Received: (qmail 95619 invoked by uid 500); 21 Jun 2017 23:03:37 -0000 Mailing-List: contact user-help@beam.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@beam.apache.org Delivered-To: mailing list user@beam.apache.org Received: (qmail 95609 invoked by uid 99); 21 Jun 2017 23:03:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 21 Jun 2017 23:03:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 1C532C00A9 for ; Wed, 21 Jun 2017 23:03:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -11.525 X-Spam-Level: X-Spam-Status: No, score=-11.525 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FORGED_MUA_MOZILLA=1.596, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, USER_IN_DEF_WHITELIST=-15] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=yahoo-inc.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id H5EEove1a8YS for ; Wed, 21 Jun 2017 23:03:34 +0000 (UTC) Received: from sonic311-25.consmr.mail.ne1.yahoo.com (sonic311-25.consmr.mail.ne1.yahoo.com [66.163.188.206]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id F18DB5FCB9 for ; Wed, 21 Jun 2017 23:03:33 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo-inc.com; s=ginc1024; t=1498086207; bh=+loRE7jmh+KZAkY0IdP7UGoEA/kRzECFxaCXYnhWcgA=; h=Date:From:Reply-To:To:Subject:References:From:Subject; b=o+pNmjWYp/Y25nHLuATKsrzT4krB0F4+2K2nHx8qG862RO9uPp4KWB/5N35kbt6ROc8AqDriji7WhpzIt1s2xSi1/NExc4zTskvs9JFTu2BH8kGW+YZ1UXRzLyL87Pq5dO+lM6iY7jjvCdEGbxeJMFnNV6oYq/tMYVo8MH48OvI= X-YMail-OSG: DNiP_wsVM1kEUf1ZkScHymVT4MbgNNQH8NoMCMpqA9eJA_Tu_gRRbXq3Bk2.NBj .e_WI.qhRK9FtlsClyJpX.wQoKLlMQ2u15FDJirVYnozm8eStoqac3k80FuxWRb3vWeHJ8HSxHr6 N8yAyi7goObBRRQKKwkJW6QLNwsC9FhRZZasel.2mIgikWHbDMzwg8Pq9gabiZBc2M38yVGUc0Ls 7PzRMhgeBf45J.agZ8IW6deoJj67eE6UcfQLxwkpUhibSBjo7SD2_OrBi8RWPaPS7JzLtnQ-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.ne1.yahoo.com with HTTP; Wed, 21 Jun 2017 23:03:27 +0000 Date: Wed, 21 Jun 2017 23:03:27 +0000 (UTC) From: Will Walters Reply-To: Will Walters To: Flavio Fiszman , "user@beam.apache.org" Message-ID: <1595235333.3620957.1498086207109@mail.yahoo.com> Subject: Re: Quickstart Issue MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_3620956_1421230266.1498086207106" References: <1595235333.3620957.1498086207109.ref@mail.yahoo.com> X-Mailer: WebService/1.1.9911 YahooMailNeo Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36 archived-at: Wed, 21 Jun 2017 23:03:39 -0000 ------=_Part_3620956_1421230266.1498086207106 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable After adding more dependencies to the compilation, as in the second link yo= u provided, seems to have solved the problem.=20 Thanks for the help! =20 On Wednesday, June 21, 2017 2:14 PM, Flavio Fiszman = wrote: =20 Hi Will, did you find out what the issue was?If you did, would you mind sh= aring it so we have some knowledge of common issues in the user list?If not= , here are a couple of related questions that may be of help:https://stacko= verflow.com/questions/44497662/apache-beamunable-to-find-registrar-for-hdfs= https://stackoverflow.com/ questions/26958865/no- filesystem-for-scheme-hdf= s/ 28135140#28135140 Thanks! On Thu, Jun 15, 2017 at 10:25 AM, Will Walters wro= te: JB, That variable is already defined by default in my environment. I've put the= same path into the configuration for Flink on Yarn. -Will=20 On Tuesday, June 13, 2017 10:32 PM, Jean-Baptiste Onofr=C3=A9 wrote: =20 Hi Will, for HDFS, you can try to define the HADOOP_CONF_DIR env variable. Regards JB On 06/14/2017 12:35 AM, Will Walters wrote: > JB, >=20 > I'm trying to run the Word Count example as shown on the website. If I de= fine=20 > the path to hdfs-site.xml in the Flink config, I get an error saying "Una= ble to=20 > find registrar for HDFS." If I do not, it is unable to find the specified= file. >=20 > -Will >=20 >=20 > On Tuesday, June 13, 2017 12:23 PM, Jean-Baptiste Onofr=C3=A9 wrote: >=20 >=20 > Hi, >=20 > which sample do you try ? >=20 > For HDFS, how did you define the location of the hdfs-site.xml ? >=20 > Regards > JB >=20 > On 06/13/2017 08:31 PM, Will Walters wrote: >=C2=A0 > Hello, >=C2=A0 > >=C2=A0 > I am attempting to run the Beam quickstart with Flink on a Yarn c= luster. >=C2=A0 > However, I cannot find a file path which gets Flink to recognize = the input file. >=C2=A0 > I have tried local, absolute, and hdfs filepaths, and none of the= m have seemed >=C2=A0 > to work. Does anyone have advice about what form the filepaths sh= ould be in? >=C2=A0 > >=C2=A0 > Thank you, >=C2=A0 > Will Walters. >=20 >=20 > --=20 > Jean-Baptiste Onofr=C3=A9 > jbonofre@apache.org > http://blog.nanthrax.net > Talend - http://www.talend.com >=20 >=20 >=20 --=20 Jean-Baptiste Onofr=C3=A9 jbonofre@apache.org http://blog.nanthrax.net Talend - http://www.talend.com =20 =20 ------=_Part_3620956_1421230266.1498086207106 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
After adding more dependencies t= o the compilation, as in the second link you provided, seems to have solved= the problem.

Th= anks for the help!


On Wednesday, June 21, 2017 2:14 PM, Flavio Fiszman <flaviocf@g= oogle.com> wrote:

Hi Wil= l, did you find out what the issue was?
If you did, would you mind sharing it so we have some knowledge of comm= on issues in the user list?
If= not, here are a couple of related questions that may be of help:
https://stackoverflow.com/questions/44= 497662/apache-beamunable-to-find-registrar-for-hdfs
https://stackoverflow.com/ questions/2695886= 5/no- filesystem-for-scheme-hdfs/ 28135140#28135140
<= /div>
Thanks!

On Thu, Jun 15, 2017 at 10:25 AM, Will Walters <w= walters@yahoo-inc.com> wrote:
JB,

<= /font>
That variable is already defined by default i= n my environment. I've put the same path into the configuration for Flink o= n Yarn.

<= font face=3D"HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande= , sans-serif">-Will


On Tuesda= y, June 13, 2017 10:32 PM, Jean-Baptiste Onofr=C3=A9 <jb@nanthrax.net> wrote:


Hi Will,

for HDFS, you can try to define the HADOO= P_CONF_DIR env variable.

Regards
JB

On 06/14/2017 12:35 AM= , Will Walters wrote:
> JB,
> > I'm trying to run the Word Count example as shown on t= he website. If I define
> the path to hdfs-site.xml i= n the Flink config, I get an error saying "Unable to
>= ; find registrar for HDFS." If I do not, it is unable to find the specified= file.
>
> -Will
>
>
> On Tuesday, June 13= , 2017 12:23 PM, Jean-Baptiste Onofr=C3=A9 <jb@nanthrax.net> wrote:
>
>
> Hi,
>
> which sample do you try ?
>
> For HDFS, how did you define the location of the hdfs-sit= e.xml ?
>
> Regards
> JB
>
> On 06/13/2017 = 08:31 PM, Will Walters wrote:
>  > Hello,
>  >
>  > I am attemp= ting to run the Beam quickstart with Flink on a Yarn cluster.
>  > However, I cannot find a file path which gets Flink to= recognize the input file.
>  > I have tried l= ocal, absolute, and hdfs filepaths, and none of them have seemed
>  > to work. Does anyone have advice about what form = the filepaths should be in?
>  >
>  > Thank you,
>  > Will Walt= ers.
>
>
>= --
> Jean-Baptiste Onofr=C3=A9
>= ; jbonofre@apache.org<= /a> <mailto:jbonofr= e@apache.org>
> http://blog.nanthr= ax.net <http://blog.nanthrax.net/>
> Talend - http://www.talend.com <http:/= /www.talend.com/>


=



------=_Part_3620956_1421230266.1498086207106--