Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2CACE179A9 for ; Tue, 12 May 2015 14:33:30 +0000 (UTC) Received: (qmail 86857 invoked by uid 500); 12 May 2015 14:33:24 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 86732 invoked by uid 500); 12 May 2015 14:33:24 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 86721 invoked by uid 99); 12 May 2015 14:33:24 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 May 2015 14:33:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id BA567C440B for ; Tue, 12 May 2015 14:33:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.953 X-Spam-Level: *** X-Spam-Status: No, score=3.953 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_SOFTFAIL=0.972, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id yegcilUKshH4 for ; Tue, 12 May 2015 14:33:17 +0000 (UTC) Received: from mail-la0-f46.google.com (mail-la0-f46.google.com [209.85.215.46]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id EBFBC45419 for ; Tue, 12 May 2015 14:33:16 +0000 (UTC) Received: by layy10 with SMTP id y10so7449769lay.0 for ; Tue, 12 May 2015 07:33:15 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=2TXTQuTFP1mD0zynndN7e60ymVyxOQNe/sVEr1LHCXo=; b=CdIzVQ5kYgW4rPVkIUx7UqVNXbyKtauSN9d2v9u/sf6jdTdTSFmc5QezltnOcpy65q qusIP8mQxYWcSCJR/sLNteXuEw7O0To/w3i7FT0GsTDPyGaXwoEmAVNkS6d6EKDsjfX/ KGW8Bnsee8qY6ey+LgbrSrkX3ziMZMf2gg2UjZ3SeQ0FE9xOfOjYZ5kpscdB3x2GBG0X ewm0X2Araf1cQiO6XORCUG2IZVJ6tmwCIYZa+f4tjP2jlyzdcqD/mTjVmQbtsHZQmhSR RCZK3957/qXUiWjX6GBaEFdwS4zCAKPST8/viSbLU5UUV6v12PfXriQnO/kNNIlGXQVP dCrg== X-Gm-Message-State: ALoCoQldLaSr6n1So3IGlpurBgzvrmM3qLR5ejavVKbwLDx7VpKouqNAIeo2AoQvT1KWIwYpwkqPvswmvoAqBExafZEq9991ainLOqjAQ1vpDtZ1JfeNXZffwF/h9qwQ7rkBuGQLlcwp MIME-Version: 1.0 X-Received: by 10.112.29.36 with SMTP id g4mr12625767lbh.56.1431441195219; Tue, 12 May 2015 07:33:15 -0700 (PDT) Received: by 10.114.175.49 with HTTP; Tue, 12 May 2015 07:33:15 -0700 (PDT) In-Reply-To: <99A73733-25A0-4F4B-BBD1-CEADC37F6196@quobyte.com> References: <99A73733-25A0-4F4B-BBD1-CEADC37F6196@quobyte.com> Date: Tue, 12 May 2015 16:33:15 +0200 Message-ID: Subject: Re: URI missing scheme and authority in job start with new FileSystem implementation From: Silvan Kaiser To: "user@hadoop.apache.org" Content-Type: multipart/alternative; boundary=001a1133f994f55d420515e35f59 --001a1133f994f55d420515e35f59 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Varun, hi List! Just a small success feedback note: It took me quite a while but in the end i found out that not mine but AbstractFileSystem.java's resolvePath() method was used, sigh. Solution was simply to add an override in the DelegateToFileSystem impl, this override explicitely calls fsImpl.resolvePath() (which is my FileSytems implementation) and yarn is now writing correct fully qualified URIs into the job configuration. Thanks for helping! Silvan --=20 -- *Quobyte* GmbH Hardenbergplatz 2 - 10623 Berlin - Germany +49-30-814 591 800 - www.quobyte.com Amtsgericht Berlin-Charlottenburg, HRB 149012B management board: Dr. Felix Hupfeld, Dr. Bj=C3=B6rn Kolbeck, Dr. Jan Stende= r --001a1133f994f55d420515e35f59 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Varun,= hi List!
Just a small success feedback note:
It = took me quite a while but in the end i found out that not mine but Abstract= FileSystem.java's resolvePath() method was used, sigh.
Soluti= on was simply to add an override in the DelegateToFileSystem impl, this ove= rride explicitely calls fsImpl.resolvePath() (which is my FileSytems implem= entation) and yarn is now writing correct fully qualified URIs into the job= configuration.
Thanks for helping!
Silvan

=
--
Quobyte=C2=A0GmbH
Hardenbergplatz 2 - 10623 Berlin - Germany
= +49-30-814 591 800=C2=A0-=C2=A0www.quobyte.com
Amtsge= richt Berlin-Charlottenburg, HRB 149012B
management board: Dr. Felix Hup= feld, Dr. Bj=C3=B6rn Kolbeck, Dr. Jan Stender
--001a1133f994f55d420515e35f59--