Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 668FA17BF6 for ; Mon, 10 Nov 2014 18:46:45 +0000 (UTC) Received: (qmail 49541 invoked by uid 500); 10 Nov 2014 18:46:39 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 49435 invoked by uid 500); 10 Nov 2014 18:46:39 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 49424 invoked by uid 99); 10 Nov 2014 18:46:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Nov 2014 18:46:39 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of brandon@hortonworks.com designates 209.85.217.177 as permitted sender) Received: from [209.85.217.177] (HELO mail-lb0-f177.google.com) (209.85.217.177) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 10 Nov 2014 18:46:13 +0000 Received: by mail-lb0-f177.google.com with SMTP id u10so3047563lbd.8 for ; Mon, 10 Nov 2014 10:46:09 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=j3ysZeHAoxR7QMRQx7nhAQFeQTJJvWqYe9qAwloEEJg=; b=DloSLrC2GVXsEL6V2Mgi+GKa3wRe2TcwYWQEnT1bDVBWK4tK9Zl5GwzBs8C3vovKqD qG9xvn6MoIRN8QT7eA3f6wjvpjIo/5Aj2JG306BLczgqq+52LHQ3Uj3sZLqbSZyPuvlL p4biaPh3rmPcbcVvBThqvUK3tAo32GRtqtpd8n8FWt9oPMuevVCcXcYZBFBYRhv0hs1W 52ykL9BhOUQtw/vq58OikcX6+zDNObXz3RlVKOcw+6HxBtyGy9M4y3ALKa9gxq5UUlOB 4E4laSCqK04/DKqym5eCTllkja2Fb8x8vOBe3cuo7dR7nT+4yrTuPun91nAAjPVAWo9K M2Hw== X-Gm-Message-State: ALoCoQl/1K6EnXJHiyFLD/1gX8sYPFz5GaZcHr4w9/Y907QS+V9xeMMe1/IqMdWixyonQbnHeQ37f9cAUJe4QnOVdIlGWhDCV+cBs7tB+R9btAxtZNz5FA4= MIME-Version: 1.0 X-Received: by 10.112.147.225 with SMTP id tn1mr31394854lbb.37.1415645168872; Mon, 10 Nov 2014 10:46:08 -0800 (PST) Received: by 10.152.36.132 with HTTP; Mon, 10 Nov 2014 10:46:08 -0800 (PST) In-Reply-To: References: Date: Mon, 10 Nov 2014 10:46:08 -0800 Message-ID: Subject: Re: Error while writing to HDFS NFS from windows From: Brandon Li To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b3a8cf46b48d4050785934c X-Virus-Checked: Checked by ClamAV on apache.org --047d7b3a8cf46b48d4050785934c Content-Type: text/plain; charset=UTF-8 Hi Gautam, File update is not supported by the NFS gateway. You may want to delete original testnfs.txt before re-creating it. Thanks, Brandon On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage wrote: > Hi Gautam, > > Did you set access privileges in hdfs-site.xml ? If access privileges are > not set, by default it's read only as i can remember. Please add following > property in "hdfs-site.xml" and restart hdfs and nfs gateway. > -------------------------------------------------------------- > > > dfs.nfs.exports.allowed.hosts > * rw > > > -------------------------------------------------------------- > > Regards, > > On 10 November 2014 10:53, Gautam Hegde > wrote: > >> Hi Pumudu, >> >> Thanks for your reply. >> >> The command that was used to mount on windows was >> >> mount -o nolock mtype=hard 10.66.27.171:/! W: >> >> I was able to browse, but unable to write files. When I try to >> create/write a file, it gives me the following error, >> >> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when >> creating file: testnfs.txt dir fileId:463160 >> >> Would like to use NFS itself, since we need to recreate the exact >> folder/file structure on hdfs. >> >> With Regards, >> Gautam Hegde >> >> >> >> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage >> wrote: >> >>> Hi Gautam, >>> >>> Can you please give more details of what you tried ? What's the command >>> you execute to create? Were you able to browse hdfs through mount point ? >>> As a alternative have you tried WebHDFS[1 >>> ] ? (Since you're >>> using windows it'll be easy if you try to use webhdfs as it's based on rest >>> calls) >>> >>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html >>> >>> Regards, >>> >>> On 7 November 2014 11:10, Gautam Hegde >>> wrote: >>> >>>> Hi All, >>>> >>>> I have a use case where I need to transfer files from windows to HDFS. >>>> I cannot use flume because the folder and file structure need to be >>>> replicated as they are. >>>> HDFS NFS is the perfect thing for this use case, I was able to mount >>>> hdfs on windows, but when I try to write to it I get the following error. >>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when >>>> creating file: New Text Document.txt dir fileId:463160 >>>> >>>> >>>> Is there any way to resolve this, so that I can successfully write from >>>> windows to HDFS NFS? >>>> >>>> Thanks in advance >>>> Gautam Hegde >>>> >>>> >>> >>> >>> -- >>> Pumudu Ruhunage >>> >>> email : pumudu88@gmail.com >>> work email : pumudu@wso2.com >>> Blog : http://pumuduruhunage.blogspot.com/ >>> >> >> > > > -- > Pumudu Ruhunage > > email : pumudu88@gmail.com > work email : pumudu@wso2.com > Blog : http://pumuduruhunage.blogspot.com/ > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You. --047d7b3a8cf46b48d4050785934c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Gautam,

File update is not suppo= rted by the NFS gateway. You may want to delete original testnfs.txt before= re-creating it.

Thanks,
Brandon

On Sun, Nov 9, 2014 at 10:34 PM, P= umudu ruhunage <pumudu88@gmail.com> wrote:
Hi Gautam,

Did you se= t access privileges in hdfs-site.xml ? If access privileges are not set, by= default it's read only as i can remember. Please add following propert= y in "hdfs-site.xml= "=C2=A0and restart hdfs and nfs gateway.
-----------------------------------= ---------------------------

<property>
<name>dfs.nfs.exports.allowed.hosts</= name>
<value>* rw</value>
</property>

-----------------------------------= ---------------------------

Regards,

On 10 November 2014 10:53, = Gautam Hegde <gautam@aralitechnologies.com> wrote= :
Hi Pumu= du,

Thanks for your reply.

The co= mmand that was used to mount on windows was

mount -o nolock=C2=A0 mt= ype=3Dhard 10.66.27.171:/! W:

I was able to browse, but u= nable to write files. When I try to create/write a file, it gives me the fo= llowing error,

=C2=A0ERROR nfs3.RpcProgramNfs3: Setting file size is= not supported when creating file: testnfs.txt dir fileId:463160
<= div>
Would like to use NFS itself, since we need to recreate the e= xact folder/file structure on hdfs.

With Regards,
Gautam He= gde



=
On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage= <pumudu88@gmail.com> wrote:
Hi Gautam,

Can you please give more= details of what you tried ? What's the command you execute to create? = Were you able to browse hdfs through mount point ?
As a alternative hav= e you tried WebHDFS[1] ? (Since you're using windows it'll= be easy if you try to use webhdfs as it's based on rest calls)


Regards,

On 7 November 2014 11:10, Gautam Hegde <gautam@aral= itechnologies.com> wrote:
Hi All,

I have a use case where I need to transfer fil= es from windows to HDFS. I cannot use flume because the folder and file str= ucture need to be replicated as they are.
HDFS NFS is the perfect= thing for this use case, I was able to mount hdfs on windows, but when I t= ry to write to it I get the following error.
ERROR nfs3.RpcProgramNfs3: Setting = file size is not supported when creating file: New Text Document.txt dir fi= leId:463160


Is there any way to resolve this, so that I can successfully write fro= m windows to HDFS NFS?=C2=A0

Thanks in advanc= e=C2=A0
Gautam Hegde




<= font color=3D"#888888">--
Pumudu Ruhunage
email :=C2=A0pumudu88@gmail.com
work email : pumudu@wso2.com




--
=
Pumudu Ruhunage



CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u. --047d7b3a8cf46b48d4050785934c--