hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brandon Li <bran...@hortonworks.com>
Subject Re: Error while writing to HDFS NFS from windows
Date Mon, 10 Nov 2014 18:46:08 GMT
Hi Gautam,

File update is not supported by the NFS gateway. You may want to delete
original testnfs.txt before re-creating it.

Thanks,
Brandon

On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pumudu88@gmail.com> wrote:

> Hi Gautam,
>
> Did you set access privileges in hdfs-site.xml ? If access privileges are
> not set, by default it's read only as i can remember. Please add following
> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
> --------------------------------------------------------------
>
> <property>
> <name>dfs.nfs.exports.allowed.hosts</name>
> <value>* rw</value>
> </property>
>
> --------------------------------------------------------------
>
> Regards,
>
> On 10 November 2014 10:53, Gautam Hegde <gautam@aralitechnologies.com>
> wrote:
>
>> Hi Pumudu,
>>
>> Thanks for your reply.
>>
>> The command that was used to mount on windows was
>>
>> mount -o nolock  mtype=hard 10.66.27.171:/! W:
>>
>> I was able to browse, but unable to write files. When I try to
>> create/write a file, it gives me the following error,
>>
>>  ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: testnfs.txt dir fileId:463160
>>
>> Would like to use NFS itself, since we need to recreate the exact
>> folder/file structure on hdfs.
>>
>> With Regards,
>> Gautam Hegde
>>
>>
>>
>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pumudu88@gmail.com>
>> wrote:
>>
>>> Hi Gautam,
>>>
>>> Can you please give more details of what you tried ? What's the command
>>> you execute to create? Were you able to browse hdfs through mount point ?
>>> As a alternative have you tried WebHDFS[1
>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>> calls)
>>>
>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>
>>> Regards,
>>>
>>> On 7 November 2014 11:10, Gautam Hegde <gautam@aralitechnologies.com>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>> I cannot use flume because the folder and file structure need to be
>>>> replicated as they are.
>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>> creating file: New Text Document.txt dir fileId:463160
>>>>
>>>>
>>>> Is there any way to resolve this, so that I can successfully write from
>>>> windows to HDFS NFS?
>>>>
>>>> Thanks in advance
>>>> Gautam Hegde
>>>>
>>>>
>>>
>>>
>>> --
>>> Pumudu Ruhunage
>>>
>>> email : pumudu88@gmail.com
>>> work email : pumudu@wso2.com
>>> Blog : http://pumuduruhunage.blogspot.com/
>>>
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Mime
View raw message