hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pumudu ruhunage <pumud...@gmail.com>
Subject Re: Error while writing to HDFS NFS from windows
Date Mon, 10 Nov 2014 06:34:20 GMT
Hi Gautam,

Did you set access privileges in hdfs-site.xml ? If access privileges are
not set, by default it's read only as i can remember. Please add following
property in "hdfs-site.xml" and restart hdfs and nfs gateway.
--------------------------------------------------------------

<property>
<name>dfs.nfs.exports.allowed.hosts</name>
<value>* rw</value>
</property>

--------------------------------------------------------------

Regards,

On 10 November 2014 10:53, Gautam Hegde <gautam@aralitechnologies.com>
wrote:

> Hi Pumudu,
>
> Thanks for your reply.
>
> The command that was used to mount on windows was
>
> mount -o nolock  mtype=hard 10.66.27.171:/! W:
>
> I was able to browse, but unable to write files. When I try to
> create/write a file, it gives me the following error,
>
>  ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: testnfs.txt dir fileId:463160
>
> Would like to use NFS itself, since we need to recreate the exact
> folder/file structure on hdfs.
>
> With Regards,
> Gautam Hegde
>
>
>
> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pumudu88@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Can you please give more details of what you tried ? What's the command
>> you execute to create? Were you able to browse hdfs through mount point ?
>> As a alternative have you tried WebHDFS[1
>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>> calls)
>>
>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>
>> Regards,
>>
>> On 7 November 2014 11:10, Gautam Hegde <gautam@aralitechnologies.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have a use case where I need to transfer files from windows to HDFS. I
>>> cannot use flume because the folder and file structure need to be
>>> replicated as they are.
>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>> hdfs on windows, but when I try to write to it I get the following error.
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: New Text Document.txt dir fileId:463160
>>>
>>>
>>> Is there any way to resolve this, so that I can successfully write from
>>> windows to HDFS NFS?
>>>
>>> Thanks in advance
>>> Gautam Hegde
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>


-- 
Pumudu Ruhunage

email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/

Mime
View raw message