hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Venner <ja...@attributor.com>
Subject Re: [jira] Updated: (HADOOP-4) tool to mount dfs on linux
Date Thu, 07 Feb 2008 23:02:57 GMT
I have been using this extensively, I think the version prior to the 
addition of the directory write operations.
I see high reliability when the fuse_dfs is run ON the master name node, 
I see low reliability when run on other machines.

I was running hadoop streaming job, that for each record copied out a 
100k-1M file into tmp, via fuse_dfs and ran an operation on it.

It appeared that the JVM's were crashing - I wonder if there wasn't a 
large enough ram size but the error logs are getting lost unless I run 
the fuse debug from the command line.

Pete Wyckoff (JIRA) wrote:
>      [ https://issues.apache.org/jira/browse/HADOOP-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
>
> Pete Wyckoff updated HADOOP-4:
> ------------------------------
>
>     Attachment: fuse-dfs.tar.gz
>
> Here's a version with configure to make things easier.
>
> Just run bootstrap.sh after setting the right hdfs, fuse and jdk paths.
>
> I still haven't added a version # (next on my list) or better docs (next next on my list).
>
> --- pete
>
>
>   
>> tool to mount dfs on linux
>> --------------------------
>>
>>                 Key: HADOOP-4
>>                 URL: https://issues.apache.org/jira/browse/HADOOP-4
>>             Project: Hadoop Core
>>          Issue Type: Improvement
>>          Components: fs
>>    Affects Versions: 0.5.0
>>         Environment: linux only
>>            Reporter: John Xing
>>            Assignee: Doug Cutting
>>         Attachments: fuse-dfs.tar.gz, fuse-dfs.tar.gz, fuse-hadoop-0.1.0_fuse-j.2.2.3_hadoop.0.5.0.tar.gz,
fuse-hadoop-0.1.0_fuse-j.2.4_hadoop.0.5.0.tar.gz, fuse-hadoop-0.1.1.tar.gz, fuse-j-hadoopfs-03.tar.gz,
fuse_dfs.c, fuse_dfs.c, Makefile
>>
>>
>> tool to mount dfs on linux
>>     
>
>   
-- 
Jason Venner
Attributor - Publish with Confidence <http://www.attributor.com/>
Attributor is hiring Hadoop Wranglers, contact if interested

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message