hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pete Wyckoff (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-3797) FUSE module chokes on directories with lots (10,000+ or so) files
Date Sun, 20 Jul 2008 00:55:31 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12615060#action_12615060

Pete Wyckoff commented on HADOOP-3797:

The reason for this turns out to be 'ls' itself and not fuse or the kernel. If one has ls
aliased to include --color=blah, ls will stat every file.

The only solution I see is to to some sort of super simple caching of the stat info when doing
the readdir so we can then re-use it on all those stat calls. 

The best thing would be if there's a way to put those in fuse's attribute cache - I will look
into that.

-- pete

> FUSE module chokes on directories with lots (10,000+ or so) files
> -----------------------------------------------------------------
>                 Key: HADOOP-3797
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3797
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: contrib/fuse-dfs
>            Reporter: Pete Wyckoff
> For some reason, fuse is calling getattr for every file after doing a readdir. The readdir
supplies the same info so there's no reason for the getattr calls (that I can see) and it
does not do this for subdirectories.
> I don't know why it's doing this, so I sent an email to the fuse development list.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message