hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "zhihai xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3549) use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.
Date Mon, 27 Apr 2015 20:11:39 GMT

    [ https://issues.apache.org/jira/browse/YARN-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514878#comment-14514878
] 

zhihai xu commented on YARN-3549:
---------------------------------

Thanks [~cnauroth], It is very nice of you to help test on windows environment.

> use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead
of shell-based implementation from RawLocalFileSystem in checkLocalDir.
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-3549
>                 URL: https://issues.apache.org/jira/browse/YARN-3549
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: zhihai xu
>            Assignee: zhihai xu
>
> Use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead
of shell-based implementation from RawLocalFileSystem in checkLocalDir.
> As discussed in YARN-3491, shell-based implementation getPermission runs shell command
"ls -ld" to get permission, which take 4 or 5 ms(very slow).
> We should switch to io.nativeio.NativeIO.POSIX#getFstat as implementation in RawLocalFileSystem
to get rid of shell-based implementation for FileStatus.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message