hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15000) s3a new getdefaultblocksize be called in getFileStatus which has not been implemented in s3afilesystem yet
Date Wed, 01 Nov 2017 10:20:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16233888#comment-16233888
] 

Steve Loughran commented on HADOOP-15000:
-----------------------------------------

Its deprecated more at the caller level, than the implementor. We, FS implementors, always
have to implement it.

Why don't we want callers to use it? Because with aggregate filesystems (viewfs) the blocksize
may vary depending on which bit of the path you are looking at. Same for different storage
layers, where SSD may have a different policy from HDD.


> s3a new getdefaultblocksize be called in getFileStatus which has not been implemented
in s3afilesystem yet
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-15000
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15000
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>    Affects Versions: 2.9.0
>            Reporter: Yonger
>            Priority: Minor
>
> new implementation of getting block size has been called in getFileStatus method: 
> {code:java}
>           return new S3AFileStatus(meta.getContentLength(),
>               dateToLong(meta.getLastModified()),
>               path,
>               getDefaultBlockSize(path),
>               username);
>         }
> {code}
> while we don't implement it in our s3afilesystem currently, also we need to implement
this new method as the old one deprecated.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message