hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manoj Govindassamy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13715) Add isErasureCoded() API to FileStatus class
Date Wed, 22 Mar 2017 02:40:41 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Manoj Govindassamy updated HADOOP-13715:
    Attachment: HADOOP-13715.03.patch

Thanks [~andrew.wang], [~stevel@apache.org] for the review. Attached v03 patch with following
changes. Please take a look.

I see FileStatus#toString() extended by S3 and Swift, but not displayed as-is in on shell.
Stat command use FileStatus to construct its own customized string. And few more commands
use the FileStatus to get path or other attributes. Removing the enhancement to the FileStatus#toString()
based on the discussion.

Added TestHttpFSServerECFileStatus to verify HttpFS FileStatus with EC Files

PS: The previous precheckin run showed compilation and symbol not found errors. My clean build
is not showing any of these problems. Not sure what went wrong with the module dependencies
in the previous jenkins run. Will monitor the new precheckin run. 

> Add isErasureCoded() API to FileStatus class
> --------------------------------------------
>                 Key: HADOOP-13715
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13715
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: fs
>    Affects Versions: 3.0.0-alpha1
>            Reporter: Wei-Chiu Chuang
>            Assignee: Manoj Govindassamy
>            Priority: Blocker
>              Labels: hdfs-ec-3.0-must-do
>         Attachments: HADOOP-13715.01.patch, HADOOP-13715.02.patch, HADOOP-13715.03.patch
> Per the discussion in [HDFS-10971|https://issues.apache.org/jira/browse/HDFS-10971?focusedCommentId=15567108&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15567108]
I would like to add a new API {{isErasureCoded()}} to {{FileStatus}} so that tools and downstream
applications can tell if it needs to treat a file differently.
> Hadoop tools that can benefit from this effort include: distcp and teragen/terasort.
> Downstream applications such as flume or hbase may also benefit from it.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message