hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raghu Angadi (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-2063) Command to pull corrupted files
Date Wed, 20 Feb 2008 23:39:43 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12570886#action_12570886

Raghu Angadi commented on HADOOP-2063:

> I think it might not be useful to sent it to stdout
hmm.. it is just file data right? 

> The checksum feature is not available for some other FileSystem. So I am not sure whether
we should make it as a FileSystem property. I will think about this.

Though this is not available in other filesystems, it is used by the generic FsShell layer
as an argument to generic command. In that sense the flag might belong in FileSystem. LocalFileSystem
can certainly support it. I think it also makes the implementation simpler.

> Command to pull corrupted files
> -------------------------------
>                 Key: HADOOP-2063
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2063
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.14.1
>            Reporter: Koji Noguchi
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.17.0
>         Attachments: 2063_20080219.patch, 2063_20080220.patch
> Before 0.14, dfs -get didn't perform checksum checking.   
> Users were able to download the corrupted files to see if they want to delete them.
> After 0.14, dfs -get also does the checksumming. 
> Requesting a command for no-checksum-get command.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message