hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "John George (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-8319) FileContext does not support setWriteChecksum
Date Wed, 09 May 2012 13:33:48 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13271405#comment-13271405

John George commented on HADOOP-8319:

Sorry  I missed this comment.
The side-effect is the very solution to the bug. If I tell my context: "disable writing checksums
because I really don't care about integrity", then I implicitly don't care where the data
is being written by the context. With the patch as-is, the user can't reliably control the
writing or verification of checksums w/o explicitly resolving paths and creating a new context
for the resolved path – which kind of defeats the purpose of the context.
The user can set/reset the values specific to the path. But like you said, the other option
is to allow user to only set/reset per file context (as opposed to per AFS that each path
belongs to). That might simplify the implementation and make it less complex for the user
as well. 

Do you have another solution in mind to control the flags?
The other solution is to cache the state per AFS which is the latest patch I have uploaded.
But, I am leaning towards your proposal of per FC, especially since the setWD and getWD are
implemented per FC.

Let me know your thoughts either way. Thanks for all your inputs Daryn.
> FileContext does not support setWriteChecksum
> ---------------------------------------------
>                 Key: HADOOP-8319
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8319
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.0.0, 3.0.0
>            Reporter: John George
>            Assignee: John George
>         Attachments: HADOOP-8319.patch, HADOOP-8319.patch, HADOOP-8319.patch, HADOOP-8319.patch,
HADOOP-8319.patch, HADOOP-8319.patch
> File Context does not support setWriteChecksum and hence users trying
> to use this functionality fails.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message