hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ivan Mitic (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-4839) add NativeIO#mkdirs, that provides an error message on failure
Date Tue, 21 May 2013 06:23:19 GMT

    [ https://issues.apache.org/jira/browse/HDFS-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13662737#comment-13662737

Ivan Mitic commented on HDFS-4839:

Thanks Colin for providing the additional context. Some comments inline.

bq. It's not difficult to give relevant error messages on all platforms, including Windows
and all the UNIXes.
I was never arguing that it’s hard to give error messages on all platforms. However, each
time we add platform dependent code it adds on the cost over time and makes things more complex
w.r.t. cross-platform support. IOW, let’s do this only when absolutely necessary. 

bq. I have had to diagnose issues in production clusters where rename or mkdir failed, and
the logs did not reveal why. It's not fun. And it can lead to very serious code and/or system
administration problems getting misdiagnosed.
Thanks, this is a valid point, I agree. 

> add NativeIO#mkdirs, that provides an error message on failure
> --------------------------------------------------------------
>                 Key: HDFS-4839
>                 URL: https://issues.apache.org/jira/browse/HDFS-4839
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 2.0.5-beta
>            Reporter: Colin Patrick McCabe
>            Priority: Minor
> It would be nice to have a variant of mkdirs that provided an error message explaining
why it failed.  This would make it easier to debug certain failing unit tests that rely on
mkdir / mkdirs-- the ChecksumFilesystem tests, for example.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message