hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo Nicholas Sze (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-6055) Change default configuration to limit file name length in HDFS
Date Sun, 09 Mar 2014 04:48:44 GMT

    [ https://issues.apache.org/jira/browse/HDFS-6055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925113#comment-13925113
] 

Tsz Wo Nicholas Sze commented on HDFS-6055:
-------------------------------------------

> I'm attaching a patch that changes the default limit to 255. ...

+1  Changing the default to 255 sounds good.  It is the the same as Unix.

BTW, the description below is not precise.  It should be the number of "bytes" but not "characters"
since a character may occupies multiple bytes.  Could you fix it as well?
{code}
//hdfs-default.xml
  <description>Defines the maximum number of characters in each component
      of a path.  A value of 0 will disable the check.</description>
{code}

> Change default configuration to limit file name length in HDFS
> --------------------------------------------------------------
>
>                 Key: HDFS-6055
>                 URL: https://issues.apache.org/jira/browse/HDFS-6055
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>    Affects Versions: 3.0.0, 2.4.0
>            Reporter: Suresh Srinivas
>            Assignee: Chris Nauroth
>         Attachments: HDFS-6055.1.patch
>
>
> Currently configuration "dfs.namenode.fs-limits.max-component-length" is set to 0. With
this HDFS file names have no length limit. However, we see more users run into issues where
they copy files from HDFS to another file system and the copy fails due to the file name length
being too long.
> I propose changing the default configuration "dfs.namenode.fs-limits.max-component-length"
to a reasonable value. This will be an incompatible change. However, user who need long file
names can override this configuration to turn off length limit.
> What do folks think?



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message