hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-14255) S3A to delete unnecessary fake directory objects in mkdirs()
Date Wed, 29 Mar 2017 21:57:41 GMT
Mingliang Liu created HADOOP-14255:

             Summary: S3A to delete unnecessary fake directory objects in mkdirs()
                 Key: HADOOP-14255
                 URL: https://issues.apache.org/jira/browse/HADOOP-14255
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
            Reporter: Mingliang Liu
            Assignee: Mingliang Liu

In S3AFileSystem, as an optimization, we delete unnecessary fake directory objects if that
directory contains at least one (nested) file. That is done in closing stream of newly created
file. However, if the directory becomes non-empty after we just create an empty subdirectory,
we do not delete its fake directory object though that fake directory object becomes "unnecessary".

So in {{S3AFileSystem::mkdirs()}}, we have a pending TODO:
  // TODO: If we have created an empty file at /foo/bar and we then call
  // mkdirs for /foo/bar/baz/roo what happens to the empty file /foo/bar/?
  private boolean innerMkdirs(Path p, FsPermission permission)

This JIRA is to fix the TODO: provide consistent behavior for a fake directory object between
its nested subdirectory and nested file by deleting it.

See related discussion in [HADOOP-14236].

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org

View raw message