hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Dobbins (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12057) swiftfs rename on partitioned file attempts to consolidate partitions
Date Tue, 11 Aug 2015 11:13:45 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681625#comment-14681625

David Dobbins commented on HADOOP-12057:

The sahara version of the swiftfs code lives in the [sahara-extra|http://github.com/openstack/sahara-extra]
repository, which contains [this|https://github.com/openstack/sahara-extra/blob/master/LICENSE]
Apache 2.0 license. Since it was contributed to OpenStack, original contributor rights were
surrendered to the OpenStack Foundation, per their [Contributor License Agreement|https://review.openstack.org/static/cla.html].

> swiftfs rename on partitioned file attempts to consolidate partitions
> ---------------------------------------------------------------------
>                 Key: HADOOP-12057
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12057
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs/swift
>            Reporter: David Dobbins
>            Assignee: David Dobbins
>         Attachments: HADOOP-12057-006.patch, HADOOP-12057-008.patch, HADOOP-12057.007.patch,
HADOOP-12057.patch, HADOOP-12057.patch, HADOOP-12057.patch, HADOOP-12057.patch, HADOOP-12057.patch
> In the swift filesystem for openstack, a rename operation on a partitioned file uses
the swift COPY operation, which attempts to consolidate all of the partitions into a single
object.  This causes the rename to fail when the total size of all the partitions exceeds
the maximum object size for swift.  Since partitioned files are primarily created to allow
a file to exceed the maximum object size, this bug makes writing to swift extremely unreliable.

This message was sent by Atlassian JIRA

View raw message