hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matt Foley (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-7133) CLONE to COMMON - HDFS-1445 Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file
Date Thu, 10 Mar 2011 02:07:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13004945#comment-13004945
] 

Matt Foley commented on HADOOP-7133:
------------------------------------

Hi Hairong, glad it's working well for you.  Your suggestion to use ThreadLocal buffers is
perfect.  It will take me a little time to implement and test, though, so I'd like to go ahead
with Jakob's suggestion, if you don't mind, so we can proceed with review of the second part
of the patch in HDFS-1445.

> CLONE to COMMON - HDFS-1445 Batch the calls in DataStorage to FileUtil.createHardLink(),
so we call it once per directory instead of once per file
> --------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-7133
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7133
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: util
>    Affects Versions: 0.20.2
>            Reporter: Matt Foley
>            Assignee: Matt Foley
>             Fix For: 0.22.0
>
>         Attachments: HDFS-1445-trunk.v23_common_1-of-3.patch
>
>
> The fix for HDFS-1445 "Batch the calls in DataStorage to FileUtil.createHardLink(), so
we call it once per directory instead of once per file" requires coordinated change in COMMON
and HDFS.  This is the COMMON portion, submitted here under a separate bug to activate the
automated testing.
> Warning: this patch to COMMON, by itself, will break HDFS.  It requires coordinated commit
of the HDFS portion of the patch in HDFS-1445.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message