hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hairong Kuang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HDFS-222) Support for concatenating of files into a single file
Date Fri, 23 Oct 2009 19:11:59 GMT

    [ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12769372#action_12769372
] 

Hairong Kuang commented on HDFS-222:
------------------------------------

Borris, sorry that more comments are here. Hope that this will be the last iteration:
# Exam all loggings at the info level to see if you can either remove them or change them
to be debug level
# Remove the change to BlockManager.java since the code is already commented.
# FSNamesystem.java:
#* no need to verify quota since target and sources are in the same directory
#* should use getINodeFile to get inode of target & sources
#* no need to check if srcInode is root
#* minor: cacatInternal better to be a synchronized method in FSDirectory
# FSDirectory.java
#* No need to track & update disk space consumed in upprotectedConcat.
#* in deleteFileWithoutComment, no need to update modification time for the parent for every
source & update disk space consumed.
#* you might be able to remove deleteFileWithoutCommit to take advantage of target & sources
are under one parent.
#* minor: optimize the number of copies when concatenating blocks.
# FSEditLog.java: check version # for handling OP_CONCAT_DELETE in loadEditLogs.

> Support for concatenating of files into a single file
> -----------------------------------------------------
>
>                 Key: HDFS-222
>                 URL: https://issues.apache.org/jira/browse/HDFS-222
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Venkatesh S
>            Assignee: Boris Shkolnik
>         Attachments: HDFS-222-1.patch, HDFS-222-2.patch, HDFS-222-3.patch, HDFS-222-4.patch,
HDFS-222-5.patch, HDFS-222-6.patch, HDFS-222-7.patch, HDFS-222-8.patch, HDFS-222-9.patch,
HDFS-222.patch
>
>
> An API to concatenate files of same size and replication factor on HDFS into a single
larger file.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message