hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nicolas Liochon (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-5916) provide API to bulk delete directories/files
Date Tue, 25 Feb 2014 15:28:21 GMT

    [ https://issues.apache.org/jira/browse/HDFS-5916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13911658#comment-13911658
] 

Nicolas Liochon commented on HDFS-5916:
---------------------------------------

This would be great. I was actually very surprised when I discovered that bulk was not available.
On the atomicity debate: it could be an option, but If I look at what ZooKeeper did when they
added 'multi', they chose to have only fully atomic operations. It makes the API simpler for
the client, and there are  less options to manage in the server code this way...

> provide API to bulk delete directories/files
> --------------------------------------------
>
>                 Key: HDFS-5916
>                 URL: https://issues.apache.org/jira/browse/HDFS-5916
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Sergey Shelukhin
>
> It would be nice to have an API to delete directories and files in bulk - for example,
when deleting Hive partitions or HBase regions in large numbers, the code could avoid many
trips to NN. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message