accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew George Wells (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2851) Import Table Operation removes files
Date Mon, 02 Jun 2014 22:21:02 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14015964#comment-14015964
] 

Andrew George Wells commented on ACCUMULO-2851:
-----------------------------------------------

In the current implementation. It calles FileSystem.rename(). Which is where I drew my issue.
The change requested is simply to give an option to the user if they want to keep the files
they copied on importing. 

This request at this time does not require change to anything involving the current use case
nor does it add a major feature. It would only give the user preference and control over the
files they provided.

I think I know where the distcp reimplementation comment came from, but that is not involving
this ticket.

In programming, this should just involve the components to have a Boolean option to replace
the call in the code for importing, 

FileSystem.rename(oldFile,newFile)

With

 org.apache.hadoop.fs.hadoop.FileUtil(FileSystem srcfs, Path src, FileSystem dstfs, Path dst,
boolean deleteSource, Configuration config)

> Import Table Operation removes files
> ------------------------------------
>
>                 Key: ACCUMULO-2851
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2851
>             Project: Accumulo
>          Issue Type: Wish
>    Affects Versions: 1.5.1, 1.6.0
>            Reporter: Andrew George Wells
>            Priority: Minor
>              Labels: easyfix
>             Fix For: 1.5.2, 1.6.1
>
>   Original Estimate: 12h
>  Remaining Estimate: 12h
>
> When Importing a table, the code calls rename, which moves the file away. However, in
some use cases, the user may need to keep data intact. An option should be provided to not
remove the data from the import directory.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message