falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Landon Robinson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-668) FeedReplicator improvement to include more DistCP options
Date Thu, 09 Apr 2015 19:22:13 GMT

    [ https://issues.apache.org/jira/browse/FALCON-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488054#comment-14488054
] 

Landon Robinson commented on FALCON-668:
----------------------------------------

We're having issues in Falcon due to this very issue. Are there any initiatives to leverage
these new options, or bring them back into Falcon via DistCP? We need to be able to preserve
the blocksize of files across clusters.

> FeedReplicator improvement to include more DistCP options 
> ----------------------------------------------------------
>
>                 Key: FALCON-668
>                 URL: https://issues.apache.org/jira/browse/FALCON-668
>             Project: Falcon
>          Issue Type: Improvement
>          Components: replication
>            Reporter: Sowmya Ramesh
>            Assignee: Sowmya Ramesh
>         Attachments: FALCON-668.patch, FALCON-668.v1.patch, FALCON-668.v2.patch
>
>
> FeedReplicator improvement to include more DistCP options listed below
> * overwrite
> * ignore errors
> * skip checksum
> * remove deleted files
> * preserve block size 
> * preserve replication count
> * preserve permissions
> Also currently in FeedReplicator FEED_STORAGETYPE is used to determine usage of custom
replicator and need to do post processing. 
> Instead falcon.include.path should be used. If falcon.include.path is set then use custom
replicator and do post processing. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message