falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shaik Idris Ali (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-668) FeedReplicator improvement to include more DistCP options
Date Sat, 04 Oct 2014 07:29:33 GMT

    [ https://issues.apache.org/jira/browse/FALCON-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14159017#comment-14159017
] 

Shaik Idris Ali commented on FALCON-668:
----------------------------------------

I was wondering instead of making all the properties as first-class citizen can we pass the
FeedReplicator's conf arguments/Feed properties to DistCp job as it is, but I remember DistCp
job had some issue of passing this.

> FeedReplicator improvement to include more DistCP options 
> ----------------------------------------------------------
>
>                 Key: FALCON-668
>                 URL: https://issues.apache.org/jira/browse/FALCON-668
>             Project: Falcon
>          Issue Type: Bug
>          Components: replication
>            Reporter: Sowmya Ramesh
>            Assignee: Sowmya Ramesh
>             Fix For: 0.6
>
>         Attachments: FALCON-668.patch, FALCON-668.v1.patch, FALCON-668.v2.patch
>
>
> FeedReplicator improvement to include more DistCP options listed below
> * overwrite
> * ignore errors
> * skip checksum
> * remove deleted files
> * preserve block size 
> * preserve replication count
> * preserve permissions
> Also currently in FeedReplicator FEED_STORAGETYPE is used to determine usage of custom
replicator and need to do post processing. 
> Instead falcon.include.path should be used. If falcon.include.path is set then use custom
replicator and do post processing. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message