falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shwetha G S (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-234) Replication feed not respecting partition filter instead copying all data to target
Date Mon, 28 Apr 2014 06:55:16 GMT

    [ https://issues.apache.org/jira/browse/FALCON-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13982787#comment-13982787
] 

Shwetha G S commented on FALCON-234:
------------------------------------

>From the logs, looks like data was copied correctly:
{noformat}
2013-12-19 02:16:59,153 INFO [main] org.apache.hadoop.tools.mapred.CopyMapper: Copying hftp://arpit-falcon-colo3-2.cs1cloud.internal:50070/localDC/rc/billing/2012/10/01/12/00/ua1
to hdfs://arpit-falcon-colo2-2.cs1cloud.internal:8020/clusterPath/localDC/rc/billing/2012/10/01/12/00/ua1
{noformat}

> Replication feed not respecting partition filter instead copying all data to target
> -----------------------------------------------------------------------------------
>
>                 Key: FALCON-234
>                 URL: https://issues.apache.org/jira/browse/FALCON-234
>             Project: Falcon
>          Issue Type: Bug
>          Components: replication
>    Affects Versions: 0.4
>            Reporter: Arpit Gupta
>            Assignee: Venkatesh Seetharam
>         Attachments: feed.xml, oozie-job-conf.txt, yarn-actual-map-task.txt, yarn-oozie-launcher-stdout.txt,
yarn-oozie-launcher-syslog.txt
>
>
> A replication feed was setup where the source was
> cluster-1:8020/data with partition set to ua1. The feed instead of copying over just
cluster-1:8020/data/ua1 copied over cluster-1:8020/data.
> This was seen on a cluster running Hadoop 2.2.0 and Oozie 4.0.0



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message