falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Johannes Mayer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-2302) Same partition gets exported over and over
Date Fri, 11 Aug 2017 10:34:00 GMT

    [ https://issues.apache.org/jira/browse/FALCON-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123157#comment-16123157

Johannes Mayer commented on FALCON-2302:

I attached the feed definition and coord/wf config.
I think the problem is in coordinator.xml

    <value>export   --connect jdbc:oracle:thin:@ --table HADOOP_TEST
--username GFPROGNOSE --password Join2day --num-mappers 1 --update-mode allowinsert --skip-dist-cache
--hcatalog-database ${coord:databaseIn('export-input')} --hcatalog-table ${coord:tableIn('export-input')}
--hcatalog-partition-keys ds_year,ds_month,ds_day --hcatalog-partition-values *${coord:dataInPartitionMin('export-input','ds_year')},${coord:dataInPartitionMin('export-input','ds_month')},${coord:dataInPartitionMin('export-input','ds_day')}*

The values in bold are always: 2017-05-17

> Same partition gets exported over and over
> ------------------------------------------
>                 Key: FALCON-2302
>                 URL: https://issues.apache.org/jira/browse/FALCON-2302
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.10
>         Environment: Hortonworks Data Platform 2.6.1
>            Reporter: Johannes Mayer
>            Priority: Critical
>         Attachments: coordinator.xml, OracleFeed.xml, workflow.xml
> I want to export a HCat/Hive table to Oracle. The table is partitioned by year month
and day. As exprected, for everyday a oozie workflow is generated. but when I look at the
> {code:java}
> sqoopCommand
> {code}
> I can see *it always exports the same partition* (partition of feed start).
> The expected behaviour is, that for every day partition a workflow should be generated
that exports that given partition.

This message was sent by Atlassian JIRA

View raw message