Return-Path: <dev-return-23256-archive-asf-public=cust-asf.ponee.io@falcon.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id 897A4200B6D
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Tue, 23 Aug 2016 15:56:26 +0200 (CEST)
Received: by cust-asf.ponee.io (Postfix)
	id 882AC160AAD; Tue, 23 Aug 2016 13:56:26 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id CE024160AA5
	for <archive-asf-public@cust-asf.ponee.io>; Tue, 23 Aug 2016 15:56:24 +0200 (CEST)
Received: (qmail 21074 invoked by uid 500); 23 Aug 2016 13:56:24 -0000
Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@falcon.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@falcon.apache.org>
List-Post: <mailto:dev@falcon.apache.org>
List-Id: <dev.falcon.apache.org>
Reply-To: dev@falcon.apache.org
Delivered-To: mailing list dev@falcon.apache.org
Received: (qmail 21062 invoked by uid 99); 23 Aug 2016 13:56:24 -0000
Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2016 13:56:23 +0000
Received: from localhost (localhost [127.0.0.1])
	by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 90309C9E3A
	for <dev@falcon.apache.org>; Tue, 23 Aug 2016 13:56:23 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: -3.739
X-Spam-Level: 
X-Spam-Status: No, score=-3.739 tagged_above=-999 required=6.31
	tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1,
	RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01,
	RP_MATCHES_RCVD=-0.519] autolearn=disabled
Received: from mx2-lw-us.apache.org ([10.40.0.8])
	by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024)
	with ESMTP id tfGr0m6a7AW4 for <dev@falcon.apache.org>;
	Tue, 23 Aug 2016 13:56:21 +0000 (UTC)
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with SMTP id 086275FAD1
	for <dev@falcon.incubator.apache.org>; Tue, 23 Aug 2016 13:56:20 +0000 (UTC)
Received: (qmail 21042 invoked by uid 99); 23 Aug 2016 13:56:20 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 23 Aug 2016 13:56:20 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 770D42C014E
	for <dev@falcon.incubator.apache.org>; Tue, 23 Aug 2016 13:56:20 +0000 (UTC)
Date: Tue, 23 Aug 2016 13:56:20 +0000 (UTC)
From: "Pragya Mittal (JIRA)" <jira@apache.org>
To: dev@falcon.incubator.apache.org
Message-ID: <JIRA.12999200.1471956437000.383422.1471960580484@Atlassian.JIRA>
In-Reply-To: <JIRA.12999200.1471956437000@Atlassian.JIRA>
References: <JIRA.12999200.1471956437000@Atlassian.JIRA> <JIRA.12999200.1471956437983@arcas>
Subject: [jira] [Commented] (FALCON-2125) Feed replication fails due to
 failed post processing action missing in workflow
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
archived-at: Tue, 23 Aug 2016 13:56:26 -0000


    [ https://issues.apache.org/jira/browse/FALCON-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432829#comment-15432829 ] 

Pragya Mittal commented on FALCON-2125:
---------------------------------------

Feed definition is :
{noformat}
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<feed name="A7769e4e0-bf3ce415" description="Input File" xmlns="uri:falcon:feed:0.1">
    <partitions>
        <partition name="colo"/>
        <partition name="eventTime"/>
        <partition name="impressionHour"/>
        <partition name="pricingModel"/>
    </partitions>
    <frequency>minutes(5)</frequency>
    <timezone>UTC</timezone>
    <late-arrival cut-off="days(100000)"/>
    <clusters>
        <cluster name="A7769e4e0-adb310ea" type="source" version="0">
            <validity start="2016-08-23T12:55Z" end="2016-08-23T13:00Z"/>
            <retention limit="days(1000000)" action="delete"/>
        </cluster>
        <cluster name="A7769e4e0-5a50ac8e" type="target" version="0">
            <validity start="2016-08-23T12:55Z" end="2016-08-23T13:00Z"/>
            <retention limit="days(1000000)" action="delete"/>
            <locations>
                <location type="data" path="/tmp/falcon-regression/FeedReplicationTest/target/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
            </locations>
        </cluster>
    </clusters>
    <locations>
        <location type="data" path="/tmp/falcon-regression/FeedReplicationTest/source/${YEAR}/${MONTH}/${DAY}/${HOUR}/${MINUTE}"/>
        <location type="stats" path="/data/regression/fetlrc/billing/stats"/>
        <location type="meta" path="/data/regression/fetlrc/billing/metadata"/>
    </locations>
    <ACL owner="pragya.mittal" group="dataqa" permission="*"/>
    <schema location="/databus/streams_local/click_rr/schema/" provider="protobuf"/>
    <properties>
        <property name="field1" value="value1"/>
        <property name="field2" value="value2"/>
        <property name="job.counter" value="true"/>
    </properties>
</feed>
{noformat}

> Feed replication fails due to failed post processing action missing in workflow
> -------------------------------------------------------------------------------
>
>                 Key: FALCON-2125
>                 URL: https://issues.apache.org/jira/browse/FALCON-2125
>             Project: Falcon
>          Issue Type: Bug
>          Components: feed, process
>    Affects Versions: trunk, 1.0
>            Reporter: Pragya Mittal
>            Assignee: Praveen Adlakha
>
> https://issues.apache.org/jira/browse/FALCON-2039 introduced threadpool capacity for log moving in server. I have scheduled a feed (replication) and it is failing with failed post processing.
> Workflow:
> {noformat}
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <workflow-app xmlns="uri:oozie:workflow:0.3" name="FALCON_FEED_REPLICATION_A7769e4e0-bf3ce415">
>     <start to="pre-processing"/>
>     <action name="pre-processing" retry-max="3" retry-interval="1">
>         <java>
>             <job-tracker>${jobTracker}</job-tracker>
>             <name-node>${nameNode}</name-node>
>             <configuration>
>                 <property>
>                     <name>mapred.job.queue.name</name>
>                     <value>${queueName}</value>
>                 </property>
>                 <property>
>                     <name>oozie.launcher.mapred.job.priority</name>
>                     <value>${jobPriority}</value>
>                 </property>
>                 <property>
>                     <name>oozie.action.sharelib.for.java</name>
>                     <value>hcatalog</value>
>                 </property>
>                 <property>
>                     <name>oozie.launcher.oozie.libpath</name>
>                     <value>${wf:conf(&quot;falcon.libpath&quot;)}</value>
>                 </property>
>             </configuration>
>             <main-class>org.apache.falcon.workflow.LateDataHandler</main-class>
>             <arg>-out</arg>
>             <arg>${logDir}/latedata/${nominalTime}/${srcClusterName}</arg>
>             <arg>-paths</arg>
>             <arg>${falconInPaths}</arg>
>             <arg>-falconInputNames</arg>
>             <arg>${falconInputNames}</arg>
>             <arg>-falconInputFeedStorageTypes</arg>
>             <arg>${falconInputFeedStorageTypes}</arg>
>             <arg>-out</arg>
>             <arg>${logDir}/latedata/${nominalTime}/${srcClusterName}</arg>
>             <capture-output/>
>         </java>
>         <ok to="replication"/>
>         <error to="failed-post-processing"/>
>     </action>
>     <action name="replication">
>         <java>
>             <job-tracker>${jobTracker}</job-tracker>
>             <name-node>${nameNode}</name-node>
>             <configuration>
>                 <property>
>                     <name>oozie.launcher.mapreduce.job.user.classpath.first</name>
>                     <value>true</value>
>                 </property>
>                 <property>
>                     <name>mapred.job.queue.name</name>
>                     <value>${queueName}</value>
>                 </property>
>                 <property>
>                     <name>oozie.launcher.mapred.job.priority</name>
>                     <value>${jobPriority}</value>
>                 </property>
>                 <property>
>                     <name>oozie.action.sharelib.for.java</name>
>                     <value>distcp</value>
>                 </property>
>                 <property>
>                     <name>oozie.launcher.oozie.libpath</name>
>                     <value>${wf:conf(&quot;falcon.libpath&quot;)}</value>
>                 </property>
>             </configuration>
>             <main-class>org.apache.falcon.replication.FeedReplicator</main-class>
>             <arg>-Dfalcon.include.path=${sourceRelativePaths}</arg>
>             <arg>-Dmapred.job.queue.name=${queueName}</arg>
>             <arg>-Dmapred.job.priority=${jobPriority}</arg>
>             <arg>-maxMaps</arg>
>             <arg>${maxMaps}</arg>
>             <arg>-mapBandwidth</arg>
>             <arg>${mapBandwidth}</arg>
>             <arg>-sourcePaths</arg>
>             <arg>${distcpSourcePaths}</arg>
>             <arg>-targetPath</arg>
>             <arg>${distcpTargetPaths}</arg>
>             <arg>-falconFeedStorageType</arg>
>             <arg>${falconFeedStorageType}</arg>
>             <arg>-availabilityFlag</arg>
>             <arg>${availabilityFlag == 'NA' ? &quot;NA&quot; : availabilityFlag}</arg>
>             <arg>-counterLogDir</arg>
>             <arg>${logDir}/job-${nominalTime}/${srcClusterName == 'NA' ? '' : srcClusterName}</arg>
>         </java>
>         <ok to="end"/>
>         <error to="fail"/>
>     </action>
>     <kill name="fail">
>         <message>Workflow failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
>     </kill>
>     <end name="end"/>
> </workflow-app>
> {noformat}
> Oozie logs :
> {noformat}
> 2016-08-23 18:27:36,856 ERROR pool-6-thread-2 SubmitXCommand - SERVER[8RPCG32.corp.inmobi.com] USER[pragya.mittal] GROUP[-] TOKEN[] APP[FALCON_FEED_REPLICATION_A7769e4e0-bf3ce415_A7769e4e0-adb310ea] JOB[0000004-160823182134602-oozie-oozi-C] ACTION[0000004-160823182134602-oozie-oozi-C@1] XException,
> org.apache.oozie.command.CommandException: E0708: Invalid transition, node [pre-processing] transition [failed-post-processing]
>        	at org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:272)
>        	at org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:76)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.DagEngine.submitJobFromCoordinator(DagEngine.java:138)
>        	at org.apache.oozie.command.coord.CoordActionStartXCommand.execute(CoordActionStartXCommand.java:214)
>        	at org.apache.oozie.command.coord.CoordActionStartXCommand.execute(CoordActionStartXCommand.java:63)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:356)
>        	at org.apache.oozie.command.coord.CoordActionReadyXCommand.execute(CoordActionReadyXCommand.java:128)
>        	at org.apache.oozie.command.coord.CoordActionReadyXCommand.execute(CoordActionReadyXCommand.java:42)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:356)
>        	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:235)
>        	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
>        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>        	at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.oozie.workflow.WorkflowException: E0708: Invalid transition, node [pre-processing] transition [failed-post-processing]
>        	at org.apache.oozie.workflow.lite.LiteWorkflowAppParser.validate(LiteWorkflowAppParser.java:560)
>        	at org.apache.oozie.workflow.lite.LiteWorkflowAppParser.validate(LiteWorkflowAppParser.java:573)
>        	at org.apache.oozie.workflow.lite.LiteWorkflowAppParser.validateAndParse(LiteWorkflowAppParser.java:162)
>        	at org.apache.oozie.workflow.lite.LiteWorkflowLib.parseDef(LiteWorkflowLib.java:58)
>        	at org.apache.oozie.service.LiteWorkflowAppService.parseDef(LiteWorkflowAppService.java:58)
>        	at org.apache.oozie.service.LiteWorkflowAppService.parseDef(LiteWorkflowAppService.java:47)
>        	at org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:165)
>        	... 18 more
> 2016-08-23 18:27:36,859  WARN pool-6-thread-2 CoordActionStartXCommand - SERVER[8RPCG32.corp.inmobi.com] USER[pragya.mittal] GROUP[-] TOKEN[] APP[FALCON_FEED_REPLICATION_A7769e4e0-bf3ce415_A7769e4e0-adb310ea] JOB[0000004-160823182134602-oozie-oozi-C] ACTION[0000004-160823182134602-oozie-oozi-C@1] can not create DagEngine for submitting jobs
> org.apache.oozie.DagEngineException: E0708: Invalid transition, node [pre-processing] transition [failed-post-processing]
>        	at org.apache.oozie.DagEngine.submitJobFromCoordinator(DagEngine.java:143)
>        	at org.apache.oozie.command.coord.CoordActionStartXCommand.execute(CoordActionStartXCommand.java:214)
>        	at org.apache.oozie.command.coord.CoordActionStartXCommand.execute(CoordActionStartXCommand.java:63)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:356)
>        	at org.apache.oozie.command.coord.CoordActionReadyXCommand.execute(CoordActionReadyXCommand.java:128)
>        	at org.apache.oozie.command.coord.CoordActionReadyXCommand.execute(CoordActionReadyXCommand.java:42)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:356)
>        	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:235)
>        	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
>        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>        	at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.oozie.command.CommandException: E0708: Invalid transition, node [pre-processing] transition [failed-post-processing]
>        	at org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:272)
>        	at org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:76)
>        	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
>        	at org.apache.oozie.DagEngine.submitJobFromCoordinator(DagEngine.java:138)
>        	... 15 more
> Caused by: org.apache.oozie.workflow.WorkflowException: E0708: Invalid transition, node [pre-processing] transition [failed-post-processing]
>        	at org.apache.oozie.workflow.lite.LiteWorkflowAppParser.validate(LiteWorkflowAppParser.java:560)
>        	at org.apache.oozie.workflow.lite.LiteWorkflowAppParser.validate(LiteWorkflowAppParser.java:573)
>        	at org.apache.oozie.workflow.lite.LiteWorkflowAppParser.validateAndParse(LiteWorkflowAppParser.java:162)
>        	at org.apache.oozie.workflow.lite.LiteWorkflowLib.parseDef(LiteWorkflowLib.java:58)
>        	at org.apache.oozie.service.LiteWorkflowAppService.parseDef(LiteWorkflowAppService.java:58)
>        	at org.apache.oozie.service.LiteWorkflowAppService.parseDef(LiteWorkflowAppService.java:47)
>        	at org.apache.oozie.command.wf.SubmitXCommand.execute(SubmitXCommand.java:165)
>        	... 18 more
> 2016-08-23 18:27:36,859 ERROR pool-6-thread-2 CoordActionStartXCommand - SERVER[8RPCG32.corp.inmobi.com] USER[pragya.mittal] GROUP[-] TOKEN[] APP[FALCON_FEED_REPLICATION_A7769e4e0-bf3ce415_A7769e4e0-adb310ea] JOB[0000004-160823182134602-oozie-oozi-C] ACTION[0000004-160823182134602-oozie-oozi-C@1] Failing the action 0000004-160823182134602-oozie-oozi-C@1. Because E0708 : E0708: Invalid transition, node [pre-processing] transition [failed-post-processing]
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)