falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pragya Mittal (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FALCON-1412) Process waits indefinitely and finally timedout even though missing dependencies are met
Date Wed, 19 Aug 2015 14:33:45 GMT

     [ https://issues.apache.org/jira/browse/FALCON-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Pragya Mittal updated FALCON-1412:
----------------------------------
    Description: 
While scheduling a process it gets scheduled but instance keeps on waiting (although there
are no missing dependency) and finally times out.
Process -definition is :
{code}
<?xml version="1.0" encoding="UTF-8"?><process xmlns="uri:falcon:process:0.1" name="A2e5a4c86-eb1bf7ae">
    <clusters>
        <cluster name="A2e5a4c86-19a2cd05">
            <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
        </cluster>
    </clusters>
    <parallel>1</parallel>
    <order>FIFO</order>
    <frequency>minutes(5)</frequency>
    <timezone>UTC</timezone>
    <inputs>
        <input name="inputData" feed="A2e5a4c86-a870a6f8" start="now(0,-20)" end="now(0,0)"/>
    </inputs>
    <outputs>
        <output name="outputData" feed="A2e5a4c86-fcf4ee44" instance="now(0,0)"/>
    </outputs>
    <properties>
        <property name="inputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun"/>
        <property name="outputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun/output"/>
    </properties>
    <workflow path="/tmp/falcon-regression/ProcessInstanceRerunTest/aggregator"/>
    <retry policy="periodic" delay="minutes(3)" attempts="3"/>
    <ACL owner="pragya" group="dataqa" permission="*"/>
</process>
{code}

Oozie stack trace :
{code}
2015-08-19 14:29:54,187 ERROR pool-6-thread-1 CoordActionInputCheckXCommand - SERVER[ip-192-168-138-200]
USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1]
XException, 
org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to
evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
	... 6 more
Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
	at org.apache.commons.el.Logger.logError(Logger.java:484)
	at org.apache.commons.el.Logger.logError(Logger.java:545)
	at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
	... 10 more
2015-08-19 14:29:54,194  WARN pool-6-thread-1 CallableQueueService$CallableWrapper - SERVER[ip-192-168-138-200]
USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1]
exception callable [coord_action_input], E1021: Coord Action Input Check Error: Unable to
evaluate :${dataIn('inputData', 'null')}:

org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable to
evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:

	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
	... 6 more
Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function "dataIn"
	at org.apache.commons.el.Logger.logError(Logger.java:484)
	at org.apache.commons.el.Logger.logError(Logger.java:545)
	at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
	... 10 more

{code}

> Process waits indefinitely and finally timedout even though missing dependencies are
met
> ----------------------------------------------------------------------------------------
>
>                 Key: FALCON-1412
>                 URL: https://issues.apache.org/jira/browse/FALCON-1412
>             Project: Falcon
>          Issue Type: Bug
>          Components: prism
>    Affects Versions: 0.7
>         Environment: QA
>            Reporter: Pragya Mittal
>
> While scheduling a process it gets scheduled but instance keeps on waiting (although
there are no missing dependency) and finally times out.
> Process -definition is :
> {code}
> <?xml version="1.0" encoding="UTF-8"?><process xmlns="uri:falcon:process:0.1"
name="A2e5a4c86-eb1bf7ae">
>     <clusters>
>         <cluster name="A2e5a4c86-19a2cd05">
>             <validity start="2015-01-02T01:00Z" end="2015-01-02T01:04Z"/>
>         </cluster>
>     </clusters>
>     <parallel>1</parallel>
>     <order>FIFO</order>
>     <frequency>minutes(5)</frequency>
>     <timezone>UTC</timezone>
>     <inputs>
>         <input name="inputData" feed="A2e5a4c86-a870a6f8" start="now(0,-20)" end="now(0,0)"/>
>     </inputs>
>     <outputs>
>         <output name="outputData" feed="A2e5a4c86-fcf4ee44" instance="now(0,0)"/>
>     </outputs>
>     <properties>
>         <property name="inputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun"/>
>         <property name="outputPath" value="/tmp/falcon-regression/ProcessInstanceRerunTest/rerun/output"/>
>     </properties>
>     <workflow path="/tmp/falcon-regression/ProcessInstanceRerunTest/aggregator"/>
>     <retry policy="periodic" delay="minutes(3)" attempts="3"/>
>     <ACL owner="pragya" group="dataqa" permission="*"/>
> </process>
> {code}
> Oozie stack trace :
> {code}
> 2015-08-19 14:29:54,187 ERROR pool-6-thread-1 CoordActionInputCheckXCommand - SERVER[ip-192-168-138-200]
USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C] ACTION[0000005-150819132616710-oozie-oozi-C@1]
XException, 
> org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable
to evaluate :${dataIn('inputData', 'null')}:
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
> 	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
> 	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
> 	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
> 	... 6 more
> Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function
"dataIn"
> 	at org.apache.commons.el.Logger.logError(Logger.java:484)
> 	at org.apache.commons.el.Logger.logError(Logger.java:545)
> 	at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
> 	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
> 	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
> 	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
> 	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
> 	... 10 more
> 2015-08-19 14:29:54,194  WARN pool-6-thread-1 CallableQueueService$CallableWrapper -
SERVER[ip-192-168-138-200] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000005-150819132616710-oozie-oozi-C]
ACTION[0000005-150819132616710-oozie-oozi-C@1] exception callable [coord_action_input], E1021:
Coord Action Input Check Error: Unable to evaluate :${dataIn('inputData', 'null')}:
> org.apache.oozie.command.CommandException: E1021: Coord Action Input Check Error: Unable
to evaluate :${dataIn('inputData', 'null')}:
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:279)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:71)
> 	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
> 	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Unable to evaluate :${dataIn('inputData', 'null')}:
> 	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:723)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveTagContents(CoordActionInputCheckXCommand.java:398)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.materializeDataProperties(CoordActionInputCheckXCommand.java:379)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.resolveCoordConfiguration(CoordActionInputCheckXCommand.java:288)
> 	at org.apache.oozie.command.coord.CoordActionInputCheckXCommand.execute(CoordActionInputCheckXCommand.java:230)
> 	... 6 more
> Caused by: javax.servlet.jsp.el.ELException: An error occurred while evaluating function
"dataIn"
> 	at org.apache.commons.el.Logger.logError(Logger.java:484)
> 	at org.apache.commons.el.Logger.logError(Logger.java:545)
> 	at org.apache.commons.el.FunctionInvocation.evaluate(FunctionInvocation.java:174)
> 	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:263)
> 	at org.apache.commons.el.ExpressionEvaluatorImpl.evaluate(ExpressionEvaluatorImpl.java:190)
> 	at org.apache.oozie.util.ELEvaluator.evaluate(ELEvaluator.java:204)
> 	at org.apache.oozie.coord.CoordELFunctions.evalAndWrap(CoordELFunctions.java:714)
> 	... 10 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message