falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FALCON-1618) Unable to run OOZIE (MapReduce) workflow through Falcon Process
Date Mon, 23 Nov 2015 04:36:11 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021514#comment-15021514
] 

Peeyush Bishnoi edited comment on FALCON-1618 at 11/23/15 4:35 AM:
-------------------------------------------------------------------

[~saktheesh] Is it possible for you to share the Falcon cluster, feed and process entity to
debug this issue. It is quite strange that you are getting this issue as on HDP cluster, I
have several times executed the Oozie MR workflow through Falcon without any issues.


was (Author: peeyushb):
[~saktheesh] Is it possible for you to share the Falcon cluster, feed and process entity to
debug this issue.

> Unable to run OOZIE (MapReduce)  workflow through Falcon Process
> ----------------------------------------------------------------
>
>                 Key: FALCON-1618
>                 URL: https://issues.apache.org/jira/browse/FALCON-1618
>             Project: Falcon
>          Issue Type: Bug
>          Components: oozie
>    Affects Versions: 0.6.1, trunk
>         Environment: HDP 2.3.2
>            Reporter: Saktheesh Balaraj
>            Priority: Blocker
>
> Error:
> ~~~~
> Caused by: org.apache.falcon.FalconException: E1004 : E1004: Expression language evaluation
error, Unable to evaluate :${dataIn('input', 'null')}:
>         at org.apache.falcon.workflow.engine.OozieWorkflowEngine.dryRunInternal(OozieWorkflowEngine.java:234)
> Environment:  HDP2.3.2 Sandbox
> ~~~~~~~~~~
> Observation:
> ~~~~~~~~~~
> This could be due to wrong property values in OOZIE coordinator file being generated
by Falcon for an OOZIE workflow (MR).
> Current Values:
>                 <property>
>                     <name>falconInPaths</name>
>                     <value>${dataIn('input', 'null')}</value>
>                 </property>
>                 <property>
>                     <name>input</name>
>                     <value>${dataIn('input', 'null')}</value>
>                 </property>
> Expected Values:
> ~~~~~~~~~~~~~
> <property>
>                     <name>falconInPaths</name>
>                     <value>coord:{dataIn('input', 'null')}</value>
>                 </property>
>                 <property>
>                     <name>input</name>
>                     <value>coord:{dataIn('input', 'null')}</value>
>                 </property>
> Steps to simulate the problem:
> ~~~~~~~~~~~~~~~~~~~~~~~~
> 1.Install  HDP 2.3.2 Sandbox
> 	2. Enable Falcon through Ambari
> 	3. Configure Feed (input), Feed (output)
> 	4. Configure process with the following configurations
> 		-input (input Feed)
> 		-output (output Feed)
> 	5. Schedule the process through Falcon 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message