falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (FALCON-1588) Need ability to provide the path for recipe files in command line
Date Thu, 19 Nov 2015 13:52:11 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15006767#comment-15006767
] 

Peeyush Bishnoi edited comment on FALCON-1588 at 11/19/15 1:51 PM:
-------------------------------------------------------------------

To provide the recipe properties file on command line and invoking the respective recipe for
execution, it is also required to have workflow.xml and recipe template in path. To perform
this, I have thought of passing the recipe property file as follows:
{code:java}
$ ./bin/falcon recipe -name hdfs-replication -operation HDFS_REPLICATION -properties <recipe
properties file path>
{code}

For execution of recipe, if recipe properties file is provided on command line, look for the
respective recipe workflow.xml and template file in the directory path where recipe properties
file is located. Also users can still execute the recipe by specifying the directory path
through falcon.recipe.path=<recipe directory path> in conf/client.properties. To perform
this users can copy the recipe's related files from $FALCON_HOME/data-mirroring/hdfs-replication
to accessible directory. 

Similar steps can be performed for Hive replication recipe as well.

Please provide thoughts on the above approach.


was (Author: peeyushb):
To provide the recipe properties file on command line and invoking the respective recipe for
execution, it is also required to have workflow.xml and recipe template in path. To perform
this, I have thought of passing the recipe property file as follows:
{code:java}
$ ./bin/falcon recipe -operation HDFS_REPLICATION -properties recipe.properties:<recipe
properties file path>
{code}

For execution of recipe, if recipe.properties file is provided on command line, look for the
respective recipe workflow.xml and template file in one of the location on the basis of recipe
name:
   a. In the directory path where recipe.properties file is located.
   a. In the $FALCON_HOME/data-mirroring directory.
   b. In the directory path specified through falcon.recipe.path=<recipe directory path>,
if specified in conf/client.properties.

Please provide thoughts on the above approach.

> Need ability to provide the path for recipe files in command line
> -----------------------------------------------------------------
>
>                 Key: FALCON-1588
>                 URL: https://issues.apache.org/jira/browse/FALCON-1588
>             Project: Falcon
>          Issue Type: New Feature
>            Reporter: Ajay Yadava
>            Assignee: Peeyush Bishnoi
>
> Currently recipe path option can only be specified through client.properties file. We
should add an option to provide path for recipes through command line as well. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message