falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srikanth Sundarrajan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1108) Custom recipe processing
Date Thu, 19 Mar 2015 01:44:38 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14368319#comment-14368319

Srikanth Sundarrajan commented on FALCON-1108:

Launching a JVM task in Yarn and waiting for it to complete (given the vagaries of the cluster
and the availability of slots), while the user is waiting on the request seems a challenge.
Given the number of recipes that needs to be cooked and the frequency of such occurrence,
I think JVM on the falcon server seems manageable.

> Custom recipe processing
> ------------------------
>                 Key: FALCON-1108
>                 URL: https://issues.apache.org/jira/browse/FALCON-1108
>             Project: Falcon
>          Issue Type: Sub-task
>    Affects Versions: 0.6
>            Reporter: Sowmya Ramesh
>              Labels: Recipe
>             Fix For: 0.7
> Custom recipe cooking to be done on the server side in a separate independent process
than Falcon process I.e. It runs in a different JVM. For more details refer [FALCON-1107|https://issues.apache.org/jira/browse/FALCON-1107]

This message was sent by Atlassian JIRA

View raw message