falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Srikanth Sundarrajan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-796) Enable users to triage data processing issues through falcon
Date Sun, 28 Jun 2015 05:31:04 GMT

    [ https://issues.apache.org/jira/browse/FALCON-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604541#comment-14604541
] 

Srikanth Sundarrajan commented on FALCON-796:
---------------------------------------------

+1

> Enable users to triage data processing issues through falcon
> ------------------------------------------------------------
>
>                 Key: FALCON-796
>                 URL: https://issues.apache.org/jira/browse/FALCON-796
>             Project: Falcon
>          Issue Type: New Feature
>            Reporter: Srikanth Sundarrajan
>            Assignee: Ajay Yadava
>             Fix For: 0.7
>
>         Attachments: FALCON-796-v2.patch, FALCON-796.patch, FALCON-796.patch
>
>
> Falcon has a wealth of information that can help users to triage issues relating to their
pipelines, but this information is not available in a consumable form to the users. Here is
a suggestion to solve for this issue to some extent.
> In a typical usage scenario, users may find that their data has not been generated and
that would require them to walk up the dependency tree to identify the root cause. Luckily
all this information is available within Falcon and can be surfaced. 
> A mock of how this would look:
> *falcon instance -type feed -name FEED-abc -start 2014-10-01T00:00Z -end 2014-10-01T00:00Z
 -triage*
> {noformat}
> FEED-abc/2014-10-01T00:00Z MISSING
>   + PROCESS-def/2014-10-02T04:00Z WAITING
>     + FEED-ghi/2014-10-01T00:00Z MISSING
>       + PROCESS-mno/2014-10-01T01:30Z  RUNNING
>     + FEED-ghi/2014-10-01T01:00Z MISSING
>       + PROCESS-mno/2014-10-01T02:30Z  FAILED
>     + FEED-ghi/*                 AVAIALBLE
>     + FEED-jkl/*                 AVAILABLE
> {noformat}
> *falcon instance -type feed -name FEED-abc -start 2014-09-01T00:00Z -end 2014-09-01T00:00Z
 -triage*
> {noformat}
> FEED-abc/2014-09-01T00:00Z AVAILABLE
> {noformat}
> *falcon instance -type process -name PROCESS-def -start 2014-10-01T00:00Z -end 2014-10-01T00:00Z
 -triage*
> {noformat}
> PROCESS-def/2014-10-02T04:00Z WAITING
>   + FEED-ghi/2014-10-01T00:00Z MISSING
>     + PROCESS-mno/2014-10-01T01:30Z  RUNNING
>   + FEED-ghi/2014-10-01T01:00Z MISSING
>     + PROCESS-mno/2014-10-01T02:30Z  FAILED
>   + FEED-ghi/*                 AVAIALBLE
>   + FEED-jkl/*                 AVAILABLE
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message