falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peeyush Bishnoi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1102) Gather data transfer detail of replication job submitted from HDFS recipe
Date Wed, 24 Jun 2015 10:24:04 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14599222#comment-14599222

Peeyush Bishnoi commented on FALCON-1102:

Thanks @sriksun for providing the comments.

Yes I will enable this feature for standard replication as well. 

I want to have some thoughts for deleting the counter file. This counter file is just intermediate
file to store job counter information. Once contents of counter file added to WorkflowExecutionArgs
COUNTERS  attribute, it is getting deleted. I could have left deletion of this counter file
to log cleanup service but considering that it is intermediate file, can deletion of this
file should be performed here itself once contents added to COUNTERS attribute. Also, I have
tested and found that this file is getting deleted. 

Please suggest.

> Gather data transfer detail of replication job submitted from HDFS recipe
> -------------------------------------------------------------------------
>                 Key: FALCON-1102
>                 URL: https://issues.apache.org/jira/browse/FALCON-1102
>             Project: Falcon
>          Issue Type: Bug
>    Affects Versions: 0.7
>            Reporter: Peeyush Bishnoi
>            Assignee: Peeyush Bishnoi
>             Fix For: 0.7
>         Attachments: FALCON-1102.patch
> Falcon UI has a requirement to show data transfer details from replication job invoked
through HDFS recipe. To carry out this, we need to capture the bytes transferred from source
to destination of replication job and then populate to backend store from where UI can access.

This message was sent by Atlassian JIRA

View raw message