Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 02D631730D for ; Wed, 24 Jun 2015 10:24:28 +0000 (UTC) Received: (qmail 24369 invoked by uid 500); 24 Jun 2015 10:24:27 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 24332 invoked by uid 500); 24 Jun 2015 10:24:27 -0000 Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.apache.org Delivered-To: mailing list dev@falcon.apache.org Received: (qmail 24320 invoked by uid 99); 24 Jun 2015 10:24:27 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Jun 2015 10:24:27 +0000 X-ASF-Spam-Status: No, hits=-2001.4 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Wed, 24 Jun 2015 10:22:17 +0000 Received: (qmail 24161 invoked by uid 99); 24 Jun 2015 10:24:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 24 Jun 2015 10:24:04 +0000 Date: Wed, 24 Jun 2015 10:24:04 +0000 (UTC) From: "Peeyush Bishnoi (JIRA)" To: dev@falcon.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (FALCON-1102) Gather data transfer detail of replication job submitted from HDFS recipe MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/FALCON-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14599222#comment-14599222 ] Peeyush Bishnoi commented on FALCON-1102: ----------------------------------------- Thanks @sriksun for providing the comments. Yes I will enable this feature for standard replication as well. I want to have some thoughts for deleting the counter file. This counter file is just intermediate file to store job counter information. Once contents of counter file added to WorkflowExecutionArgs COUNTERS attribute, it is getting deleted. I could have left deletion of this counter file to log cleanup service but considering that it is intermediate file, can deletion of this file should be performed here itself once contents added to COUNTERS attribute. Also, I have tested and found that this file is getting deleted. Please suggest. > Gather data transfer detail of replication job submitted from HDFS recipe > ------------------------------------------------------------------------- > > Key: FALCON-1102 > URL: https://issues.apache.org/jira/browse/FALCON-1102 > Project: Falcon > Issue Type: Bug > Affects Versions: 0.7 > Reporter: Peeyush Bishnoi > Assignee: Peeyush Bishnoi > Fix For: 0.7 > > Attachments: FALCON-1102.patch > > > Falcon UI has a requirement to show data transfer details from replication job invoked through HDFS recipe. To carry out this, we need to capture the bytes transferred from source to destination of replication job and then populate to backend store from where UI can access. -- This message was sent by Atlassian JIRA (v6.3.4#6332)