Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 75CE5200B62 for ; Fri, 12 Aug 2016 21:05:42 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 74847160AB0; Fri, 12 Aug 2016 19:05:42 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B317C160A85 for ; Fri, 12 Aug 2016 21:05:41 +0200 (CEST) Received: (qmail 19199 invoked by uid 500); 12 Aug 2016 19:05:40 -0000 Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.apache.org Delivered-To: mailing list dev@nifi.apache.org Delivered-To: moderator for dev@nifi.apache.org Received: (qmail 15405 invoked by uid 99); 12 Aug 2016 19:04:11 -0000 X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.173 X-Spam-Level: ** X-Spam-Status: No, score=2.173 tagged_above=-999 required=6.31 tests=[DKIM_ADSP_CUSTOM_MED=0.001, NML_ADSP_CUSTOM_MED=1.2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.972] autolearn=disabled Date: Fri, 12 Aug 2016 10:48:20 -0700 (MST) From: saikrishnat To: dev@nifi.apache.org Message-ID: <1471024100501-13036.post@n7.nabble.com> Subject: How can we validate a data flow.? MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit archived-at: Fri, 12 Aug 2016 19:05:42 -0000 Hi, I need to find out if there is a way to validate the data flow end-to-end and best practises for it. lets say if i have thousands of files that i want to move to a different destinations based on some attributes and\or contents. after the job is finished i want a complete track of all files like how many files are processed successfully , how many files are failed and what are those. if i use Merge process what files are merged under each bin etc. so that it will be easy to compare the source to destination. can anything along these lines be done in NiFi.?? kind of log of all activities.? Regards, -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/How-can-we-validate-a-data-flow-tp13036.html Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.