From dev-return-17161-archive-asf-public=cust-asf.ponee.io@nifi.apache.org Fri May 4 09:50:42 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id AE0A1180634 for ; Fri, 4 May 2018 09:50:41 +0200 (CEST) Received: (qmail 47458 invoked by uid 500); 4 May 2018 07:50:40 -0000 Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.apache.org Delivered-To: mailing list dev@nifi.apache.org Received: (qmail 47425 invoked by uid 99); 4 May 2018 07:50:39 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 May 2018 07:50:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id B730818077F for ; Fri, 4 May 2018 07:50:38 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.311 X-Spam-Level: X-Spam-Status: No, score=-0.311 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=2, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id KyhQugNfrfSL for ; Fri, 4 May 2018 07:50:37 +0000 (UTC) Received: from mailout.micron.com (mailout.micron.com [137.201.242.129]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 83B795FBC9 for ; Fri, 4 May 2018 07:50:36 +0000 (UTC) Received: from mail.micron.com (bowex17a.micron.com [137.201.21.209]) by mailout.micron.com (8.14.4/8.14.6) with ESMTP id w447oSH6011195 for ; Fri, 4 May 2018 01:50:28 -0600 Received: from SIWEX5H.sing.micron.com (10.160.29.166) by bowex17a.micron.com (137.201.21.209) with Microsoft SMTP Server (TLS) id 15.0.1347.2; Fri, 4 May 2018 01:50:27 -0600 Received: from SIWEX4A.sing.micron.com (10.160.29.65) by SIWEX5H.sing.micron.com (10.160.29.166) with Microsoft SMTP Server (TLS) id 15.0.1347.2; Fri, 4 May 2018 15:50:25 +0800 Received: from SIWEX4A.sing.micron.com ([fe80::c99e:8533:9763:5a81]) by SIWEX4A.sing.micron.com ([fe80::c99e:8533:9763:5a81%25]) with mapi id 15.00.1347.000; Fri, 4 May 2018 15:50:25 +0800 From: "Peter Wicks (pwicks)" To: "dev@nifi.apache.org" Subject: ReplaceText Flow File Processing Count Thread-Topic: ReplaceText Flow File Processing Count Thread-Index: AdPje/YiMzsv4IO3RYe2pqetLX6lIw== Date: Fri, 4 May 2018 07:50:25 +0000 Message-ID: <9ee038eda24e4fc8b68e63294365cb32@SIWEX4A.sing.micron.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.160.29.124] X-TM-AS-Product-Ver: SMEX-12.0.0.1782-8.200.1013-23822.005 X-TM-AS-Result: No--23.430700-0.000000-31 X-TM-AS-MatchedID: 700756-848362-706249-700016-703491-701604-706561-709584-7 05682-701298-700107-700082-139704-113220-708196-111604-188119-700362-705718 -700345-851619-701827-700264-702497-700450-700732-701306-704425-709859-1880 38-111605-700074-303242-700079-188093-148004-148036-148050-148980-11-20020- 41000-42003-29961 X-TM-AS-User-Approved-Sender: Yes X-TM-AS-User-Blocked-Sender: No x-mt-checkinternalsenderrule: True Content-Type: multipart/alternative; boundary="_000_9ee038eda24e4fc8b68e63294365cb32SIWEX4Asingmicroncom_" MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.78 on 137.201.82.98 --_000_9ee038eda24e4fc8b68e63294365cb32SIWEX4Asingmicroncom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Had a user notice today that a ReplaceText processor, scheduled to run ever= y 20 minutes, had processed all 14 files in queue at once. I looked at the = code and see that ReplaceText does not do a standard session.get, but inste= ad calls: final List flowFiles =3D session.get(FlowFileFilters.newSizeBased= Filter(1, DataUnit.MB, 100)); Was there a design reason behind this? To us it was just really confusing t= hat we didn't have full control over how quickly FlowFile's move through th= is processor. Thanks, Peter --_000_9ee038eda24e4fc8b68e63294365cb32SIWEX4Asingmicroncom_--