Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9A3EF200BE8 for ; Fri, 9 Dec 2016 03:01:39 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 98D93160B27; Fri, 9 Dec 2016 02:01:39 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E1150160B1F for ; Fri, 9 Dec 2016 03:01:38 +0100 (CET) Received: (qmail 81087 invoked by uid 500); 9 Dec 2016 02:01:38 -0000 Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.apache.org Delivered-To: mailing list dev@nifi.apache.org Received: (qmail 81070 invoked by uid 99); 9 Dec 2016 02:01:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 09 Dec 2016 02:01:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 43B42C9F43 for ; Fri, 9 Dec 2016 02:01:37 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.148 X-Spam-Level: ** X-Spam-Status: No, score=2.148 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 4RprediwGXlz for ; Fri, 9 Dec 2016 02:01:36 +0000 (UTC) Received: from mail-io0-f177.google.com (mail-io0-f177.google.com [209.85.223.177]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 9A0045F405 for ; Fri, 9 Dec 2016 02:01:35 +0000 (UTC) Received: by mail-io0-f177.google.com with SMTP id d9so33485668ioe.0 for ; Thu, 08 Dec 2016 18:01:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=CAnHTD0S0hwvTWxq4H3CdsCvX+CbU7i4SbIsazdc3BU=; b=rp2jx7uqgFqMjPHmO+l1N1htCl4tuBjgoxpsqzN/s0RrR3mH0XwnRse7Affsat9L+q G80ldCsLocz4RXqCvH5TVKsQZBS1Nk4kQ5GNXYw85Gc3X3RmInAKV9rSQ9jxqNr3BsDm iIMP39zqTLnopbL6AGkIkaf18aMX7goMszTv/ZKS29K7gNggpYOFirX2e58RyibuXSea aou0Y1KuLtEx9pcsALBJZBvqszNT/RQrrqo6/kTubBkbcoD1RRZ1dE+FSa2vhaqDZQPh YTXeJJq/Dqq4XzBqjZ/Om94T1mMZDsAbUp3R3xNAaNSn/IiFrQLvPvSHiJ2xkuWs0nP1 EFDQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=CAnHTD0S0hwvTWxq4H3CdsCvX+CbU7i4SbIsazdc3BU=; b=gBnjlhgWP1fw/d7WUvnt88mHZ7JaZWEcHzcDP4vOXmK/3/6JKv3OjXTZSbwalAa6/e g7e8zu792f/oJoYrrGriu7oyC1RCvPgwypBBeM0RHZWkUWQabl0Fx1jNI+HZQ35trK+o JpD+E+5lyHazBY6LOK9Xqddd3qOFve5wgL1Mcav0A7QpgdCr7+nJZxcU+Rtzg40Y4mz0 AhW9GZTMqeOwiVM56Wo0HGt/SQKO3ayQ2knm+Iwq2JTHQTyLCC4BlJg43/HoCnqEJkFW bHR25gv5OW58khAhbVhkePcxMLCFtCSIzjVEfTPtoiWPNOFxWGjjoCIuIwNbtY0jnuSL a/Sw== X-Gm-Message-State: AKaTC02nfpfOOtfD8aCSJyBkjJItbUk9ENvVukgk32QX2wZB/hVwv6hCTi8Y/jSpFml7hJMQib2k4Bfgsa5i1Q== X-Received: by 10.107.172.134 with SMTP id v128mr69299667ioe.49.1481248894325; Thu, 08 Dec 2016 18:01:34 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.146.135 with HTTP; Thu, 8 Dec 2016 18:01:33 -0800 (PST) Received: by 10.50.146.135 with HTTP; Thu, 8 Dec 2016 18:01:33 -0800 (PST) In-Reply-To: <1481238718636-14174.post@n7.nabble.com> References: <1481214833384-14169.post@n7.nabble.com> <1481217253317-14171.post@n7.nabble.com> <1481238718636-14174.post@n7.nabble.com> From: Matthew Clarke Date: Thu, 8 Dec 2016 21:01:33 -0500 Message-ID: Subject: Re: Help with "MergeContent" To: dev@nifi.apache.org Content-Type: multipart/alternative; boundary=001a1148d5d42b97bf0543302220 archived-at: Fri, 09 Dec 2016 02:01:39 -0000 --001a1148d5d42b97bf0543302220 Content-Type: text/plain; charset=UTF-8 You can set a min number of files, but also set a max bin age. This will allow a bin to continue to grow until it reaches the min, but also force it to merge if the max bin age occurs before that min is reached. This solves your 93 file issue. You just need to decide how long your are willing to wait to insure you have gotten every file you wanted merged into a single file. Matt On Dec 8, 2016 8:03 PM, "srini" wrote: > Hi Matt, > > I see some Minimum properties. But if I set 100, but the number of > flowfiles > is 93, then it never complete. > > And PutFile doesn't have append option. That is a big problem for me. > > My desired outcome is to have a single merged file that included all 170 > input files. > > thanks > Srini > > > > -- > View this message in context: http://apache-nifi-developer- > list.39713.n7.nabble.com/Help-with-MergeContent-tp14169p14174.html > Sent from the Apache NiFi Developer List mailing list archive at > Nabble.com. > --001a1148d5d42b97bf0543302220--