From dev-return-17542-archive-asf-public=cust-asf.ponee.io@nifi.apache.org Thu Jun 14 21:33:08 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id B7F9E180600 for ; Thu, 14 Jun 2018 21:33:07 +0200 (CEST) Received: (qmail 12909 invoked by uid 500); 14 Jun 2018 19:33:01 -0000 Mailing-List: contact dev-help@nifi.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@nifi.apache.org Delivered-To: mailing list dev@nifi.apache.org Received: (qmail 12031 invoked by uid 99); 14 Jun 2018 19:33:01 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 14 Jun 2018 19:33:01 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id A66FAC00D6; Thu, 14 Jun 2018 19:33:00 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.901 X-Spam-Level: *** X-Spam-Status: No, score=3.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, KAM_BADIPHTTP=2, NORMAL_HTTP_TO_IP=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001, T_DKIMWL_WL_MED=-0.01, T_REMOTE_IMAGE=0.01, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Hfb4JOQ4gu88; Thu, 14 Jun 2018 19:32:59 +0000 (UTC) Received: from mail-oi0-f54.google.com (mail-oi0-f54.google.com [209.85.218.54]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id E47A55F1E3; Thu, 14 Jun 2018 19:32:58 +0000 (UTC) Received: by mail-oi0-f54.google.com with SMTP id k190-v6so6727605oib.9; Thu, 14 Jun 2018 12:32:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=B+ZRzn8pgDtHw2UgOx3pcyhKwFqhcZLCB/W6Fn5N0Yk=; b=aVWt5tjji7PTh1Wx8aCc/byaQlqxc6RVxdZfDmotbn62Nw/E+ycjeSbFvS+xMy5DNA MIjBCaX+m+OxJx7ivuPfHG4htJ0nUuAs1nZFCKVUKKB+KMYWrF3hO1dTaqV+qa5H2gRQ jQrneTxR5u3QLq3/zTRVv85TkNYqCmEqQaq6WWDBiLxjXVCPotiq5Cv7VjQP9OqaRTKn 1drxhszNwb28Ajza5aEmZPEJUmQ7l5m2CJu8bF62fYFoTMWPEGEZoE3CxsTz6OKNfL6C f8T9hl5k+nm8lhYvUCV4cmmYeaXBI7QZR2Yj/XcAHCVMJdmGMhLq/Z9Tb0R92F/wx8NY j6+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=B+ZRzn8pgDtHw2UgOx3pcyhKwFqhcZLCB/W6Fn5N0Yk=; b=jjYa1PX3BxOazyTyd4YeIaigxXHtTl81Pvk7yxOGcHAE/ViewZzDqE9bKUthrVkv3w LDI5AcQgdTuPypy1svYLhu34bZO5Vz6UpEvsgzdnMiNthqfOdXfbN+eY2dSEG3torowg Aj5+kkx2fABijMsemJv3kEhQbetiw7uTOGxjguUrY2ooFA1C4NK39Tp/pJpaaSZSnl2x tLtN6vELbAtCKN5Tlr2FBTD3FvfSXQjw9fZ7O4tcGcurd+06MQ5UyxImFAzYyx7NNgyW tCuJ+/73rJqSZSLP+eKVoVlX1k1Zse9LFxTMmEgnYyCycd1CZF0X/rdYrEPaPhu5qK0A Re6A== X-Gm-Message-State: APt69E2Ss2wwZRrk/tRW8m5IWvZynC4yNovIX2CXHO0znkc143a4LcRA FpLiTlD6wH00Fv/pdSayPHrdGEjVbNQ5KqsOSG76jQ== X-Google-Smtp-Source: ADUXVKIikG+EtfZ37pqwKWHUTcTFfnXf7XmO/RuSdk3v2o+tLug4CmZh/Cvyda34EWUFLVhDLk3dCVEoIC7MJz+34tk= X-Received: by 2002:aca:518e:: with SMTP id f136-v6mr2071555oib.111.1529004778215; Thu, 14 Jun 2018 12:32:58 -0700 (PDT) MIME-Version: 1.0 References: <002b01d4038a$e346dfb0$a9d49f10$@bridgera.com> <008d01d4038b$c80d4f80$5827ee80$@bridgera.com> <00c201d40412$e1c42e80$a54c8b80$@bridgera.com> <010801d40415$866f1c40$934d54c0$@bridgera.com> In-Reply-To: <010801d40415$866f1c40$934d54c0$@bridgera.com> From: Bryan Bende Date: Thu, 14 Jun 2018 15:32:47 -0400 Message-ID: Subject: Re: TCP Connection Limit Error To: Rajesh Biswas Cc: Joydeep Misra , dev@nifi.apache.org, users@nifi.apache.org Content-Type: multipart/alternative; boundary="000000000000aa5c9b056e9f2a4b" --000000000000aa5c9b056e9f2a4b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I don=E2=80=99t remember any specific bugs around the connection handling o= n NiFi side, but since there have been quite a few release since 0.6.1, it wouldn=E2=80=99t hurt to try upgrading. On Thu, Jun 14, 2018 at 3:26 PM Rajesh Biswas wrote: > Hello Bryan, > > Thank you very much for your response. > > We thoroughly checked the client piece of the code about managing the > opened connection. > > TCP Processor feeds the incoming data into Kafka Queue to inject the data > into our system. > > Do you suggest is there any known issue in NiFi (0.6.1) version, do you > suggest upgrade the version may solve this issue? > > > > Thanks and Regards, > > *Rajesh Biswas* | +91 9886433461 | www.bridgera.com > > > > *From:* Bryan Bende [mailto:bbende@gmail.com] > *Sent:* Friday, June 15, 2018 12:50 AM > *To:* users@nifi.apache.org > *Cc:* dev@nifi.apache.org > *Subject:* Re: TCP Connection Limit Error > > > > Hello, > > > > There is a counter that is incremented when a connection is opened, and > decremented when it is closed. When this counter exceeds the number > configured in the processor, then it rejects the connection with the > message you are seeing. Since you have the max connections set to 1000, > there must be over 1000 connections being opened. > > > > You could probably use something like nestat or some other networking > monitoring utility to see what connections are open. Also may want to loo= k > into whatever the source of the connections is to see how it is opening a= nd > closing connections. > > > > Thanks, > > > > Bryan > > > > On Thu, Jun 14, 2018 at 3:07 PM Rajesh Biswas > wrote: > > Hello Team, > > We are using TCP Processor to receive input from external systems. > > We are frequently receiving max connection timeout exception > > We feel the number of configured connections are more than our > requirements. > > Is there any way to monitor the open connections. > > How we can know that open connections are not closed after data is > received from external systems? > > The NiFi version is 0.6.1 > > Please find the log file for the reference > > > > Exception: > > Rejecting connection from /162.244.250.137:25558 because max connections > has been met > > > > Attached log file and processor properties > > > > > > Thanks and Regards, > > *Rajesh Biswas* | +91 9886433461 | www.bridgera.com > > > > > > > > > Virus-free. www.avast.com > > > > > -- > > Sent from Gmail Mobile > --=20 Sent from Gmail Mobile --000000000000aa5c9b056e9f2a4b--