Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2745118FE8 for ; Mon, 14 Dec 2015 19:11:27 +0000 (UTC) Received: (qmail 77644 invoked by uid 500); 14 Dec 2015 19:11:25 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 77574 invoked by uid 500); 14 Dec 2015 19:11:25 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 77563 invoked by uid 99); 14 Dec 2015 19:11:25 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 14 Dec 2015 19:11:25 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id EE2CE1A0396 for ; Mon, 14 Dec 2015 19:11:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.874 X-Spam-Level: X-Spam-Status: No, score=0.874 tagged_above=-999 required=6.31 tests=[FSL_HELO_BARE_IP_2=0.873, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id OEW9QP2ti1Fk for ; Mon, 14 Dec 2015 19:11:12 +0000 (UTC) Received: from relayvx12c.securemail.intermedia.net (relayvx12c.securemail.intermedia.net [64.78.52.187]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 2E88126AD2 for ; Mon, 14 Dec 2015 19:11:12 +0000 (UTC) Received: from securemail.intermedia.net (localhost [127.0.0.1]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id C9C3953DE2 for ; Mon, 14 Dec 2015 11:11:11 -0800 (PST) Subject: Re: Connection between TempletonJob and Worker Nodes remains in FIN_WAIT_2 state for long time MIME-Version: 1.0 x-echoworx-msg-id: 532d0498-0587-40a1-97b3-9d59970d5ad4 x-echoworx-emg-received: Mon, 14 Dec 2015 11:11:11.756 -0800 x-echoworx-action: delivered Received: from 10.254.155.17 ([10.254.155.17]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 831 for ; Mon, 14 Dec 2015 11:11:11 -0800 (PST) Received: from MBX080-W4-CO-2.exch080.serverpod.net (unknown [10.224.117.102]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by emg-ca-1-2.localdomain (Postfix) with ESMTPS id 8FE6853DE2 for ; Mon, 14 Dec 2015 11:11:11 -0800 (PST) Received: from MBX080-W4-CO-1.exch080.serverpod.net (10.224.117.101) by MBX080-W4-CO-2.exch080.serverpod.net (10.224.117.102) with Microsoft SMTP Server (TLS) id 15.0.1130.7; Mon, 14 Dec 2015 11:11:09 -0800 Received: from MBX080-W4-CO-1.exch080.serverpod.net ([10.224.117.101]) by mbx080-w4-co-1.exch080.serverpod.net ([10.224.117.101]) with mapi id 15.00.1130.005; Mon, 14 Dec 2015 11:11:09 -0800 From: Eugene Koifman To: "user@hive.apache.org" Thread-Topic: Connection between TempletonJob and Worker Nodes remains in FIN_WAIT_2 state for long time Thread-Index: AQHRNHF5RQxbIltxs0i70WbVClc0nJ7K3XuA Date: Mon, 14 Dec 2015 19:11:08 +0000 Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [192.175.27.10] x-source-routing-agent: Processed Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable https://cwiki.apache.org/confluence/display/Hive/WebHCat+Reference+Hive lets you submit a file with SQL statements Eugene On 12/11/15, 4:09 PM, "mahender bigdata" wrote: >Hi, >We have submitted too many jobs to webhcat (templeton) reason is our HQL >has multiple hive statements,each hive statement is submitted as a job >causing too many job, after some times all the submitted job are in >pending state. later after waiting for 2 hrs, all the pending jobs got >completed. But we were not able to submit jobs to WEBHCAT, When we >remote head node and run netstat -a, I see too many ports open >(incremental manner ) to templeton port. All the Connections are in >FIN_WAIT_2, where client is not sending 'FIN' token to server. Is there >a way to set time out for server to close this connection after some hr >or mins. So that we dont have too many connection or ports opened and >get into hang state. > >Another Question, can we run all the hive statements in HQL file in >single shot rather than each individual hive statement has hive job. > >Thanks in advance. > > >