Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1D73B17D4C for ; Wed, 25 Feb 2015 20:38:22 +0000 (UTC) Received: (qmail 95234 invoked by uid 500); 25 Feb 2015 20:38:20 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 95168 invoked by uid 500); 25 Feb 2015 20:38:20 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 95158 invoked by uid 99); 25 Feb 2015 20:38:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Feb 2015 20:38:20 +0000 X-ASF-Spam-Status: No, hits=4.2 required=5.0 tests=FSL_HELO_BARE_IP_2,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of vgumashta@hortonworks.com designates 64.78.52.187 as permitted sender) Received: from [64.78.52.187] (HELO relayvx12c.securemail.intermedia.net) (64.78.52.187) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 25 Feb 2015 20:38:15 +0000 Received: from securemail.intermedia.net (localhost [127.0.0.1]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id CA83D53E92 for ; Wed, 25 Feb 2015 12:37:33 -0800 (PST) Subject: Re: ERROR OutOfMemoryError: Java heap space MIME-Version: 1.0 x-echoworx-emg-received: Wed, 25 Feb 2015 12:37:33.819 -0800 x-echoworx-msg-id: 5c0bf293-45c0-4380-b5f7-3c4a596c26aa x-echoworx-action: delivered Received: from 10.254.155.17 ([10.254.155.17]) by emg-ca-1-2 (JAMES SMTP Server 2.3.2) with SMTP ID 667 for ; Wed, 25 Feb 2015 12:37:33 -0800 (PST) Received: from MBX080-W4-CO-1.exch080.serverpod.net (unknown [10.224.117.101]) by emg-ca-1-2.localdomain (Postfix) with ESMTP id 86B4B53E92 for ; Wed, 25 Feb 2015 12:37:33 -0800 (PST) Received: from MBX080-W4-CO-1.exch080.serverpod.net (10.224.117.101) by MBX080-W4-CO-1.exch080.serverpod.net (10.224.117.101) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Wed, 25 Feb 2015 12:37:32 -0800 Received: from MBX080-W4-CO-1.exch080.serverpod.net ([10.224.117.101]) by mbx080-w4-co-1.exch080.serverpod.net ([10.224.117.101]) with mapi id 15.00.1044.021; Wed, 25 Feb 2015 12:37:32 -0800 From: Vaibhav Gumashta To: "user@hive.apache.org" Thread-Topic: ERROR OutOfMemoryError: Java heap space Thread-Index: AQHQUNktpzv5/s1PZUCKeZ4XYIDOiZ0Bl5kAgAACFgCAAAFWgIAAAvoAgAABVoCAAAzeAIAAB0QAgAAB7QCAAA6fAIAAEAuA Date: Wed, 25 Feb 2015 20:37:32 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [192.175.27.15] x-source-routing-agent: Processed Content-Type: multipart/alternative; boundary="_000_D11371C6F5E9vgumashtahortonworkscom_" X-Virus-Checked: Checked by ClamAV on apache.org --_000_D11371C6F5E9vgumashtahortonworkscom_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hi, auth=3Dnosasl should be only provided in JDBC url if "hive.server2.authenti= cation=94 is explicitly set to NOSASL in your hive-site. Otherwise, the jdb= c client tries to open a plain socket while the the server is expecting a s= asl negotiation to happen. Due to an issue with thrift, this results in OOM= on client side. =97Vaibhav From: Srinivas Thunga > Reply-To: "user@hive.apache.org" > Date: Wednesday, February 25, 2015 at 3:40 AM To: "user@hive.apache.org" > Subject: Re: ERROR OutOfMemoryError: Java heap space Is your problem solved? Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 4:17 PM, Srinivas Thunga > wrote: Hi, You can set fetch size based certain datatype like blob, image, etc statement.setFetchSize(1000); Try this. Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 4:10 PM, Jadhav Shweta > wrote: Query is working fine if i have small data set in same table. But its throwing error for large data set Thanks Shweta Jadhav -----Srinivas Thunga > wrote: ----- To: "user@hive.apache.org" > From: Srinivas Thunga > Date: 02/25/2015 03:45PM Subject: Re: ERROR OutOfMemoryError: Java heap space not required. Make sure there will not be unnecessary looping in your code Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 2:58 PM, Jadhav Shweta > wrote: Do I need to increase HADOOP_HEAPSIZE I haven't set it. I have cluster with 4 machines each having 8GB ram. I read somewhere that we should mention auth=3DnoSasl in hive jdbc url. Is = it necessary Thanks Shweta Jadhav -----Jadhav Shweta > wr= ote: ----- To: user@hive.apache.org From: Jadhav Shweta > Date: 02/25/2015 02:54PM Subject: Re: ERROR OutOfMemoryError: Java heap space I am running the query using spring batch framework. Thanks Shweta Jadhav -----Srinivas Thunga > wrote: ----- To: "user@hive.apache.org" > From: Srinivas Thunga > Date: 02/25/2015 02:43PM Subject: Re: ERROR OutOfMemoryError: Java heap space Hi, Might be problem in your code. Generally it happens when there are unnecessary looping. Please check your java code. Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 2:38 PM, Jadhav Shweta > wrote: Hi I have installed apache hive 0.13.0. I have configured metastore as postgres db. Query is working fine in beeline command line interface but giving Heap spa= ce error while executing using JDBC java client. Thanks Shweta Jadhav -----Srinivas Thunga > wrote: ----- To: "user@hive.apache.org" > From: Srinivas Thunga > Date: 02/25/2015 02:32PM Subject: Re: ERROR OutOfMemoryError: Java heap space Hi, Let me know how you configured Hive? R u using cloudera? If you are installed Hive separately then have you configured Metastore? Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 2:27 PM, Jadhav Shweta > wrote: Hi I am running simple select query select * from table; thanks Shweta Jadhav -----Srinivas Thunga > wrote: ----- To: "user@hive.apache.org" > From: Srinivas Thunga > Date: 02/25/2015 01:09PM Subject: Re: Hi, Can you place the query as well which you are trying? Thanks & Regards, Srinivas T On Wed, Feb 25, 2015 at 1:02 PM, Jadhav Shweta > wrote: Hi I am trying to run hive query Its getting executed from beeline interface but its throwing java.lang.OutOfMemoryError: Java heap space error when connecting using jdbc. I am using hive 0.13.0 version and hiveserver2. which parameters i need to configure for the same. thanks Shweta Jadhav =3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D Notice: The information contained in this e-mail message and/or attachments to it may contain confidential or privileged information. If you are not the intended recipient, any dissemination, use, review, distribution, printing or copying of the information contained in this e-mail message and/or attachments to it are strictly prohibited. If you have received this communication in error, please notify us by reply e-mail or telephone and immediately and permanently delete the message and any attachments. Thank you --_000_D11371C6F5E9vgumashtahortonworkscom_ Content-Type: text/html; charset="Windows-1252" Content-ID: Content-Transfer-Encoding: quoted-printable
Hi,

auth=3Dnosasl should be only provided in JDBC url if "hive.server= 2.authentication=94 is explicitly set to NOSASL in your hive-site. Otherwis= e, the jdbc client tries to open a plain socket while the the server is exp= ecting a sasl negotiation to happen. Due to an issue with thrift, this results in OOM on client side.

=97Vaibhav

From: Srinivas Thunga <srinivas.thunga@gmail.com>
Reply-To: "user@hive.apache.org" <user@hive.apache.org>
Date: Wednesday, February 25, 2015 = at 3:40 AM
To: "user@hive.apache.org" <user@hive.apache.org>
Subject: Re: ERROR OutOfMemoryError= : Java heap space

Is your problem solved?

Thanks & Regards,

Srinivas T

On Wed, Feb 25, 2015 at 4:17 PM, Srinivas Thunga= <srinivas= .thunga@gmail.com> wrote:
Hi,

You can set fetch size based cer= tain datatype like blob, image, etc

statement.setFetchSize(1000);

Try this.


Thanks & Regards,

Srinivas T
On Wed, Feb 25, 2015 at 4:10 PM, Jadhav Shweta <= span dir=3D"ltr"> <jadhav.shwet= a@tcs.com> wrote:
Query is working fine if i have small data set in same table.
But its throwing error for large data set

Thanks
Shweta Jadhav



-----Srinivas Thunga <srinivas.thunga@gmail.com> wrot= e: -----
To: "user= @hive.apache.org" <user@hive.apache.org>
From: Srinivas Thunga <srinivas.thunga@gmail.com>
Date: 02/25/2015 03:45PM
<= /font>
<= br> Subject: Re: ERROR OutOfMemoryError: Java heap space

not required. Make sure there will not be unnecessary loop= ing in your code

Thanks & Regards,

Srinivas T
On Wed, Feb 25, 2015 at 2:58 PM, Jadhav Shweta <jadhav.shweta@tcs.com> wrote:
Do I need to increase HADOOP_HEAPSIZE
I haven't set it.
I have cluster with 4 machines each having 8GB ram.
I read somewhere that we should mention auth=3DnoSasl in hive jdbc url= . Is it necessary

Thanks
Shweta Jadhav



-----Jadhav Shweta <jadhav.shweta@tcs.com> wrote: -----
To: user@hive.apache.org
From: Jadhav Shweta <jadhav.shweta@tcs.com>
Date: 02/25/2015 02:54PM

Subject: Re: ERROR OutOfMemoryError: Java heap space

I am running the query using spring batch framework.

Thanks
Shweta Jadhav

-----Srinivas Thunga <srinivas.thunga@gmail.com> wrot= e: -----
To: "user= @hive.apache.org" <user@hive.apache.org>
From: Srinivas Thunga <srinivas.thunga@gmail.com>
Date: 02/25/2015 02:43PM
Subject: Re: ERROR OutOfMemoryError: Java heap space

Hi,

Might be problem in your code.

Generally it happens when there are unnecessary looping.

Please check your java code. 

Thanks & Regards,

Srinivas T

On Wed, Feb 25, 2015 at 2:38 PM, Jadhav Shweta <= span dir=3D"ltr"> <jadhav.shwet= a@tcs.com> wrote:
Hi

I have installed apache hive 0.13.0.
I have configured metastore as postgres db.
Query is working fine in beeline command line interface but giving Hea= p space error while executing using JDBC java client.

Thanks
Shweta Jadhav

-----Srinivas Thunga <srinivas.thunga@gmail.com> wrot= e: -----
To: "user@hive.apache.org" <user@hive.apache.org>
From: Srinivas Thunga <srinivas.thunga@gmail.com>
Date: 02/25/2015 02:32PM
Subject: Re: ERROR OutOfMemoryError: Java heap space


Hi,

Let me know how you configured Hive?

R u using cloudera?

If you are installed Hive separately then have you configured Metastor= e?



Thanks & Regards,

Srinivas T

On Wed, Feb 25, 2015 at 2:27 PM, Jadhav Shweta <= span dir=3D"ltr"> <jadhav.shwet= a@tcs.com> wrote:
Hi

I am running simple select query

select * from table;

thanks
Shweta Jadhav



-----Srinivas Thunga <srinivas.thunga@gmail.com> wrot= e: -----
To: "user= @hive.apache.org" <user@hive.apache.org>
From: Srinivas Thunga <srinivas.thunga@gmail.com>
Date: 02/25/2015 01:09PM
Subject: Re:

Hi, 

Can  you place the query as well which you are trying?



Thanks & Regards,

Srinivas T

On Wed, Feb 25, 2015 at 1:02 PM, Jadhav Shweta <= span dir=3D"ltr"> <jadhav.shwet= a@tcs.com> wrote:
Hi

I am trying to run hive query
Its getting executed from beeline interface
but its throwing
    java.lang.OutOfMemoryError: Java heap space
      error when connecting using jdbc.
      I am using hive 0.13.0 version and hiveserver2.=
      which parameters i need to configure for the same.
thanks

Shweta Jadhav

=3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D-----=3D=3D=3D=3D=3D
Notice: The information contained in this e-mail
message and/or attachments to it may contain
confidential or privileged information. If you are
not the intended recipient, any dissemination, use,
review, distribution, printing or copying of the
information contained in this e-mail message
and/or attachments to it are strictly prohibited. If
you have received this communication in error,
please notify us by reply e-mail or telephone and
immediately and permanently delete the message
and any attachments. Thank you







 --_000_D11371C6F5E9vgumashtahortonworkscom_--