hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nitin Pawar <nitinpawar...@gmail.com>
Subject Re: [HIVE] Cannot perform a queries
Date Tue, 27 Aug 2013 04:12:04 GMT
Not sure, why your zookeeper has reached max connection and then its
blocking hive to connect anymore.

Can you remove
===
<property>
    <name>hive.zookeeper.quorum</name>
    <value>datlas-cloudera-m01</value>
  </property>
  <property>
    <name>hive.zookeeper.client.port</name>
    <value>2181</value>
</property>
====
and give it a try.



On Tue, Aug 27, 2013 at 1:31 AM, Guillermo Alvarado <
guillermoalvarado89@gmail.com> wrote:

> Hi Nitin,
>
> I apreciate your help,
>
> This is my hive-site.xml:
>
> <?xml version="1.0" encoding="UTF-8"?>
>
> <!--Autogenerated by Cloudera CM on 2013-06-26T17:55:39.126Z-->
> <configuration>
>   <property>
>     <name>hive.metastore.local</name>
>     <value>false</value>
>   </property>
>   <property>
>     <name>hive.metastore.uris</name>
>     <value>thrift://datlas-cloudera-m01:9083</value>
>   </property>
>   <property>
>     <name>hive.metastore.warehouse.dir</name>
>     <value>/user/hive/warehouse</value>
>   </property>
>   <property>
>     <name>hive.warehouse.subdir.inherit.perms</name>
>     <value>true</value>
>   </property>
>   <property>
>     <name>mapred.reduce.tasks</name>
>     <value>-1</value>
>   </property>
>   <property>
>     <name>hive.exec.reducers.bytes.per.reducer</name>
>     <value>1073741824</value>
>   </property>
>   <property>
>     <name>hive.exec.reducers.max</name>
>     <value>999</value>
>   </property>
>   <property>
>     <name>hive.metastore.execute.setugi</name>
>     <value>true</value>
>   </property>
>   <property>
>     <name>hive.support.concurrency</name>
>     <value>true</value>
>   </property>
>   <property>
>     <name>hive.zookeeper.quorum</name>
>     <value>datlas-cloudera-m01</value>
>   </property>
>   <property>
>     <name>hive.zookeeper.client.port</name>
>     <value>2181</value>
>   </property>
>   <property>
>     <name>hive.aux.jars.path</name>
>     <value>file:/etc/hive/hive-serdes-1.0-SNAPSHOT.jar</value>
>   </property>
>   <property>
>     <name>hive.server2.authentication</name>
>     <value>NOSASL</value>
>   </property>
> </configuration>
>
>
> And this is the Zookeeper log:
>
> 2013-08-26 14:59:05,803 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:07,653 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:09,364 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:11,336 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:12,950 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:14,523 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:16,547 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:17,884 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:19,243 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:21,106 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:23,156 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:24,479 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:25,372 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
> 2013-08-26 14:59:25,779 WARN
> org.apache.zookeeper.server.NIOServerCnxnFactory: Too many connections from
> /10.5.96.195 - max is 60
>
>
> I did not know that about zookeeper, thanks for that info. Anyway, I can
> not perform a query in the hive console...
>
> Thanks,
> Regards.
>
>
> 2013/8/26 Nitin Pawar <nitinpawar432@gmail.com>
>
>> Can you share your hive-site.xml  and zookeeper log?
>> Unless you are using concurrency in hive, zookeeper is not needed.
>>
>> I run hive without zookeeper.
>>
>>
>> On Mon, Aug 26, 2013 at 9:38 PM, Guillermo Alvarado <
>> guillermoalvarado89@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Anybody can give me some help with this please?
>>>
>>> Thanks in advance,
>>> Regards.
>>>
>>>
>>> 2013/8/22 Guillermo Alvarado <guillermoalvarado89@gmail.com>
>>>
>>>> Hi everyone,
>>>>
>>>> I have a CDH4 cluster running In 4 nodes. I can perform queries in
>>>> Beeswax UI but If I try to perform the same query with the hive console it
>>>> is not possible.
>>>>
>>>> I launched the console in this way: hive -hiveconf
>>>> hive.root.logger=DEBUG,console and this is the output.
>>>>
>>>> =====
>>>>
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:java.library.path=/opt/cloudera/parcels/CDH-4.3.0-1.cdh4.3.0.p0.22/lib/hadoop/lib/native
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:java.io.tmpdir=/tmp
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:java.compiler=<NA>
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client environment:os.name
>>>> =Linux
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:os.arch=amd64
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:os.version=2.6.32-279.el6.x86_64
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client environment:
>>>> user.name=root
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:user.home=/root
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Client
>>>> environment:user.dir=/
>>>> 13/08/22 13:44:21 INFO zookeeper.ZooKeeper: Initiating client
>>>> connection, connectString=datlas-cloudera-m01:2181 sessionTimeout=600000
>>>> watcher=org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager$DummyWatcher@357c7988
>>>> 13/08/22 13:44:21 DEBUG zookeeper.ClientCnxn:
>>>> zookeeper.disableAutoWatchReset is false
>>>> 13/08/22 13:44:21 INFO zookeeper.ClientCnxn: Opening socket connection
>>>> to server datlas-cloudera-m01/10.5.96.195:2181. Will not attempt to
>>>> authenticate using SASL (No se puede localizar una configuración de inicio
>>>> de sesión)
>>>> 13/08/22 13:44:21 INFO zookeeper.ClientCnxn: Socket connection
>>>> established to datlas-cloudera-m01/10.5.96.195:2181, initiating session
>>>> 13/08/22 13:44:21 DEBUG zookeeper.ClientCnxn: Session establishment
>>>> request sent on datlas-cloudera-m01/10.5.96.195:2181
>>>> 13/08/22 13:44:21 INFO zookeeper.ClientCnxn: Unable to read additional
>>>> data from server sessionid 0x0, likely server has closed socket, closing
>>>> socket connection and attempting reconnect
>>>> Interrupting... Be patient, this might take some time.
>>>> 13/08/22 13:44:21 INFO CliDriver: Interrupting... Be patient, this
>>>> might take some time.
>>>> 13/08/22 13:44:21 INFO ql.Driver: <PERFLOG method=acquireReadWriteLocks>
>>>> 13/08/22 13:44:22 INFO zookeeper.ClientCnxn: Opening socket connection
>>>> to server datlas-cloudera-m01/10.5.96.195:2181. Will not attempt to
>>>> authenticate using SASL (No se puede localizar una configuración de inicio
>>>> de sesión)
>>>> 13/08/22 13:44:22 INFO zookeeper.ClientCnxn: Socket connection
>>>> established to datlas-cloudera-m01/10.5.96.195:2181, initiating session
>>>> 13/08/22 13:44:22 DEBUG zookeeper.ClientCnxn: Session establishment
>>>> request sent on datlas-cloudera-m01/10.5.96.195:2181
>>>> 13/08/22 13:44:22 INFO zookeeper.ClientCnxn: Unable to read additional
>>>> data from server sessionid 0x0, likely server has closed socket, closing
>>>> socket connection and attempting reconnect
>>>>
>>>> ======
>>>>
>>>> Also, when I see the status of the services with the cloudera manager
>>>> UI I see a Bad Health in Zookeper and HBase. I restarted a lot of times
>>>> Zookeper but it is in the same status.
>>>>
>>>> Why I can perform queries with Beeswax UI and not with Hive console?
>>>> And how can I solve this problem?
>>>>
>>>> BTW, if I type SHOW TABLES, I get the result, but a SELECT does not work
>>>>
>>>>
>>>> I will apreciate very much your help,
>>>> Thanks in advance.
>>>>
>>>
>>>
>>
>>
>> --
>> Nitin Pawar
>>
>
>


-- 
Nitin Pawar

Mime
View raw message