hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roberto Congiu <roberto.con...@openx.com>
Subject Re: HiveServer2
Date Mon, 18 Nov 2013 22:11:40 GMT
We've also had issues with both hiveserver1 and 2 crashing because of heap
exhaustion, but instead of restarting it periodically we took a different
approach, that is, abstracting the part of the interface we needed, and
implemented an adapter that implements the same method as thrift, but
forking a shell, sending commands to it, and parsing the results.
It is slow, but it's fast enough for our hourly process that loads data in
hive EXTERNAL tables for which we need extra reliability.

R.


On Mon, Nov 18, 2013 at 1:24 PM, Edward Capriolo <edlinuxguru@gmail.com>wrote:

> Thanks for pointing out any issue. HiveServer1 is significantly less
> robust. We have run HS1 behind a load balancer/proxy and rotated/restarted
> "angry" instances.
>
>
> On Mon, Nov 18, 2013 at 3:59 PM, Stephen Sprague <spragues@gmail.com>wrote:
>
>> A word of warning for users of HiveServer2 - version 0.11 at least. This
>> puppy has the ability crash and/or hang your server with a memory leak.
>>
>> Apparently its not new since googling shows this discussed before and i
>> see reference to a workaround here:
>>
>> https://cwiki.apache.org/confluence/display/Hive/Setting+up+HiveServer2
>>
>> Anyhoo. Consider this a Public Service Announcement. Take heed.
>>
>> Regards,
>> Stephen.
>>
>>
>>
>>
>


-- 
----------------------------------------------------------
Good judgement comes with experience.
Experience comes with bad judgement.
----------------------------------------------------------
Roberto Congiu - Data Engineer - OpenX
tel: +1 626 466 1141

Mime
View raw message