hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yang <teddyyyy...@gmail.com>
Subject Re: how to control hive log location on 0.13?
Date Fri, 18 Jul 2014 18:38:07 GMT
thanks guys.   anybody knows what generates the log like "
myuser_20140716143232_d76043ed-1c4b-42a0-bf0a-2816377a6a2a.log" ? I checked
our application code, it doesn't generate this, looks from hive.


On Fri, Jul 18, 2014 at 12:28 AM, Andre Araujo <araujo@pythian.com> wrote:

> Make sure the directory you specify has the sticky bit set, otherwise
> users will have permission problems:
>
> chmod 1777 <dir>
>
>
> On 18 July 2014 14:19, Satish Mittal <satish.mittal@inmobi.com> wrote:
>
>> You can configure the following property in
>> $HIVE_HOME/conf/hive-log4j.properties:
>>
>> hive.log.dir=<your location>
>>
>> The default value of this property is ${java.io.tmpdir}/${user.name}.
>>
>> Thanks,
>> Satish
>>
>>
>> On Thu, Jul 17, 2014 at 11:58 PM, Yang <teddyyyy123@gmail.com> wrote:
>>
>>> we just moved to hadoop2.0 (HDP2.1 distro). it turns out that the new
>>> hive version generates a lot of logs into /tmp/ and is quickly creating the
>>> danger of running out of our /tmp/ space.
>>>
>>>
>>> I see these 2 different logs :
>>>
>>> [myuser@mybox ~]$  ls -lt /tmp/myuser/
>>> total 1988
>>> -rw-rw-r-- 1 myuser myuser  191687 2014-07-17 11:17 hive.log
>>> -rw-rw-r-- 1 myuser myuser   14472 2014-07-16 14:43
>>> myuser_20140716143232_d76043ed-1c4b-42a0-bf0a-2816377a6a2a.log
>>> -rw-rw-r-- 1 myuser myuser   14260 2014-07-16 14:04
>>> myuser_20140716135353_de698da0-807f-4e3b-8b97-5af5064b55f2.log
>>> -rw-rw-r-- 1 myuser myuser   14254 2014-07-16 13:42
>>> myuser_20140716133838_208329bd-77bb-4981-a2e9-e747647d0704.log
>>>
>>>
>>>
>>> from the doc at
>>> https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-ErrorLogs
>>> I can see that "per Hive session basis in /tmp/<user.name>/, but can be
>>> configured in hive-site.xml
>>> <https://cwiki.apache.org/confluence/display/Hive/AdminManual+Configuration>
with
>>> the hive.querylog.location property.",
>>> but I tried to pass it to -hiveconf hive.querylog.location=/tmp/mycustomlogdir/
>>>  , doesn't seem to work; the hive.log location is not changed by this
>>> approach either.
>>>
>>> so how can I change the location of both the logs , by some per-script
>>> params ? (i.e. we can't afford to change the system hive-site.xml or
>>> /etc/hive/conf etc)
>>>
>>> Thanks a lot
>>>  Yang
>>>
>>
>>
>> _____________________________________________________________
>> The information contained in this communication is intended solely for
>> the use of the individual or entity to whom it is addressed and others
>> authorized to receive it. It may contain confidential or legally privileged
>> information. If you are not the intended recipient you are hereby notified
>> that any disclosure, copying, distribution or taking any action in reliance
>> on the contents of this information is strictly prohibited and may be
>> unlawful. If you have received this communication in error, please notify
>> us immediately by responding to this email and then delete it from your
>> system. The firm is neither liable for the proper and complete transmission
>> of the information contained in this communication nor for any delay in its
>> receipt.
>
>
>
>
> --
> André Araújo
> Big Data Consultant/Solutions Architect
> The Pythian Group - Australia - www.pythian.com
>
> Office (calls from within Australia): 1300 366 021 x1270
> Office (international): +61 2 8016 7000  x270 *OR* +1 613 565 8696   x1270
> Mobile: +61 410 323 559
> Fax: +61 2 9805 0544
> IM: pythianaraujo @ AIM/MSN/Y! or araujo@pythian.com @ GTalk
>
> “Success is not about standing at the top, it's the steps you leave behind.”
> — Iker Pou (rock climber)
>
> --
>
>
>
>

Mime
View raw message