Return-Path: X-Original-To: apmail-hive-user-archive@www.apache.org Delivered-To: apmail-hive-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 5A810119C5 for ; Thu, 17 Jul 2014 18:29:03 +0000 (UTC) Received: (qmail 2877 invoked by uid 500); 17 Jul 2014 18:29:01 -0000 Delivered-To: apmail-hive-user-archive@hive.apache.org Received: (qmail 2798 invoked by uid 500); 17 Jul 2014 18:29:01 -0000 Mailing-List: contact user-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hive.apache.org Delivered-To: mailing list user@hive.apache.org Received: (qmail 2787 invoked by uid 500); 17 Jul 2014 18:29:01 -0000 Delivered-To: apmail-hadoop-hive-user@hadoop.apache.org Received: (qmail 2784 invoked by uid 99); 17 Jul 2014 18:29:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 18:29:01 +0000 X-ASF-Spam-Status: No, hits=3.4 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HK_RANDOM_ENVFROM,HK_RANDOM_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of teddyyyy123@gmail.com designates 209.85.220.45 as permitted sender) Received: from [209.85.220.45] (HELO mail-pa0-f45.google.com) (209.85.220.45) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 17 Jul 2014 18:28:59 +0000 Received: by mail-pa0-f45.google.com with SMTP id eu11so3853271pac.18 for ; Thu, 17 Jul 2014 11:28:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=+//PzfzSpC8f7vyyIfEepy7ieM87rqVEZjCMyAFywZM=; b=YuhhT0KY5b+UuVNOeAQaApFAdplwq2PaEKi0wvsRlN6BN/HFUjD8V9CtJZ/NKxgvGE +PSmKpgAC0MuJdyc8gqIzeJBzmmIbDfhYg+e/Px14gcQGkiS2Yc/jn3+f026LsDY0dx7 2QLB3wQ1RM9lgS096eQFxA2W2FIZkwRNnWWs8O5eQoE8zQBQ4QM8mB5pVPUnybOna95b +/plSiTdc/XsBBVcuikpfjfIA4+Rib5/6CEj2ef1Lll5m/3lVAeXeqHj3mSQ3bnVBlsB 2kmc7mtRa15BTFAIXHzNLgIYBcQFjI/1spQt4a/iGl17qESOytLgLr3Qzo4zLiEmtHQ0 naEA== X-Received: by 10.68.190.98 with SMTP id gp2mr39594598pbc.88.1405621714074; Thu, 17 Jul 2014 11:28:34 -0700 (PDT) MIME-Version: 1.0 Received: by 10.70.128.161 with HTTP; Thu, 17 Jul 2014 11:28:13 -0700 (PDT) From: Yang Date: Thu, 17 Jul 2014 11:28:13 -0700 Message-ID: Subject: how to control hive log location on 0.13? To: hive-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=e89a8ff1caf0f4c40e04fe67ce63 X-Virus-Checked: Checked by ClamAV on apache.org --e89a8ff1caf0f4c40e04fe67ce63 Content-Type: text/plain; charset=UTF-8 we just moved to hadoop2.0 (HDP2.1 distro). it turns out that the new hive version generates a lot of logs into /tmp/ and is quickly creating the danger of running out of our /tmp/ space. I see these 2 different logs : [myuser@mybox ~]$ ls -lt /tmp/myuser/ total 1988 -rw-rw-r-- 1 myuser myuser 191687 2014-07-17 11:17 hive.log -rw-rw-r-- 1 myuser myuser 14472 2014-07-16 14:43 myuser_20140716143232_d76043ed-1c4b-42a0-bf0a-2816377a6a2a.log -rw-rw-r-- 1 myuser myuser 14260 2014-07-16 14:04 myuser_20140716135353_de698da0-807f-4e3b-8b97-5af5064b55f2.log -rw-rw-r-- 1 myuser myuser 14254 2014-07-16 13:42 myuser_20140716133838_208329bd-77bb-4981-a2e9-e747647d0704.log from the doc at https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-ErrorLogs I can see that "per Hive session basis in /tmp//, but can be configured in hive-site.xml with the hive.querylog.location property.", but I tried to pass it to -hiveconf hive.querylog.location=/tmp/mycustomlogdir/ , doesn't seem to work; the hive.log location is not changed by this approach either. so how can I change the location of both the logs , by some per-script params ? (i.e. we can't afford to change the system hive-site.xml or /etc/hive/conf etc) Thanks a lot Yang --e89a8ff1caf0f4c40e04fe67ce63 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
we just moved to hadoop2.0 (HDP2.1 distro). it turns out t= hat the new hive version generates a lot of logs into /tmp/ and is quickly = creating the danger of running out of our /tmp/ space.


I see these 2 different logs :

[myuser@mybox ~]$ =C2=A0ls -lt /tmp/myuser/
total 1988
-rw-rw-r-- 1 myuser myuser =C2=A0191687 2014-07-17 11:17 hive.log
-rw-rw-r-- 1 myuser myuser =C2=A0 14472 2014-07-16 14:43 myuser_201407161= 43232_d76043ed-1c4b-42a0-bf0a-2816377a6a2a.log
-rw-rw-r-- 1 myuser myuser =C2=A0 14260 2014-07-16 14:04 myuser_201407= 16135353_de698da0-807f-4e3b-8b97-5af5064b55f2.log
-rw-rw-r-- 1 my= user myuser =C2=A0 14254 2014-07-16 13:42 myuser_20140716133838_208329bd-77= bb-4981-a2e9-e747647d0704.log



I can see that "per Hive session basis in= =C2=A0/tmp/<user.name>/, but can be configured in=C2=A0hive-site.xml=C2= =A0with the=C2=A0hive.querylog.location=C2=A0p= roperty.",=C2=A0
but I tried to pass it to -hiveconf=C2=A0= hive.querylog.location=3D/tmp/mycus= tomlogdir/ =C2=A0, doesn't seem to work; the hive.log location is not c= hanged by this approach either.

<= font color=3D"#333333" face=3D"Arial, sans-serif">so how can I change the location of = both the logs , by some per-script params ? (i.e. we can't afford to ch= ange the system hive-site.xml or /etc/hive/conf etc)

<= font color=3D"#333333" face=3D"Arial, sans-serif">Thanks a lot
Yang
--e89a8ff1caf0f4c40e04fe67ce63--