Return-Path: X-Original-To: apmail-ambari-user-archive@www.apache.org Delivered-To: apmail-ambari-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 83FAA18BFA for ; Fri, 23 Oct 2015 08:02:40 +0000 (UTC) Received: (qmail 26888 invoked by uid 500); 23 Oct 2015 08:02:13 -0000 Delivered-To: apmail-ambari-user-archive@ambari.apache.org Received: (qmail 26858 invoked by uid 500); 23 Oct 2015 08:02:13 -0000 Mailing-List: contact user-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ambari.apache.org Delivered-To: mailing list user@ambari.apache.org Received: (qmail 26848 invoked by uid 99); 23 Oct 2015 08:02:13 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Oct 2015 08:02:13 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id 32B171A2AE4 for ; Fri, 23 Oct 2015 08:02:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.901 X-Spam-Level: ** X-Spam-Status: No, score=2.901 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id ArW6IYH0RM2b for ; Fri, 23 Oct 2015 08:02:00 +0000 (UTC) Received: from mail-ig0-f179.google.com (mail-ig0-f179.google.com [209.85.213.179]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id 155DA439E9 for ; Fri, 23 Oct 2015 08:02:00 +0000 (UTC) Received: by igbkq10 with SMTP id kq10so29821833igb.0 for ; Fri, 23 Oct 2015 01:01:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=23TYNxFz1rXNvEKb98JAcnyiutmzV0/Mmai8TExetPU=; b=TwNlmsgYnsRYDrwsGQ3819EDbjBZWhLti0mpAmZSJSLiV5KosNSSDYbFA1Xhu/gBBk a0f6OEMuW61wuD9JHvv9pZtt5MWpezyrBQDT/7NQLvQSHCYLgDVb7WRMzYZ9b2KfJmjU YYhe6MM2V6twhH+/+5hK88fdxy2b0fQCrzVF93WyiZElmwsLF0IBKsTf1WnowwVqbGK9 9uJrWp0aX/XsR9CLM+qQrBeFJo8+zIiMQjuvJHQ87jUYdJNdQJ1lQnohFTzUS4M66POA QXoEYWjeA8zbxx8hC9G5qnrkm/RGInO2yIYemu1Y/W6wnXXFP7o3g6r9aaON5qJOn1gz 9fLw== MIME-Version: 1.0 X-Received: by 10.50.60.102 with SMTP id g6mr2746487igr.29.1445587319684; Fri, 23 Oct 2015 01:01:59 -0700 (PDT) Received: by 10.36.42.205 with HTTP; Fri, 23 Oct 2015 01:01:59 -0700 (PDT) In-Reply-To: <1445514280860.91650@hortonworks.com> References: <1445514280860.91650@hortonworks.com> Date: Fri, 23 Oct 2015 10:01:59 +0200 Message-ID: Subject: Re: Change the tmp directory From: Kaliyug Antagonist To: user@ambari.apache.org Content-Type: multipart/alternative; boundary=047d7b10c989ae82320522c1063b --047d7b10c989ae82320522c1063b Content-Type: text/plain; charset=UTF-8 Then, I think I can keep the /tmp dir. configs unchanged :) The only concern I had/have is that if someone does a rm -r * inside the /tmp, will it hamper the cluster ? In past with the Apache Hadoop distros, we had this problem. On Thu, Oct 22, 2015 at 1:44 PM, Dmitry Sen wrote: > Hi, > > > There few possible problems with /tmp directory: > > - it's cleaned up after reboot. All the services keep this in mind and > never use any files in tmp directory after their restart, so no need to > keep these files after server reboot > > - /tmp might be mounted to a small/slow partition. That's the reason for > thinking about updating the configuration. > > > 1. /tmp is a good choice :) Your tmp-dont-del should be on a fast and > preferably large partition > > 2. It's ok, but the service accounts must have RW access to the > corresponding directories. If you set hive.exec.scratchdir=/mnt/fastdrive/ > tmp-dont-del/hive , you have to make sure, that hive user has RW > permissions to /mnt/fastdrive/tmp-dont-del/hive > > > BR, > > Dmytro Sen > > > ------------------------------ > *From:* Kaliyug Antagonist > *Sent:* Thursday, October 22, 2015 2:21 PM > *To:* user@ambari.apache.org > *Subject:* Change the tmp directory > > I am planning to install HDP 2.3 using Ambari 2.1.0. > > I have installed Ambari using the root privileges. > > In the configurations, I found several places where the path is /tmp/*. > > e.g: > hive.exec.scratchdir /tmp/hive HBase tmp directory /tmp/hbase-${user.name} > dev.zookeeper.path /tmp/dev-storm-zookeeper > > I wish to replace the default /tmp path with some custom temp > directory(say 'tmp-dont-del') > > > 1. Which is the recommended directory path for the new tmp ? > 2. Is it fine to create this new temp. directory using root > credentials ? > > --047d7b10c989ae82320522c1063b Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Then, I think I can keep the /tmp dir. configs unchanged := )

The only concern I had/have is that if someone does a = rm -r * inside the /tmp, will it hamper the cluster ? In past with the Apac= he Hadoop distros, we had this problem.

On Thu, Oct 22, 2015 at 1:44 PM, Dmitry S= en <dsen@hortonworks.com> wrote:

Hi,


There few=C2=A0possible=C2=A0proble= ms=C2=A0with /tmp directory:

-=C2=A0it's cleaned up after re= boot. All the services keep this in mind and never use any files in tmp dir= ectory after their restart, so no need to keep these files after server reboot

- /tmp might be mounted to a small/= slow partition. That's the reason for thinking about updating the=C2=A0= configuration.


1. /tmp is a good choice :) Your=C2=A0tmp-dont-del should be on a=C2=A0fast and pre= ferably large partition

2. It's ok, but the=C2=A0service accounts must have RW access to the= corresponding directories. If=C2=A0you set=C2=A0hive.exec.scratchdir=3D/mnt/fastdrive/tmp-dont-del/hive=C2= =A0,=C2=A0you have to make sure, that hive user has RW permissions to=C2=A0/mnt/fastdrive/tmp-dont-del/hive


BR,

Dmytro Sen


From: Kaliyug Antagonist <kaliyugantagonist@gmail.com>
Sent: Thursday, October 22, 2015 2:21 PM
To: user= @ambari.apache.org
Subject: Change the tmp directory
=C2=A0
I am planning to install HDP 2.3 using Ambari 2.1.0.

I have installed Ambari using the root privileges.

In the configurations, I found several places where the path is /tmp/*= .

e.g:=C2=A0
hi= ve.exec.scratchdir /t= mp/hive
HB= ase tmp directory /t= mp/hbase-${user.name}
de= v.zookeeper.path /t= mp/dev-storm-zookeeper

I wish to replace the default /tmp path with some custom temp director= y(say 'tmp-dont-del')

  1. Which is the recommended directory path for the new tmp ?
  2. Is it= fine to create this new temp. directory using root credentials ?

--047d7b10c989ae82320522c1063b--