Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 48354DF35 for ; Wed, 26 Dec 2012 12:31:58 +0000 (UTC) Received: (qmail 21561 invoked by uid 500); 26 Dec 2012 12:31:53 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 21320 invoked by uid 500); 26 Dec 2012 12:31:52 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 21301 invoked by uid 99); 26 Dec 2012 12:31:52 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Dec 2012 12:31:52 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of centerqi@gmail.com designates 209.85.215.48 as permitted sender) Received: from [209.85.215.48] (HELO mail-la0-f48.google.com) (209.85.215.48) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Dec 2012 12:31:47 +0000 Received: by mail-la0-f48.google.com with SMTP id m13so10674526lah.35 for ; Wed, 26 Dec 2012 04:31:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=0UojlzAyKjTZ3wO2G8Qsd7w9g2n6SiQHrRk71knF6fQ=; b=U3tEGIy/qGwjBIUr9Bm420dGUJquUXk7rLW2M3a4b1HJZe5Ibey+Wdl2NklzU54jWY YBTHnqig9Oc7VzrslSnge7RP46Ve7AnPFvP59g3v1PZ/6WLv3TX6RNv4nAfk9JyJAfP/ wn0gL7Wakl/bEUFpJx9nR1M0vsA/XbAykUxtr4Qd+pb1FcU6zAKZoupeB7oXQ08zZ/sm MeDdUf2o9G85JErWHTgr+ibmFhp0BmSlPI6W/FQFyK6Y+OO9u0XKIVzrgUNx/jKoqANF e59eVwzr3Yb//YJ9JLRms/ZJwWYV9uHN3ReH0hAvk3+dIUYlTR1CpuCU4y2EwygH8o0l /9Sg== Received: by 10.112.44.161 with SMTP id f1mr10666577lbm.29.1356525085424; Wed, 26 Dec 2012 04:31:25 -0800 (PST) MIME-Version: 1.0 Received: by 10.152.45.199 with HTTP; Wed, 26 Dec 2012 04:31:05 -0800 (PST) In-Reply-To: References: From: centerqi hu Date: Wed, 26 Dec 2012 20:31:05 +0800 Message-ID: Subject: Re: How to estimate hadoop.tmp.dir disk space To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec554d1fed87cf304d1c09b8f X-Virus-Checked: Checked by ClamAV on apache.org --bcaec554d1fed87cf304d1c09b8f Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable How much disk space to meet the needs of hadoop.tmp.dir? thx 2012/12/26 Harsh J > The hadoop.tmp.dir is a local directory, usually defaulting to under > /tmp/ and is thereby limited by that mount's space, not the HDFS > space. > > On Wed, Dec 26, 2012 at 1:25 PM, centerqi hu wrote: > > hi all > > I encountered trouble > > > > Message: org.apache.hadoop.ipc.RemoteException: java.io.IOException: > > org.apache.hadoop.fs.FSError: java.io.IOException: No space left on > device > > > > > > > > hadoop dfsadmin -report > > > > Configured Capacity: 44302785945600 (40.29 TB) > > Present Capacity: 42020351946752 (38.22 TB) > > DFS Remaining: 8124859072512 (7.39 TB) > > DFS Used: 33895492874240 (30.83 TB) > > DFS Used%: 80.66% > > Under replicated blocks: 1687 > > Blocks with corrupt replicas: 0 > > Missing blocks: 0 > > > > However, my hdfs space is adequate > > > > Change the size of the hadoop.tmp.dir error disappeared > > How to estimate hadoop.tmp.dir disk space? > > > > thx > > -- > > centerqi@gmail.com > > > > -- > Harsh J > --=20 centerqi@gmail.com|=E9=BD=90=E5=BF=A0 --bcaec554d1fed87cf304d1c09b8f Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
How much disk space to meet the needs of hadoop.tmp.dir?
thx


2012/12= /26 Harsh J <harsh@cloudera.com>
The hadoop.tmp.dir is a local directory, usually defaulting to under
/tmp/ and is thereby limited by that mount's space, not the HDFS
space.

On Wed, Dec 26, 2012 at 1:25 PM, centerqi hu <centerqi@gmail.com> wrote:
> hi all
> =C2=A0I encountered trouble
>
> Message: org.apache.hadoop.ipc.RemoteException: java.io.IOException: > org.apache.hadoop.fs.FSError: java.io.IOException: No space left on de= vice
>
>
>
> =C2=A0hadoop dfsadmin -report
>
> =C2=A0 =C2=A0 Configured Capacity: 44302785945600 (40.29 TB)
> =C2=A0 =C2=A0 Present Capacity: 42020351946752 (38.22 TB)
> =C2=A0 =C2=A0 DFS Remaining: 8124859072512 (7.39 TB)
> =C2=A0 =C2=A0 DFS Used: 33895492874240 (30.83 TB)
> =C2=A0 =C2=A0 DFS Used%: 80.66%
> =C2=A0 =C2=A0 Under replicated blocks: 1687
> =C2=A0 =C2=A0 Blocks with corrupt replicas: 0
> =C2=A0 =C2=A0 Missing blocks: 0
>
> However, my hdfs space is adequate
>
> Change the size of the hadoop.tmp.dir error disappeared
> How to estimate hadoop.tmp.dir disk space?
>
> thx
> --
> centerqi@gmail.com



--
Harsh J



-- centerqi@gmail.co= m|=E9=BD=90=E5=BF=A0
--bcaec554d1fed87cf304d1c09b8f--