Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 547FA4AC0 for ; Sat, 21 May 2011 14:59:16 +0000 (UTC) Received: (qmail 99694 invoked by uid 500); 21 May 2011 14:59:13 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 99479 invoked by uid 500); 21 May 2011 14:59:13 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 99471 invoked by uid 99); 21 May 2011 14:59:13 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 21 May 2011 14:59:13 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of edlinuxguru@gmail.com designates 209.85.210.176 as permitted sender) Received: from [209.85.210.176] (HELO mail-iy0-f176.google.com) (209.85.210.176) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 21 May 2011 14:59:08 +0000 Received: by iym1 with SMTP id 1so5717255iym.35 for ; Sat, 21 May 2011 07:58:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=yv9RSOD+xbxTphK1YbiZp2UoDsnosBPT9lYyHlNiWxU=; b=RZMHNb/5ORSlC53T4cXmUV/hWevqHp2j+q9QzJ4YMq5cca20bYi4ZI93Y92SHH2KQ9 LcdfWRnn3QJNd8QXHpsPhiczgXntOXmjaF+eb+uQORoGusjOdZwKjyq9/iR8OGi5fP/Z 4RU5Ss+FOs+U4CgVBVMm3IjXt9sH/6FsbLgW4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=yFOn6g8hSYbmvf1KAZm0z2dQ4awMckcuXrUZf098nrHLVz4OqKU9R/S5VIMDmhSffB ipPzLVz7hz2EyNhc8i4NNYRnphd/zDwDixZKGsT1pWRNh7b0Ly/uZD+4W4mN9pJw1X44 oGu/XvdgMpNjUN66S6NtqdLdKmSBbTIUolBRU= MIME-Version: 1.0 Received: by 10.43.70.204 with SMTP id yh12mr5801343icb.430.1305989928073; Sat, 21 May 2011 07:58:48 -0700 (PDT) Received: by 10.42.177.6 with HTTP; Sat, 21 May 2011 07:58:48 -0700 (PDT) In-Reply-To: References: Date: Sat, 21 May 2011 10:58:48 -0400 Message-ID: Subject: Re: Using df instead of du to calculate datanode space From: Edward Capriolo To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=bcaec51d2246be397e04a3ca79a9 --bcaec51d2246be397e04a3ca79a9 Content-Type: text/plain; charset=ISO-8859-1 Good job. I brought this up an another thread, but was told it was not a problem. Good thing I'm not crazy. On Sat, May 21, 2011 at 12:42 AM, Joe Stein wrote: > I came up with a nice little hack to trick hadoop into calculating disk > usage with df instead of du > > > http://allthingshadoop.com/2011/05/20/faster-datanodes-with-less-wait-io-using-df-instead-of-du/ > > I am running this in production, works like a charm and already > seeing benefit, woot! > > I hope it works well for others too. > > /* > Joe Stein > http://www.twitter.com/allthingshadoop > */ > --bcaec51d2246be397e04a3ca79a9--