Return-Path: Delivered-To: apmail-lucene-hadoop-dev-archive@locus.apache.org Received: (qmail 79235 invoked from network); 28 Feb 2006 01:12:31 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (209.237.227.199) by minotaur.apache.org with SMTP; 28 Feb 2006 01:12:31 -0000 Received: (qmail 72966 invoked by uid 500); 28 Feb 2006 01:12:26 -0000 Delivered-To: apmail-lucene-hadoop-dev-archive@lucene.apache.org Received: (qmail 72922 invoked by uid 500); 28 Feb 2006 01:12:26 -0000 Mailing-List: contact hadoop-dev-help@lucene.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hadoop-dev@lucene.apache.org Delivered-To: mailing list hadoop-dev@lucene.apache.org Received: (qmail 72895 invoked by uid 99); 28 Feb 2006 01:12:26 -0000 Received: from asf.osuosl.org (HELO asf.osuosl.org) (140.211.166.49) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 27 Feb 2006 17:12:26 -0800 X-ASF-Spam-Status: No, hits=0.0 required=10.0 tests= X-Spam-Check-By: apache.org Received-SPF: pass (asf.osuosl.org: local policy) Received: from [64.191.14.28] (HELO reptile.netwurklabs.com) (64.191.14.28) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 27 Feb 2006 17:12:25 -0800 Received: (qmail 5441 invoked from network); 28 Feb 2006 01:11:41 -0000 Received: from localhost (HELO ?127.0.0.1?) (127.0.0.1) by reptile.netwurklabs.com with SMTP; 28 Feb 2006 01:11:41 -0000 Message-ID: <4403A332.5000206@netwurklabs.com> Date: Mon, 27 Feb 2006 20:11:14 -0500 From: Jeff Ritchie User-Agent: Mozilla Thunderbird 1.0.7 (Windows/20050923) X-Accept-Language: en-us, en MIME-Version: 1.0 To: hadoop-dev@lucene.apache.org Subject: Re: [jira] Commented: (HADOOP-33) DF enhancement: performance and win XP support References: <699964886.1141075077836.JavaMail.jira@ajax.apache.org> In-Reply-To: <699964886.1141075077836.JavaMail.jira@ajax.apache.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org X-Spam-Rating: minotaur.apache.org 1.6.2 0/1000/N Does this project have any use/merit? http://unxutils.sourceforge.net/ I'm not sure if all the unix utils needed for hadoop / nutch are in there or not. Jeff. Tim Patton (JIRA) wrote: > [ http://issues.apache.org/jira/browse/HADOOP-33?page=comments#action_12368028 ] > >Tim Patton commented on HADOOP-33: >---------------------------------- > >Oops, I didn't realize lines were not auto-wrapping. Sorry about that. And I meant to say I knew my batch file doesn't have relative paths, I was just copying and pasting to get it working. > > > >>DF enhancement: performance and win XP support >>---------------------------------------------- >> >> Key: HADOOP-33 >> URL: http://issues.apache.org/jira/browse/HADOOP-33 >> Project: Hadoop >> Type: Improvement >> Components: fs, dfs >> Environment: Unix, Cygwin, Win XP >> Reporter: Konstantin Shvachko >> Priority: Minor >> Attachments: DF.patch, DFpatch.txt >> >>1. DF is called twice for each heartbeat, which happens each 3 seconds. >>There is a simple fix for that in the attached patch. >>2. cygwin is required to run df program in windows environment. >>There is a class org.apache.commons.io.FileSystemUtils, which can return disk free space >>for different OSs, but it does not have means to get disk capacity. >>In general in windows there is no efficient and uniform way to calculate disk capacity >>using a shell command. >>The choices are 'chkdsk' and 'defrag -a', but both of them are too slow to be called >>every 3 seconds. >>WinXP and 2003 server have a new tool called fsutil, which provides all necessary info. >>I implemented a call to fsutil in case df fails, and the OS is right. >>Other win versions should still run cygwin. >>I tested this fetaure for linux, winXP and cygwin. >>See attached patch. >> >> > > >