hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Ritchie <jritc...@netwurklabs.com>
Subject Re: [jira] Commented: (HADOOP-33) DF enhancement: performance and win XP support
Date Tue, 28 Feb 2006 01:11:14 GMT
Does this project have any use/merit?


I'm not sure if all the unix utils needed for hadoop / nutch are in 
there or not.


Tim Patton (JIRA) wrote:

>    [ http://issues.apache.org/jira/browse/HADOOP-33?page=comments#action_12368028 ] 
>Tim Patton commented on HADOOP-33:
>Oops, I didn't realize lines were not auto-wrapping.  Sorry about that.  And I meant to
say I knew my batch file doesn't have relative paths, I was just copying and pasting to get
it working.
>>DF enhancement: performance and win XP support
>>         Key: HADOOP-33
>>         URL: http://issues.apache.org/jira/browse/HADOOP-33
>>     Project: Hadoop
>>        Type: Improvement
>>  Components: fs, dfs
>> Environment: Unix, Cygwin, Win XP
>>    Reporter: Konstantin Shvachko
>>    Priority: Minor
>> Attachments: DF.patch, DFpatch.txt
>>1. DF is called twice for each heartbeat, which happens each 3 seconds.
>>There is a simple fix for that in the attached patch.
>>2. cygwin is required to run df program in windows environment.
>>There is a class org.apache.commons.io.FileSystemUtils, which can return disk free
>>for different OSs, but it does not have means to get disk capacity.
>>In general in windows there is no efficient and uniform way to calculate disk capacity
>>using a shell command.
>>The choices are 'chkdsk' and 'defrag -a', but both of them are too slow to be called
>>every 3 seconds.
>>WinXP and 2003 server have a new tool called fsutil, which provides all necessary
>>I implemented a call to fsutil in case df fails, and the OS is right.
>>Other win versions should still run cygwin.
>>I tested this fetaure for linux, winXP and cygwin.
>>See attached patch.

View raw message