hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Patton (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-33) DF enhancement: performance and win XP support
Date Mon, 27 Feb 2006 21:16:04 GMT
    [ http://issues.apache.org/jira/browse/HADOOP-33?page=comments#action_12368027 ] 

Tim Patton commented on HADOOP-33:


I'm getting there, so far the NameNode and the DataNode are working.  I've just got hacky
batch files so far, I don't have the nice shell script system you guys developed.  Here's
my batch file for the NameNode:

java -Xmx256m -cp c:\java\lib\hadoop-nightly\conf;"c:\program files\java\jdk1.5.0_06\lib\tools.jar";c:\java\lib\hadoop-nightly\hadoop-nightly.jar;c:\java\lib\hadoop-nightly\hadoop-nightly-examples.jar;c:\java\lib\hadoop-nightly\hadoop-nightly-examples.jar;c:\java\lib\hadoop-nightly\hadoop-nightly.jar;c:\java\lib\hadoop-nightly\lib\commons-logging-api-1.0.4.jar;c:\java\lib\hadoop-nightly\lib\jetty-5.1.4.jar;c:\java\lib\hadoop-nightly\lib\junit-3.8.1.jar;c:\java\lib\hadoop-nightly\lib\lucene-core-1.9-rc1-dev.jar;c:\java\lib\hadoop-nightly\lib\servlet-api.jar;c:\java\lib\hadoop-nightly\lib\jetty-ext\ant.jar;c:\java\lib\hadoop-nightly\lib\jetty-ext\commons-el.jar;c:\java\lib\hadoop-nightly\lib\jetty-ext\jasper-compiler.jar;c:\java\lib\hadoop-nightly\lib\jetty-ext\jasper-runtime.jar;c:\java\lib\hadoop-nightly\lib\jetty-ext\jsp-api.jar

Now I am just tryng to figure out why JobTracker won't work.  I couldn't get JobTracker working
in Cygwin either, so I thought I'd edit the code to give me stack traces and see if I could
narrow it down, which led me to try to get it working right in CodeGuide without having to
keep going back to Cygwin...

> DF enhancement: performance and win XP support
> ----------------------------------------------
>          Key: HADOOP-33
>          URL: http://issues.apache.org/jira/browse/HADOOP-33
>      Project: Hadoop
>         Type: Improvement
>   Components: fs, dfs
>  Environment: Unix, Cygwin, Win XP
>     Reporter: Konstantin Shvachko
>     Priority: Minor
>  Attachments: DF.patch, DFpatch.txt
> 1. DF is called twice for each heartbeat, which happens each 3 seconds.
> There is a simple fix for that in the attached patch.
> 2. cygwin is required to run df program in windows environment.
> There is a class org.apache.commons.io.FileSystemUtils, which can return disk free space
> for different OSs, but it does not have means to get disk capacity.
> In general in windows there is no efficient and uniform way to calculate disk capacity
> using a shell command.
> The choices are 'chkdsk' and 'defrag -a', but both of them are too slow to be called
> every 3 seconds.
> WinXP and 2003 server have a new tool called fsutil, which provides all necessary info.
> I implemented a call to fsutil in case df fails, and the OS is right.
> Other win versions should still run cygwin.
> I tested this fetaure for linux, winXP and cygwin.
> See attached patch.

This message is automatically generated by JIRA.
If you think it was sent incorrectly contact one of the administrators:
For more information on JIRA, see:

View raw message