hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lukas Vlcek" <lukas.vl...@gmail.com>
Subject Developing and testing Hadoop in NetBeans at Windows?
Date Wed, 21 May 2008 09:55:20 GMT
Hi,

I am trying to develop and run Hadoop tests in NetBeans at Windows and I
have encountered few problems (no surprise, however, I do believe Hadoop
development should be platform independent as much as possible...):

1) target "generate-test-records" produces some java files under
build\test\src folder. Why? This forces me to set dependency on
build\test\src folder in NetBeans which is problem under Windows because the
system holds lock and I am not able to delete this folder. So target "clean"
can not be executed. Does anybody know how to workaround this or is there
any chance these generated files can be located outside the build folder?

2) for some tests I am getting the following exception:
Testcase: testCopyFromLocalToLocal(org.apache.hadoop.fs.TestCopyFiles):
Caused an ERROR
No FileSystem for scheme: file
java.io.IOException: No FileSystem for scheme: file
        at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1267)
        at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:56)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1281)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:203)
        at
org.apache.hadoop.fs.TestCopyFiles.createFiles(TestCopyFiles.java:99)
        at
org.apache.hadoop.fs.TestCopyFiles.testCopyFromLocalToLocal(TestCopyFiles.java:226)

What is the point here? Did I forget to put specific config file on
CLASSPATH?

As of now my CLASSPATH (or Package Folders in terms of NetBeans) is set up
as follows:

Source Package Folders:
src\java
src\examples
src\contrib\data_join\src\java
src\contrib\data_join\src\examples
src\contrib\streaming\src\java

Test Package Folders:
src\test
src\contrib\streaming\src\test
build\test\src


I am quite new to Hadoop development but I would like to dive in...

Regards,
Lukas

-- 
http://blog.lukas-vlcek.com/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message