hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From yogendra reddy <yogendra...@gmail.com>
Subject error using MiniDFSCluster in windows
Date Tue, 06 Jan 2015 09:23:35 GMT
Hi,

unit tests with minidfscluster are failing with this error. Looks like it
requires hadoop.dll in lib path and winutils.exe accessible through
HADOOP_HOME. Is there anything I can configure in pom.xml file so that the
library path and HADOOP_HOME requirements get injected?



java.lang.UnsatisfiedLinkError:
org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z

              at
org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)

              at
org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:570)

              at org.apache.hadoop.fs.FileUtil.canWrite(FileUtil.java:996)

              at
org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.analyzeStorage(Storage.java:484)

              at
org.apache.hadoop.hdfs.server.namenode.FSImage.recoverStorageDirs(FSImage.java:292)

              at
org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:202)

              at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:879)

              at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:638)

              at
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:455)

              at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:511)

              at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:670)

              at
org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:655)

              at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1304)

              at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:975)

              at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:856)

              at
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:702)

              at
org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:374)

              at
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:355)

              at
JobConfigurationFileReaderTest.shouldSelectFilesForThePastHour(JobConfigurationFileReaderTest.java:53)

              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

              at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

              at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

              at java.lang.reflect.Method.invoke(Method.java:597)

              at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)

              at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)

              at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)

              at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)

              at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)

              at
org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)

              at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)

              at
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)

              at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)

              at
org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)

              at
org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)

              at
org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)

              at
org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)

              at org.junit.runners.ParentRunner.run(ParentRunner.java:363)

              at
org.apache.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:53)

              at
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:123)

              at
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:104)

              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

              at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

              at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

              at java.lang.reflect.Method.invoke(Method.java:597)

              at
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:164)

              at
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:110)

              at
org.apache.maven.surefire.booter.SurefireStarter.invokeProvider(SurefireStarter.java:175)

              at
org.apache.maven.surefire.booter.SurefireStarter.runSuitesInProcessWhenForked(SurefireStarter.java:107)

              at
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:68)


Thanks,

Yogendra

Mime
View raw message