accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mike Drob (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-895) MiniAccumuloCluster does not work on Windows
Date Tue, 11 Dec 2012 16:55:23 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13529117#comment-13529117
] 

Mike Drob commented on ACCUMULO-895:
------------------------------------

Can run the {{ExampleAccumuloUnitTest}} now!

Having issues with {{MapReduceExample}}, though.

{noformat}

   ---- Running Mapred Against Accumulo

UUID 1355244649903 81398c27-297e-4087-8ea8-ec0bdb976220
FLUSH 1355244659049 9144 24 1000000 1000000
FLUSH 1355244668456 9407 16 2000000 1000000
FLUSH 1355244680016 11560 27 3000000 1000000
FLUSH 1355244689021 9005 15 4000000 1000000
FLUSH 1355244703781 14760 13 5000000 1000000
[main] ERROR org.apache.hadoop.security.UserGroupInformation  - PriviledgedActionException
as:mike cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-mike\mapred\staging\mike-101115261\.staging
to 0700
Exception in thread "main" java.io.IOException: Failed to set permissions of path: \tmp\hadoop-mike\mapred\staging\mike-101115261\.staging
to 0700
	at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:682)
	at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:655)
	at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509)
	at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344)
	at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189)
	at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856)
	at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Unknown Source)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
	at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
	at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
	at org.apache.accumulo.server.test.continuous.ContinuousVerify.run(ContinuousVerify.java:216)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.accumulo.server.test.continuous.ContinuousVerify.main(ContinuousVerify.java:232)
	at org.apache.accumulo.instamo.MapReduceExample.run(MapReduceExample.java:43)
	at org.apache.accumulo.instamo.MapReduceExample.main(MapReduceExample.java:60)
{noformat}

Perhaps need to specify a mapred work directory in some conf before launching?
                
> MiniAccumuloCluster does not work on Windows
> --------------------------------------------
>
>                 Key: ACCUMULO-895
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-895
>             Project: Accumulo
>          Issue Type: Sub-task
>          Components: client
>         Environment: Windows 7, Oracle Java 7
>            Reporter: Mike Drob
>            Priority: Minor
>             Fix For: 1.5.0
>
>
> I set the log level up a bit, here's the result.
> {noformat}
> [main] DEBUG org.apache.hadoop.conf.Configuration  - java.io.IOException: config()
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)
> 	at org.apache.accumulo.core.conf.SiteConfiguration.getXmlConfig(SiteConfiguration.java:49)
> 	at org.apache.accumulo.core.conf.SiteConfiguration.iterator(SiteConfiguration.java:80)
> 	at org.apache.accumulo.core.conf.ConfigSanityCheck.validate(ConfigSanityCheck.java:29)
> 	at org.apache.accumulo.core.conf.SiteConfiguration.getInstance(SiteConfiguration.java:41)
> 	at org.apache.accumulo.server.conf.ServerConfiguration.getSiteConfiguration(ServerConfiguration.java:38)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.init(MiniAccumuloCluster.java:192)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.start(MiniAccumuloCluster.java:320)
> 	at org.apache.accumulo.instamo.ExampleAccumuloUnitTest.setupMiniCluster(ExampleAccumuloUnitTest.java:46)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> 	at java.lang.reflect.Method.invoke(Unknown Source)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> 	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
> 	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
> [main] WARN  org.apache.accumulo.core.conf.SiteConfiguration  - accumulo-site.xml not
found on classpath
> [main] DEBUG org.apache.hadoop.conf.Configuration  - java.io.IOException: config()
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)
> 	at org.apache.accumulo.core.util.CachedConfiguration.getInstance(CachedConfiguration.java:26)
> 	at org.apache.accumulo.server.util.Initialize.main(Initialize.java:485)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.init(MiniAccumuloCluster.java:197)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.start(MiniAccumuloCluster.java:320)
> 	at org.apache.accumulo.instamo.ExampleAccumuloUnitTest.setupMiniCluster(ExampleAccumuloUnitTest.java:46)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> 	at java.lang.reflect.Method.invoke(Unknown Source)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> 	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
> 	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
> [main] DEBUG org.apache.hadoop.conf.Configuration  - java.io.IOException: config()
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)
> 	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:187)
> 	at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:239)
> 	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:438)
> 	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:424)
> 	at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
> 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
> 	at org.apache.accumulo.core.file.FileUtil.getFileSystem(FileUtil.java:553)
> 	at org.apache.accumulo.server.util.Initialize.main(Initialize.java:487)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.init(MiniAccumuloCluster.java:197)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.start(MiniAccumuloCluster.java:320)
> 	at org.apache.accumulo.instamo.ExampleAccumuloUnitTest.setupMiniCluster(ExampleAccumuloUnitTest.java:46)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> 	at java.lang.reflect.Method.invoke(Unknown Source)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> 	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
> 	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
> [main] DEBUG org.apache.hadoop.security.Groups  -  Creating new Groups object
> [main] DEBUG org.apache.hadoop.security.Groups  - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
cacheTimeout=300000
> [main] DEBUG org.apache.hadoop.conf.Configuration  - java.io.IOException: config()
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:227)
> 	at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:214)
> 	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:187)
> 	at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:239)
> 	at org.apache.hadoop.security.KerberosName.<clinit>(KerberosName.java:83)
> 	at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:212)
> 	at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:187)
> 	at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:239)
> 	at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:438)
> 	at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:424)
> 	at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1494)
> 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1395)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
> 	at org.apache.accumulo.core.file.FileUtil.getFileSystem(FileUtil.java:553)
> 	at org.apache.accumulo.server.util.Initialize.main(Initialize.java:487)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.init(MiniAccumuloCluster.java:197)
> 	at org.apache.accumulo.test.MiniAccumuloCluster.start(MiniAccumuloCluster.java:320)
> 	at org.apache.accumulo.instamo.ExampleAccumuloUnitTest.setupMiniCluster(ExampleAccumuloUnitTest.java:46)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> 	at java.lang.reflect.Method.invoke(Unknown Source)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> 	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> 	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
> 	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
> 	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
> 	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
> [main] DEBUG org.apache.hadoop.security.UserGroupInformation  - hadoop login
> [main] DEBUG org.apache.hadoop.security.UserGroupInformation  - hadoop login commit
> [main] DEBUG org.apache.hadoop.security.UserGroupInformation  - using local user:NTUserPrincipal:
mike
> [main] DEBUG org.apache.hadoop.security.UserGroupInformation  - UGI loginUser:mike
> [main] DEBUG org.apache.hadoop.fs.FileSystem  - Creating filesystem for file:///
> [main] INFO  org.apache.accumulo.server.util.Initialize  - Hadoop Filesystem is file:///
> [main] ERROR org.apache.accumulo.core.conf.SiteConfiguration  - Using default value for
instance.dfs.dir due to improperly formatted absolute path: D:\Users\mike\AppData\Local\Temp\junit1725534677520785696\accumulo
> [main] INFO  org.apache.accumulo.server.util.Initialize  - Accumulo data dir is /accumulo
> [main] INFO  org.apache.accumulo.server.util.Initialize  - Zookeeper server is localhost:36607
> [main] INFO  org.apache.accumulo.server.util.Initialize  - Checking if Zookeeper is available.
If this hangs, then you need to make sure zookeeper is running
> [main] DEBUG org.apache.accumulo.fate.zookeeper.ZooSession  - Connecting to localhost:36607
with timeout 30000 with auth
> [main] ERROR org.apache.accumulo.core.conf.SiteConfiguration  - Using default value for
instance.dfs.dir due to improperly formatted absolute path: D:\Users\mike\AppData\Local\Temp\junit1725534677520785696\accumulo
> [main] FATAL org.apache.accumulo.server.util.Initialize  - It appears this location was
previously initialized, exiting ... 
> [Thread-4] DEBUG org.apache.hadoop.fs.FileSystem  - Starting clear of FileSystem cache
with 1 elements.
> [Thread-4] DEBUG org.apache.hadoop.fs.FileSystem  - Removing filesystem for file:///
> [Thread-4] DEBUG org.apache.hadoop.fs.FileSystem  - Removing filesystem for file:///
> [Thread-4] DEBUG org.apache.hadoop.fs.FileSystem  - Done clearing cache
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message