accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Christopher Tubbs (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1923) Ensure ZK instances closed correctly
Date Sat, 21 Dec 2013 01:39:07 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13854742#comment-13854742
] 

Christopher Tubbs commented on ACCUMULO-1923:
---------------------------------------------

Commit [674fa95|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;a=commit;h=674fa95cacaa9353142071a66006e0ffb65cae94]
for ACCUMULO-1889 breaks MapReduceIT.

Contents of RowHash_*.err log:

{code:java}
Thread "org.apache.accumulo.examples.simple.mapreduce.RowHash" died java.lang.reflect.InvocationTargetException
java.lang.reflect.InvocationTargetException
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:622)
  at org.apache.accumulo.start.Main$1.run(Main.java:137)
  at java.lang.Thread.run(Thread.java:701)
Caused by: java.io.IOException: java.lang.RuntimeException: ZooKeeperInstance has been closed.
  at org.apache.accumulo.core.client.mapreduce.AbstractInputFormat.getSplits(AbstractInputFormat.java:596)
  at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:491)
  at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:508)
  at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:392)
  at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
  at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Subject.java:416)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
  at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
  at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
  at org.apache.accumulo.examples.simple.mapreduce.RowHash.run(RowHash.java:88)
  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  at org.apache.accumulo.examples.simple.mapreduce.RowHash.main(RowHash.java:93)
  ... 6 more
Caused by: java.lang.RuntimeException: ZooKeeperInstance has been closed.
  at org.apache.accumulo.core.client.ZooKeeperInstance.getInstanceID(ZooKeeperInstance.java:162)
  at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUtil.java:37)
  at org.apache.accumulo.core.client.impl.RootTabletLocator.getRootTabletLocation(RootTabletLocator.java:99)
  at org.apache.accumulo.core.client.impl.RootTabletLocator.locateTablet(RootTabletLocator.java:121)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl.lookupTabletLocation(TabletLocatorImpl.java:459)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl._locateTablet(TabletLocatorImpl.java:619)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl.locateTablet(TabletLocatorImpl.java:437)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl.lookupTabletLocation(TabletLocatorImpl.java:459)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl._locateTablet(TabletLocatorImpl.java:619)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl.binRanges(TabletLocatorImpl.java:278)
  at org.apache.accumulo.core.client.impl.TabletLocatorImpl.binRanges(TabletLocatorImpl.java:353)
  at org.apache.accumulo.core.client.mapreduce.AbstractInputFormat.getSplits(AbstractInputFormat.java:582)
  ... 19 more
{code}

> Ensure ZK instances closed correctly
> ------------------------------------
>
>                 Key: ACCUMULO-1923
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1923
>             Project: Accumulo
>          Issue Type: Bug
>          Components: client
>         Environment: development single node, hadoop 2.2, 
>            Reporter: Eric Newton
>            Assignee: Bill Havanki
>            Priority: Minor
>             Fix For: 1.4.5, 1.5.1, 1.6.0
>
>
> Was: "warning at the end of a MapReduce job"
> Ensure that ZK instances are closed where opened across the Accumulo codebase. This is
an expansion of the original ticket scope, whose description is below.
> Original Description:
> While running the randomwalk tests I saw this at the end of a map/reduce job:
> {noformat}
> 22 16:56:30,583 [client.ZooKeeperInstance] WARN : ZooKeeperInstance being cleaned up
without being closed. Please remember to call close() before dereferencing to clean up threads.
> {noformat}
> This came just after the warning:
> {noformat}
> 22 16:56:31,742 [sequential.MapRedVerify] DEBUG: Dropping table: sequential_hostname_1385157013877_MR
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message