hadoop-hdfs-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anu Engineer (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HDFS-12244) Ozone: the static cache provided by ContainerCache does not work in Unit tests
Date Sat, 05 Aug 2017 01:48:01 GMT

    [ https://issues.apache.org/jira/browse/HDFS-12244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115204#comment-16115204

Anu Engineer commented on HDFS-12244:

[~szetszwo] Thanks for filing this, Do you mean that this is a problem when using MiniOzoneCluster?
or is there something more? I will take a look at this.

> Ozone: the static cache provided by ContainerCache does not work in Unit tests 
> -------------------------------------------------------------------------------
>                 Key: HDFS-12244
>                 URL: https://issues.apache.org/jira/browse/HDFS-12244
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Anu Engineer
> Since a cluster may have >1 datanodes, a static ContainerCache is shared among the
datanodes.  When one datanode shutdown, the cache will be shutdown so that the other datanodes
cannot use the cache any more.  It results in "leveldb.DBException: Closed"
> {code}
> org.iq80.leveldb.DBException: Closed
> 	at org.fusesource.leveldbjni.internal.JniDB.get(JniDB.java:75)
> 	at org.apache.hadoop.utils.LevelDBStore.get(LevelDBStore.java:109)
> 	at org.apache.hadoop.ozone.container.common.impl.KeyManagerImpl.getKey(KeyManagerImpl.java:116)
> 	at org.apache.hadoop.ozone.container.common.impl.Dispatcher.handleGetSmallFile(Dispatcher.java:677)
> 	at org.apache.hadoop.ozone.container.common.impl.Dispatcher.smallFileHandler(Dispatcher.java:293)
> 	at org.apache.hadoop.ozone.container.common.impl.Dispatcher.dispatch(Dispatcher.java:121)
> 	at org.apache.hadoop.ozone.container.common.transport.server.ratis.ContainerStateMachine.dispatch(ContainerStateMachine.java:94)
> 	...
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org

View raw message