hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars George (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1460) Concurrent LRU Block Cache
Date Sun, 28 Jun 2009 17:46:47 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12724976#action_12724976
] 

Lars George commented on HBASE-1460:
------------------------------------

Hmmm, no offense guys... but

{code}
javadoc:
  [javadoc] Generating Javadoc
  [javadoc] Javadoc execution
  [javadoc] Loading source files for package org.apache.hadoop.hbase...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.client...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.client.transactional...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.filter...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.io...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.io.hfile...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.ipc...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.mapred...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.mapreduce...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.master...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.master.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.metrics.file...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.regionserver...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.regionserver.metrics...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.regionserver.transactional...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.rest...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.rest.descriptors...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.rest.exception...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.rest.filter...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.rest.parser...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.rest.serializer...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.thrift...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.thrift.generated...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.util...
  [javadoc] Loading source files for package org.apache.hadoop.hbase.zookeeper...
  [javadoc] Constructing Javadoc information...
  [javadoc] javadoc: warning - No source files for package org.apache.hadoop.hbase.client.transactional
  [javadoc] javadoc: warning - No source files for package org.apache.hadoop.hbase.regionserver.transactional
  [javadoc] Standard Doclet version 1.6.0_11
  [javadoc] Building tree for all the packages and classes...
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: cacheBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: getBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\regionserver\HLog.java:562:
warning - Tag @link: can't find COMPLETE_CACHEFLUSH in org.apache.hadoop.hbase.HConstants
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\regionserver\HLog.java:498:
warning - @return tag has no arguments.
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\regionserver\HLog.java:483:
warning - @param argument "row" is not a parameter name.
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\regionserver\HLog.java:512:
warning - @param argument "row" is not a parameter name.
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\regionserver\HLog.java:512:
warning - @param argument "now" is not a parameter name.
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: cacheBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: getBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: cacheBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: getBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: cacheBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: getBlock
  [javadoc] Building index for all the packages and classes...
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: cacheBlock
  [javadoc] C:\workspace\hbase-trunk\src\java\org\apache\hadoop\hbase\io\hfile\LruBlockCache.java:76:
warning - Tag @link: reference not found: getBlock
  [javadoc] Building index for all classes...
  [javadoc] Generating C:\workspace\hbase-trunk\build\docs\api\stylesheet.css...
  [javadoc] 17 warnings
{code}

> Concurrent LRU Block Cache
> --------------------------
>
>                 Key: HBASE-1460
>                 URL: https://issues.apache.org/jira/browse/HBASE-1460
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: io
>            Reporter: Jonathan Gray
>            Assignee: Jonathan Gray
>             Fix For: 0.20.0
>
>         Attachments: HBASE-1460-v1.patch, HBASE-1460-v2.patch, HBASE-1460-v3.patch, HBASE-1460-v4.patch,
HBASE-1460-v5.patch
>
>
> The LRU-based block cache that will be committed in HBASE-1192 is thread-safe but contains
a big lock on the hash map.  Under high load, the block cache will be hit very heavily from
a number of threads, so it needs to be built to handle massive concurrency.
> This issue aims to implement a new block cache with LRU eviction, but backed by a ConcurrentHashMap
and a separate eviction thread.  Influence will be drawn from Solr's ConcurrentLRUCache, however
there are major differences because solr treats all cached elements as equal size whereas
we are dependent on our HeapSize interface with realistic (though approximate) heap usage.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message