hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2451) .META. by-passes cache; BLOCKCACHE=>'false'
Date Thu, 15 Apr 2010 18:02:49 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12857445#action_12857445
] 

stack commented on HBASE-2451:
------------------------------

Problem is in our bootstrapping code:

{code}
  private void bootstrap() throws IOException {
    LOG.info("BOOTSTRAP: creating ROOT and first META regions");
    try {
      // Bootstrapping, make sure blockcache is off.  Else, one will be
      // created here in bootstap and it'll need to be cleaned up.  Better to
      // not make it in first place.  Turn off block caching for bootstrap.
      // Enable after.
      setBlockCaching(HRegionInfo.ROOT_REGIONINFO, false);
      setBlockCaching(HRegionInfo.FIRST_META_REGIONINFO, false);
      HRegion root = HRegion.createHRegion(HRegionInfo.ROOT_REGIONINFO,
        this.rootdir, this.conf);
      HRegion meta = HRegion.createHRegion(HRegionInfo.FIRST_META_REGIONINFO,
        this.rootdir, this.conf);
      // Add first region from the META table to the ROOT region.
      HRegion.addRegionToMETA(root, meta);
      root.close();
      root.getLog().closeAndDelete();
      meta.close();
      meta.getLog().closeAndDelete();
      setBlockCaching(HRegionInfo.ROOT_REGIONINFO, true);
      setBlockCaching(HRegionInfo.FIRST_META_REGIONINFO, true);
    } catch (IOException e) {
      e = RemoteExceptionHandler.checkIOException(e);
      LOG.error("bootstrap", e);
      throw e;
    }
  }
{code}

Master has a descriptor where the blockcache is on but the regionserver hosting the .META.
reads what was persisted.

> .META. by-passes cache; BLOCKCACHE=>'false'
> -------------------------------------------
>
>                 Key: HBASE-2451
>                 URL: https://issues.apache.org/jira/browse/HBASE-2451
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>            Priority: Blocker
>             Fix For: 0.20.4, 0.20.5, 0.21.0
>
>
> In a new install, if I describe '.META.', it says:
> {code}
> DESCRIPTION                                                             ENABLED     
                         
>  {NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384', F true
                                 
>  AMILIES => [{NAME => 'historian', COMPRESSION => 'NONE', VERSIONS => ' 
                                     
>  2147483647', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false    
                                  
>  ', BLOCKCACHE => 'false'}, {NAME => 'info', COMPRESSION => 'NONE', VER    
                                  
>  SIONS => '10', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>  
                                     
>  'false', BLOCKCACHE => 'true'}]} 
> {code}
> BLOCKCACHE is 'true' for the 'info' family (Yes historian is still in 0.20 branch).
> But, if I add logging to hfile and storefile and store, blockcache is 'false' -- there
is no cache constructed for use by the hfile.
> This is killing cluster performance.  
> It looks like a problem parsing the 'true' value in columnfamily.  I'll put up a patch
in the morning.  Meantime, marking as blocker on 0.20.4.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message