hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HBASE-4010) HMaster.createTable could be heavily optimized
Date Wed, 22 Jun 2011 05:03:47 GMT

     [ https://issues.apache.org/jira/browse/HBASE-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Ted Yu updated HBASE-4010:

    Comment: was deleted

(was: Interesting, v3 was customized to latest trunk.
TestAdmin used to pass for v2.
Now the tests were fine but JVM didn't shutdown:
"main" prio=5 tid=103000800 nid=0x100601000 in Object.wait() [100600000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1210)
        - locked <7a6041b98> (a org.apache.hadoop.fs.FileSystem$ClientFinalizer)
        at java.lang.Thread.join(Thread.java:1263)
        at java.lang.ApplicationShutdownHooks.runHooks(ApplicationShutdownHooks.java:79)
        at java.lang.ApplicationShutdownHooks$1.run(ApplicationShutdownHooks.java:24)
        at java.lang.Shutdown.runHooks(Shutdown.java:79)
        at java.lang.Shutdown.sequence(Shutdown.java:123)
        at java.lang.Shutdown.exit(Shutdown.java:168)
        - locked <7faf8ead8> (a java.lang.Class for java.lang.Shutdown)
        at java.lang.Runtime.exit(Runtime.java:90)

> HMaster.createTable could be heavily optimized
> ----------------------------------------------
>                 Key: HBASE-4010
>                 URL: https://issues.apache.org/jira/browse/HBASE-4010
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.90.3
>            Reporter: Jean-Daniel Cryans
>            Assignee: Ted Yu
>             Fix For: 0.92.0
>         Attachments: 4010-v2.txt, 4010-v3.txt
> Looking at the createTable method in HMaster (the one that's private), we seem to be
very inefficient:
>  - We set the enabled flag for the table for every region (should be done only once).
>  - Every time we create a new region we create a new HLog and then close it (reuse one
instead or see if it's really necessary).
>  - We do one RPC to .META. per region (we should batch put).
> This should provide drastic speedups even for those creating tables with just 50 regions.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message