hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Issue Comment Edited] (HBASE-451) Remove HTableDescriptor from HRegionInfo
Date Fri, 24 Jun 2011 21:47:47 GMT

    [ https://issues.apache.org/jira/browse/HBASE-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054690#comment-13054690
] 

Ted Yu edited comment on HBASE-451 at 6/24/11 9:46 PM:
-------------------------------------------------------

Looks like TestTableMapReduce doesn't create the table. From MultiRegionTable which TestTableMapReduce
inherits:
{code}
    HRegion region = createNewHRegion(desc, startKey, endKey);
{code}
I added test of whether table descriptor exists on HDFS in HRegion.createHRegion(). If it
doesn't exist, I call FSUtils.createTableDescriptor().

Now TestTableMapReduce and TestFSTableDescriptors both pass.
TestDistributedLogSplitting and TestSplitTransactionOnCluster pass on my laptop as well.

      was (Author: yuzhihong@gmail.com):
    Looks like TestTableMapReduce doesn't create the table. From MultiRegionTable which TestTableMapReduce
inherits:
{code}
    HRegion region = createNewHRegion(desc, startKey, endKey);
{code}
I added test of whether table descriptor exists on HDFS in HRegion.createHRegion(). If it
doesn't exist, I call FSUtils.createTableDescriptor().

Now TestTableMapReduce and TestFSTableDescriptors both pass.
  
> Remove HTableDescriptor from HRegionInfo
> ----------------------------------------
>
>                 Key: HBASE-451
>                 URL: https://issues.apache.org/jira/browse/HBASE-451
>             Project: HBase
>          Issue Type: Improvement
>          Components: master, regionserver
>    Affects Versions: 0.2.0
>            Reporter: Jim Kellerman
>            Assignee: Subbu M Iyer
>            Priority: Critical
>             Fix For: 0.92.0
>
>         Attachments: 451-addendum.txt, 451_support_for_removing_HTD_from_HRI_trunk.txt,
HBASE-451-Fixed_broken_TestAdmin.patch, HBASE-451-Fixed_broken_TestAdmin1.patch, HBASE-451_-_First_draft_support_for_removing_HTD_from_HRI1.patch,
HBASE-451_-_Fourth_draft_support_for_removing_HTD_from_HRI.patch, HBASE-451_-_Second_draft_-_Remove_HTD_from_HRI.patch,
descriptors.txt, fixtestadmin.txt, pass_htd_on_region_construction.txt
>
>
> There is an HRegionInfo for every region in HBase. Currently HRegionInfo also contains
the HTableDescriptor (the schema). That means we store the schema n times where n is the number
of regions in the table.
> Additionally, for every region of the same table that the region server has open, there
is a copy of the schema. Thus it is stored in memory once for each open region.
> If HRegionInfo merely contained the table name the HTableDescriptor could be stored in
a separate file and easily found.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message