hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ramkrishna.s.vasudevan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-16438) Create a cell type so that chunk id is embedded in it
Date Wed, 19 Apr 2017 04:17:41 GMT

    [ https://issues.apache.org/jira/browse/HBASE-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974040#comment-15974040
] 

ramkrishna.s.vasudevan commented on HBASE-16438:
------------------------------------------------

>From the small tests 
I got these failures
{code}
Tests in error:
  TestBackupHFileCleaner.setUpBeforeClass:66 » IO Shutting down
org.apache.hadoop.hbase.master.balancer.TestRegionLocationFinder.org.apache.hadoop.hbase.master.balancer.TestRegionLocationFinder
  Run 1: TestRegionLocationFinder.setUpBeforeClass:58 » IO Shutting down
  Run 2: TestRegionLocationFinder.tearDownAfterClass:77 NullPointer

  TestLockManager.setupCluster:77 » IO Shutting down
  TestLockProcedure.setupCluster:103 » IO Shutting down
  TestProcedureManager.setupBeforeClass:54 » IO Shutting down
  TestHRegionFileSystem.testBlockStoragePolicy:77 » IO Shutting down
{code}
which seems to be unrelated.
>From the medium tests I got
{code}
Failed tests:
  TestRegionLoad.testRegionLoad:103->compareRegionLoads:110 No of regionLoads from clusterStatus
and regionloads from RS doesn't match expected:<8> but was:<12>
{code}
>From large tests I got no failures.

The TestReversibleScanners and TestFSHLog that were failing have been fixed in the latest
patch. It was nothing but it needed ChunkCreator to be initialized.
bq.Looks like the above assignment can be moved after currentInstance is created.
Nope. We need a new type of Chunkcreator so that it is able to retire the chunks immediately.
So we nullify the current Instance and recreate the chunkCreator instance and again assign
the original one back to the INSTANCE variable. If needed I can rename from 'currentInstance'
to 'oldInstance'.


> Create a cell type so that chunk id is embedded in it
> -----------------------------------------------------
>
>                 Key: HBASE-16438
>                 URL: https://issues.apache.org/jira/browse/HBASE-16438
>             Project: HBase
>          Issue Type: Sub-task
>    Affects Versions: 2.0.0
>            Reporter: ramkrishna.s.vasudevan
>            Assignee: ramkrishna.s.vasudevan
>             Fix For: 2.0.0
>
>         Attachments: HBASE-16438_10_ChunkCreatorwrappingChunkPool_withchunkRef.patch,
HBASE-16438_11_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_12_ChunkCreatorwrappingChunkPool_withchunkRef.patch,
HBASE-16438_13_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_13_ChunkCreatorwrappingChunkPool_withchunkRef.patch,
HBASE-16438_14_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_1.patch, HBASE-16438_3_ChunkCreatorwrappingChunkPool.patch,
HBASE-16438_4_ChunkCreatorwrappingChunkPool.patch, HBASE-16438_8_ChunkCreatorwrappingChunkPool_withchunkRef.patch,
HBASE-16438_9_ChunkCreatorwrappingChunkPool_withchunkRef.patch, HBASE-16438_addendum.patch,
HBASE-16438.patch, MemstoreChunkCell_memstoreChunkCreator_oldversion.patch, MemstoreChunkCell_trunk.patch
>
>
> For CellChunkMap we may need a cell such that the chunk out of which it was created,
the id of the chunk be embedded in it so that when doing flattening we can use the chunk id
as a meta data. More details will follow once the initial tasks are completed. 
> Why we need to embed the chunkid in the Cell is described by [~anastas] in this remark
over in parent issue https://issues.apache.org/jira/browse/HBASE-14921?focusedCommentId=15244119&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15244119



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message