hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-11039) [VisibilityController] Integration test for labeled data set mixing and filtered excise
Date Wed, 09 Jul 2014 03:28:04 GMT

    [ https://issues.apache.org/jira/browse/HBASE-11039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055812#comment-14055812
] 

Andrew Purtell commented on HBASE-11039:
----------------------------------------

If I run the test with the AccessController removed from the configuration, the test still
fails. 

{noformat}
2014-07-08 20:20:49,936 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Running Loop with args:[1, 1, 10000, /tmp, 1]
2014-07-08 20:20:49,937 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Starting iteration = 0
2014-07-08 20:20:49,937 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Generating data
2014-07-08 20:20:49,938 INFO  [main] test.IntegrationTestBigLinkedList$Generator: Running
RandomInputGenerator with numMappers=1, numNodes=10000
2014-07-08 20:20:51,527 INFO  [main] test.IntegrationTestBigLinkedList$Generator: Running
Generator with numMappers=1, numNodes=10000
2014-07-08 20:20:51,528 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityGenerator:
Creating tables
2014-07-08 20:20:54,782 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Running copier
2014-07-08 20:20:59,782 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Running copier tableName_0
2014-07-08 20:21:04,792 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$Copier:
Running copiers
2014-07-08 20:21:06,886 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Running copier tableName_1
2014-07-08 20:21:11,888 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$Copier:
Running copiers
2014-07-08 20:21:13,805 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Running copier tableName_2
2014-07-08 20:21:18,806 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$Copier:
Running copiers
2014-07-08 20:21:21,080 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Verifying copied data
2014-07-08 20:21:26,080 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop:
Verifying table 0
2014-07-08 20:21:31,083 INFO  [main] test.IntegrationTestBigLinkedListWithVisibility$VisibilityVerify:
Running Verify with outputDir=/tmp/a9a6cf46-213b-4c27-bf3a-84e03c99905d, numReducers=1
2014-07-08 20:21:33,084 ERROR [main] test.IntegrationTestBigLinkedList$Verify: Expected referenced
count does not match with actual referenced count. expected referenced=10000 ,actual=0
2014-07-08 20:21:33,100 ERROR [main] util.AbstractHBaseTool: Error running command-line tool
java.lang.RuntimeException: Verify.verify failed
	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop.verify(IntegrationTestBigLinkedListWithVisibility.java:515)
	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop.runVerify(IntegrationTestBigLinkedListWithVisibility.java:457)
	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility$VisibilityLoop.run(IntegrationTestBigLinkedListWithVisibility.java:558)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility.runTestFromCommandLine(IntegrationTestBigLinkedListWithVisibility.java:601)
	at org.apache.hadoop.hbase.IntegrationTestBase.doWork(IntegrationTestBase.java:79)
	at org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:112)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.hbase.test.IntegrationTestBigLinkedListWithVisibility.main(IntegrationTestBigLinkedListWithVisibility.java:591)
{noformat}


> [VisibilityController] Integration test for labeled data set mixing and filtered excise
> ---------------------------------------------------------------------------------------
>
>                 Key: HBASE-11039
>                 URL: https://issues.apache.org/jira/browse/HBASE-11039
>             Project: HBase
>          Issue Type: Test
>    Affects Versions: 0.98.1
>            Reporter: Andrew Purtell
>            Assignee: ramkrishna.s.vasudevan
>            Priority: Critical
>             Fix For: 0.99.0, 1.0.0, 0.98.4
>
>         Attachments: HBASE-11039_ITBLL_v1.patch
>
>
> Create an integration test for the VisibilityController that:
> 1. Create several tables of test data
> 2. Assign a set of auths to each table. Label all entries in the table with appropriate
visibility expressions. Insure that some data in every table overlaps with data in other tables
at common row/family/qualifier coordinates. Generate data like ITBLL so we can verify all
data present later.
> 3. Mix the data from the different tables into a new common table
> 4. Verify for each set of auths defined in step #2 that all entries found in the source
table can be found in the common table. Like the ITBLL verification step but done N times
for each set of auths defined in step #2.
> 5. Choose one of the source tables. Get its set of auths. Perform a deletion with visibility
expression from the common table using those auths.
> 6. Verify that no data in the common table with the auth set chosen in #5 remains. A
simple row count with the set of auths chosen in #5 that should return 0.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message