hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-856) Data inserted into tables is not immidiately visible in the scanner with row filter
Date Tue, 06 Jan 2009 05:51:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661051#action_12661051
] 

stack commented on HBASE-856:
-----------------------------

I tried your new script on our 4-node cluster Krzysiek.  I did it multiple times.  I don't
see your delay.  See below.

That said, my guess is that there is probably something going on in here but it doesn't translate.
 Any chance of your digging in on your end more?   Add debugging to at least narrow where
the delay is happening?  If we knew where, it might yield a clue?

Sorry this is being such a PITA

{code}
....
09/01/06 05:45:17 [main] DEBUG client.HConnectionManager$TableServers: Attempt 0 of 10 failed
with <org.apache.hadoop.hbase.client.NoServerForRegionException: No server address listed
in .META. for region tmptable_2,,1231220717890>. Retrying after sleep of 2000
09/01/06 05:45:17 [main] DEBUG client.HConnectionManager$TableServers: Removed .META.,,1 for
tableName=.META. from cache because of tmptable_2,,99999999999999
09/01/06 05:45:18 [main] DEBUG client.HConnectionManager$TableServers: Found ROOT REGION =>
{NAME => '-ROOT-,,0', STARTKEY => '', ENDKEY => '', ENCODED => 70236052, TABLE
=> {{NAME => '-ROOT-', IS_ROOT => 'true', IS_META => 'true', FAMILIES => [{NAME
=> 'info',}
table tmptable_3 created
***********************************
table tmptable_0 test start
09/01/06 05:45:30 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <>
in tableName tmptable_0: location server XX.XX.XX.141:60020, location region name tmptable_0,,1231220705555
HRI details: tmptable_0,,1231220705555@XX.XX.XX.141:60020
inserting some sample data into random row id (aaaaa731204631)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa731204631 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:30 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_0
starting at key 'a'
09/01/06 05:45:30 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to
startKey at 'a'
09/01/06 05:45:30 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region
REGION => {NAME => 'tmptable_0,,1231220705555', STARTKEY => '', ENDKEY => '',
ENCODED => 1438968951, TABLE => {{NAME => 'tmptable_0', IS_ROOT => 'false', IS_META
=> 'false}
.09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_0
starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to
startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region
REGION => {NAME => 'tmptable_0,,1231220705555', STARTKEY => '', ENDKEY => '',
ENCODED => 1438968951, TABLE => {{NAME => 'tmptable_0', IS_ROOT => 'false', IS_META
=> 'false}

the new row has been found within 1 seconds
table tmptable_0 test finish
***********************************
***********************************
table tmptable_1 test start
09/01/06 05:45:31 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <>
in tableName tmptable_1: location server XX.XX.XX.142:60020, location region name tmptable_1,,1231220711726
HRI details: tmptable_1,,1231220711726@XX.XX.XX.142:60020
inserting some sample data into random row id (aaaaa-200513010)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-200513010 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_1
starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to
startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region
REGION => {NAME => 'tmptable_1,,1231220711726', STARTKEY => '', ENDKEY => '',
ENCODED => 2008303633, TABLE => {{NAME => 'tmptable_1', IS_ROOT => 'false', IS_META
=> 'false}

the new row has been found within 0 seconds
table tmptable_1 test finish
***********************************
***********************************
table tmptable_2 test start
09/01/06 05:45:31 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <>
in tableName tmptable_2: location server XX.XX.XX.139:60020, location region name tmptable_2,,1231220717890
HRI details: tmptable_2,,1231220717890@XX.XX.XX.139:60020
inserting some sample data into random row id (aaaaa47469040)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa47469040 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_2
starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to
startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region
REGION => {NAME => 'tmptable_2,,1231220717890', STARTKEY => '', ENDKEY => '',
ENCODED => 1916892386, TABLE => {{NAME => 'tmptable_2', IS_ROOT => 'false', IS_META
=> 'false}

the new row has been found within 0 seconds
table tmptable_2 test finish
***********************************
***********************************
table tmptable_3 test start
09/01/06 05:45:31 [main] DEBUG client.HConnectionManager$TableServers: Cache hit for row <>
in tableName tmptable_3: location server XX.XX.XX.141:60020, location region name tmptable_3,,1231220724046
HRI details: tmptable_3,,1231220724046@XX.XX.XX.141:60020
inserting some sample data into random row id (aaaaa-802676562)
inserted
testing if the new row is available through get method
confirming that data:test value = test of row aaaaa-802676562 is available
testing if the new row is available through scanner with filter
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_3
starting at key 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to
startKey at 'a'
09/01/06 05:45:31 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region
REGION => {NAME => 'tmptable_3,,1231220724046', STARTKEY => '', ENDKEY => '',
ENCODED => 2133231639, TABLE => {{NAME => 'tmptable_3', IS_ROOT => 'false', IS_META
=> 'false}
.09/01/06 05:45:32 [main] DEBUG client.HTable$ClientScanner: Creating scanner over tmptable_3
starting at key 'a'
09/01/06 05:45:32 [main] DEBUG client.HTable$ClientScanner: Advancing internal scanner to
startKey at 'a'
09/01/06 05:45:32 [main] DEBUG client.HTable$ClientScanner: Advancing forward from region
REGION => {NAME => 'tmptable_3,,1231220724046', STARTKEY => '', ENDKEY => '',
ENCODED => 2133231639, TABLE => {{NAME => 'tmptable_3', IS_ROOT => 'false', IS_META
=> 'false}

the new row has been found within 1 seconds
table tmptable_3 test finish
***********************************
---------------DONE----------------
{code}


> Data inserted into tables is not immidiately visible in the scanner with row filter
> -----------------------------------------------------------------------------------
>
>                 Key: HBASE-856
>                 URL: https://issues.apache.org/jira/browse/HBASE-856
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: filters
>    Affects Versions: 0.2.0
>         Environment: 3 Region servers on different machines one of them running Master
too. Ubuntu 8.04 server. Hadoop 0.17.2
>            Reporter: Krzysiek Szlapinski
>            Assignee: stack
>             Fix For: 0.19.0
>
>         Attachments: DelayTest.java, DelayTest.java, DelayTest.java
>
>
> When data is inserted into Region that is on the different machine than the Master it
is not immidiately available in the scanner that is using RowFilter
> Here is the output of the test case on 3 nodes (tmptable_0 and tmptable_2 were placed
on the region servers that are not running master server).
> ---------------DelayTest----------------
> table tmptable_0 created
> table tmptable_1 created
> table tmptable_2 created
> ***********************************
> table tmptable_0 test start
> inserting some sample data into random row id (aaaaa-2108369209)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-2108369209 is available
> testing if the new row is available through scanner with filter
> ...................................
> the new row has been found within 35 seconds
> table tmptable_0 test finish
> ***********************************
> ***********************************
> table tmptable_1 test start
> inserting some sample data into random row id (aaaaa-20410017)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa-20410017 is available
> testing if the new row is available through scanner with filter
> the new row has been found within 0 seconds
> table tmptable_1 test finish
> ***********************************
> ***********************************
> table tmptable_2 test start
> inserting some sample data into random row id (aaaaa1756705479)
> inserted
> testing if the new row is available through get method
> confirming that data:test value = test of row aaaaa1756705479 is available
> testing if the new row is available through scanner with filter
> ....................
> the new row has been found within 20 seconds
> table tmptable_2 test finish
> ***********************************
> ---------------DONE----------------

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message