hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-17608) Add suspend support for RawScanResultConsumer
Date Wed, 22 Feb 2017 15:49:44 GMT

    [ https://issues.apache.org/jira/browse/HBASE-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15878511#comment-15878511
] 

Hudson commented on HBASE-17608:
--------------------------------

FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #2551 (See [https://builds.apache.org/job/HBase-Trunk_matrix/2551/])
HBASE-17608 Add suspend support for RawScanResultConsumer (zhangduo: rev f037f230fd5a0b6f28e68b02f47efeb4dbc22694)
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRawAsyncTableScan.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncClientScanner.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncScanSingleRegionRpcRetryingCaller.java
* (add) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncTableScanRenewLease.java
* (edit) hbase-endpoint/src/main/java/org/apache/hadoop/hbase/client/coprocessor/AsyncAggregationClient.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncTable.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncRpcRetryingCallerFactory.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawAsyncTableImpl.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/AsyncTableResultScanner.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/RawScanResultConsumer.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncTableScanner.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/Threads.java
* (add) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAsyncTableScannerCloseWhileSuspending.java


> Add suspend support for RawScanResultConsumer
> ---------------------------------------------
>
>                 Key: HBASE-17608
>                 URL: https://issues.apache.org/jira/browse/HBASE-17608
>             Project: HBase
>          Issue Type: Sub-task
>          Components: asyncclient, Client, scan
>    Affects Versions: 2.0.0
>            Reporter: Duo Zhang
>            Assignee: Duo Zhang
>             Fix For: 2.0.0
>
>         Attachments: HBASE-17608.patch, HBASE-17608-v1.patch, HBASE-17608-v2.patch, HBASE-17608-v3.patch,
HBASE-17608-v4.patch, HBASE-17608-v5.patch
>
>
> Now for the AsyncResultScanner, we can only close the scanner if we reach the cache size
limit and open a new scanner later. This will breaks the region level consistency.
> For example, you put 10 rows to the region, and open a scanner to scan it. The scanner
returns 5 rows at the first time and the cache is full, so it closes the background scanner.
And before you reopens the scanner to fetch data, the remaining 5 rows has been deleted and
a compaction makes them gone for ever. Then after you reopen the scanner you can not see the
remaining 5 rows.
> So here we should keep the scanner open at RS side to prevent the data below the mvcc
read point of this scanner being deleted.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message