hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-15831) we are running a Spark Job for scanning Hbase table getting Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException
Date Tue, 31 May 2016 19:28:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-15831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308424#comment-15308424
] 

Anoop Sam John commented on HBASE-15831:
----------------------------------------

Why you need a filter?  Can u use Scan setStart and setStop rows to set the range?   The issue
is you are trying to fetch 500 rows in one RPC and there is filters also..  So at server end,
we might be touching many more rows in one RPC call..  This eats up time and client side gets
RPC time out and it retry.  You have to either increase the time outs or/and reduce the possible
#rows touch per scan rpc.

> we are running a Spark Job for scanning Hbase table getting Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException
> ----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-15831
>                 URL: https://issues.apache.org/jira/browse/HBASE-15831
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Neemesh
>
> I am getting following error when I am trying to scan  hbase table in QED environment
for a particular collection
> Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException:
Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id: 1629041
number_of_rows: 100 close_scanner: false next_call_seq: 0
> Following is the command to execute the spark job
> spark-submit --master yarn --deploy-mode client --driver-memory 4g --queue root.ecpqedv1patents
--class com.thomsonreuters.spark.hbase.HbaseSparkFinal HbaseSparkVenus.jar ecpqedv1patents:NovusDocCopy
w_3rd_bonds
> even I tried running this adding following two parameter also --num-executors 200 --executor-cores
4 but even it was throwing same exception.
> I goggled and found if we add following properties we would not be getting above issue,
but this property changes also did not help
> .set("hbase.client.pause","1000")
>       .set("hbase.rpc.timeout","90000")
>       .set("hbase.client.retries.number","3")
>       .set("zookeeper.recovery.retry","1")
>       .set("hbase.client.operation.timeout","30000")
>       .set("hbase.client.scanner.timeout.period","90000")
> Please let us know how to resolve this issue



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message