hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "xiaolerzheng (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HBASE-21593) closing flags show be set false in HRegion
Date Thu, 13 Dec 2018 09:44:00 GMT

    [ https://issues.apache.org/jira/browse/HBASE-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16719887#comment-16719887
] 

xiaolerzheng edited comment on HBASE-21593 at 12/13/18 9:43 AM:
----------------------------------------------------------------

I met some strange problem:

when I export some row putted in [start_time, end_time) using command:  

$hbase org.apache.hadoop.hbase.mapreduce.Export RAW.LOAN_APP_FLOW hdfs://10.1.170.1:8020/tmp/export/loan_app_flow
1 1543852800000 1543939200000

 no result was return

 

 

 

 

18/12/12 14:54:23 INFO mapreduce.Job: Counters: 20
 File System Counters
 FILE: Number of bytes read=584860554
 FILE: Number of bytes written=592091874
 FILE: Number of read operations=0
 FILE: Number of large read operations=0
 FILE: Number of write operations=0
 HDFS: Number of bytes read=0
 HDFS: Number of bytes written=606
 HDFS: Number of read operations=27
 HDFS: Number of large read operations=0
 HDFS: Number of write operations=12
 Map-Reduce Framework
 {color:#ff0000}Map input records=0{color}
 {color:#ff0000} Map output records=0{color}
 Input split bytes=827
 Spilled Records=0
 Failed Shuffles=0
 Merged Map outputs=0
 GC time elapsed (ms)=7
 Total committed heap usage (bytes)=4102029312
 File Input Format Counters
 Bytes Read=0
 File Output Format Counter

 

 

 

debug log:

 

!image-2018-12-13-16-04-51-892.png!

 

!image-2018-12-13-16-05-09-246.png!

!image-2018-12-13-16-05-36-404.png!

 

 this happened when doing ETL from hbase to hive while at the same time, some manual split
region happened for maintain hbase(split large region to small improving performance)


was (Author: xiaolerzheng):
I met some strange problem:

when I export some row putted in [start_time, end_time) using command:  

$hbase org.apache.hadoop.hbase.mapreduce.Export RAW.LOAN_APP_FLOW hdfs://10.1.170.1:8020/tmp/export/loan_app_flow
1 1543852800000 1543939200000

 no result was return

 

 

 

 

18/12/12 14:54:23 INFO mapreduce.Job: Counters: 20
 File System Counters
 FILE: Number of bytes read=584860554
 FILE: Number of bytes written=592091874
 FILE: Number of read operations=0
 FILE: Number of large read operations=0
 FILE: Number of write operations=0
 HDFS: Number of bytes read=0
 HDFS: Number of bytes written=606
 HDFS: Number of read operations=27
 HDFS: Number of large read operations=0
 HDFS: Number of write operations=12
 Map-Reduce Framework
 {color:#FF0000}Map input records=0{color}
{color:#FF0000} Map output records=0{color}
 Input split bytes=827
 Spilled Records=0
 Failed Shuffles=0
 Merged Map outputs=0
 GC time elapsed (ms)=7
 Total committed heap usage (bytes)=4102029312
 File Input Format Counters
 Bytes Read=0
 File Output Format Counter

 

 

 

debug log:

 

!image-2018-12-13-16-04-51-892.png!

 

!image-2018-12-13-16-05-09-246.png!

!image-2018-12-13-16-05-36-404.png!

 

 

 

 

 

> closing flags show be set false in HRegion
> ------------------------------------------
>
>                 Key: HBASE-21593
>                 URL: https://issues.apache.org/jira/browse/HBASE-21593
>             Project: HBase
>          Issue Type: Bug
>            Reporter: xiaolerzheng
>            Priority: Minor
>         Attachments: image-2018-12-13-16-04-51-892.png, image-2018-12-13-16-05-09-246.png,
image-2018-12-13-16-05-36-404.png
>
>
> in HRegion.java
>  
>  
> 1429 // block waiting for the lock for closing
> 1430 lock.writeLock().lock();
> 1431 this.closing.set(true);
> 1432 status.setStatus("Disabling writes for close");
>  
> ....
>  
>  
> 1557 } finally {
>        {color:#FF0000}  //should here add {color}
>     {color:#FF0000}    this.closing.set(false); {color}
> 1558  lock.writeLock().unlock();
> 1559 }



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message