hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wayne (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3438) Cluster Wide Pauses
Date Wed, 12 Jan 2011 20:22:45 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12980905#action_12980905

Wayne commented on HBASE-3438:

I did not think a region split would block reads, just writes. There is very little variance
in the cell size. We have 8 tables 3 of which are used currently each with 4 CFs  and only
1 CF is ever written to for a given row key. For loads the batch mutate is given 10k values
at a time which are grouped into a list of row mutations. The # of row mutations in a batch
totally varies from a few to thousands. All 10k values are passed to 3 CFs as there are 2
secondary CFs. Below is a typical row key / col / ts / value.

P.12345_D.1234567890 / P:D.1234567800_M.123 / 12948623468629950 / 52.5

> Cluster Wide Pauses
> -------------------
>                 Key: HBASE-3438
>                 URL: https://issues.apache.org/jira/browse/HBASE-3438
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.89.20100924
>         Environment: CentOS 5.5, 10 Nodes, 24GB RAM, 4 1TB Disks, 8GB Heap
>            Reporter: Wayne
> Under heavy write load the entire cluster seems to pause with all nodes pausing writes/reads
for several seconds at a time. This seems to be worse with larger region sizes. One possible
explanation is that a single node gets caught/paused/stuck during a split and that all other
nodes are waiting on that one node so it looks like a cluster wide pause.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message