hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Gray (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-867) If millions of columns in a column family, hbase scanner won't come up
Date Sat, 06 Jun 2009 21:50:07 GMT

    [ https://issues.apache.org/jira/browse/HBASE-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12716922#action_12716922

Jonathan Gray commented on HBASE-867:

Issue is probably resolved, but I'm going to continue testing.  It's not possible to create
JUnit tests because the psuedo-distr. cluster falls over under load this high.

First simple test (gets though, not scans... scans next):

Generated 1 Puts in 3068ms
        1 rows, 8 bytes/row key
        1000000 columns/row, 8 bytes/column key
        8 bytes/column value
Inserted Put in 23295ms
Get0 (1000000 KVs) completed in 4031ms
Get1 (1000000 KVs) completed in 2300ms
Get2 (1000000 KVs) completed in 2831ms
Get3 (1000000 KVs) completed in 1707ms
Get4 (1000000 KVs) completed in 2588ms
Get5 (1000000 KVs) completed in 2671ms
Get6 (1000000 KVs) completed in 2442ms
Get7 (1000000 KVs) completed in 2560ms
Get8 (1000000 KVs) completed in 2462ms
Get9 (1000000 KVs) completed in 2822ms

> If millions of columns in a column family, hbase scanner won't come up
> ----------------------------------------------------------------------
>                 Key: HBASE-867
>                 URL: https://issues.apache.org/jira/browse/HBASE-867
>             Project: Hadoop HBase
>          Issue Type: Bug
>            Reporter: stack
>            Assignee: Jonathan Gray
>            Priority: Critical
>             Fix For: 0.20.0
> Our Daniel has uploaded a table that has a column family with millions of columns in
it.  He can get items from the table promptly specifying row and column.  Scanning is another
matter.  Thread dumping I see we're stuck in the scanner constructor nexting through cells.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message