hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jean-Daniel Cryans (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-783) For single row, single family retrieval, getRow() works half as fast as getScanner().next()
Date Tue, 29 Jul 2008 20:03:31 GMT

    [ https://issues.apache.org/jira/browse/HBASE-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12617923#action_12617923
] 

Jean-Daniel Cryans commented on HBASE-783:
------------------------------------------

Passes the tests

{code}
test:
   [delete] Deleting directory /home/jdcryans/svn/hbase/hbase783/build/test/logs
    [mkdir] Created dir: /home/jdcryans/svn/hbase/hbase783/build/test/logs
    [junit] Running org.apache.hadoop.hbase.TestClassMigration
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.072 sec
    [junit] Running org.apache.hadoop.hbase.TestCompare
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.057 sec
    [junit] Running org.apache.hadoop.hbase.TestEmptyMetaInfo
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 33.357 sec
    [junit] Running org.apache.hadoop.hbase.TestGlobalMemcacheLimit
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 55.488 sec
    [junit] Running org.apache.hadoop.hbase.TestHBaseCluster
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 41.393 sec
    [junit] Running org.apache.hadoop.hbase.TestInfoServers
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 14.277 sec
    [junit] Running org.apache.hadoop.hbase.TestMasterAdmin
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 24.34 sec
    [junit] Running org.apache.hadoop.hbase.TestMergeMeta
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 157.313 sec
    [junit] Running org.apache.hadoop.hbase.TestMergeTable
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 115.331 sec
    [junit] Running org.apache.hadoop.hbase.TestRegionRebalancing
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 63.768 sec
    [junit] Running org.apache.hadoop.hbase.TestScanMultipleVersions
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 21.477 sec
    [junit] Running org.apache.hadoop.hbase.TestScannerAPI
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 44.356 sec
    [junit] Running org.apache.hadoop.hbase.TestSerialization
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.336 sec
    [junit] Running org.apache.hadoop.hbase.TestTable
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 130.439 sec
    [junit] Running org.apache.hadoop.hbase.TestToString
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.008 sec
    [junit] Running org.apache.hadoop.hbase.client.TestBatchUpdate
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 82.73 sec
    [junit] Running org.apache.hadoop.hbase.client.TestHTable
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 119.591 sec
    [junit] Running org.apache.hadoop.hbase.client.TestListTables
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 30.398 sec
    [junit] Running org.apache.hadoop.hbase.client.TestScannerTimes
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 30.422 sec
    [junit] Running org.apache.hadoop.hbase.client.TestTimestamp
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 20.403 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestInclusiveStopRowFilter
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.009 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestPageRowFilter
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.007 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestRegExpRowFilter
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.024 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestRowFilterAfterWrite
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 29.401 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestRowFilterOnMultipleFamilies
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 21.401 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestRowFilterSet
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.088 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestStopRowFilter
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.011 sec
    [junit] Running org.apache.hadoop.hbase.filter.TestWhileMatchRowFilter
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.01 sec
    [junit] Running org.apache.hadoop.hbase.io.TestHbaseObjectWritable
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.101 sec
    [junit] Running org.apache.hadoop.hbase.mapred.TestTableIndex
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 48.348 sec
    [junit] Running org.apache.hadoop.hbase.mapred.TestTableMapReduce
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 111.926 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestBloomFilters
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 30.539 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestCompaction
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 30.585 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestDeleteAll
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.318 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestDeleteFamily
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 9.308 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestGet
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 39.316 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestGet2
    [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 86.074 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestHLog
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 16.962 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestHMemcache
    [junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 0.302 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestHRegion
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 48.365 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestHRegionInfo
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.123 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestHStoreFile
    [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 51.942 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestLogRolling
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 96.535 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestScanner
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.386 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestSplit
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 110.615 sec
    [junit] Running org.apache.hadoop.hbase.regionserver.TestTimestamp
    [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 30.2 sec
    [junit] Running org.apache.hadoop.hbase.util.TestBase64
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.076 sec
    [junit] Running org.apache.hadoop.hbase.util.TestKeying
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.006 sec
    [junit] Running org.apache.hadoop.hbase.util.TestMergeTool
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 66.365 sec
    [junit] Running org.apache.hadoop.hbase.util.TestMigrate
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 39.496 sec
    [junit] Running org.apache.hadoop.hbase.util.TestRootPath
    [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.012 sec
    [junit] Running org.onelab.test.TestFilter
    [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.022 sec

BUILD SUCCESSFUL
Total time: 31 minutes 28 seconds
{code}

> For single row, single family retrieval, getRow() works half as fast as getScanner().next()
> -------------------------------------------------------------------------------------------
>
>                 Key: HBASE-783
>                 URL: https://issues.apache.org/jira/browse/HBASE-783
>             Project: Hadoop HBase
>          Issue Type: Improvement
>    Affects Versions: 0.2.0
>            Reporter: Jonathan Gray
>            Assignee: Jean-Daniel Cryans
>            Priority: Minor
>             Fix For: 0.2.1, 0.3.0
>
>         Attachments: hbase-783-v1.patch
>
>
> We have a very typical use-case of wanting to retrieve all columns under a single row,
single family.
> Benchmarking regularly reproduces the same result.  Using HTable.getScanner().next()
to get the RowResult works twice as fast as HTable.getRow().
> This is related to HBASE-631 by jdcryans which added this functionality to getRow().

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message