phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PHOENIX-2703) Port HBase's PerformanceEvaluation to Phoenix
Date Mon, 22 Feb 2016 20:39:18 GMT

     [ https://issues.apache.org/jira/browse/PHOENIX-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Purtell updated PHOENIX-2703:
------------------------------------
    Attachment: PHOENIX-2703.patch

See attached.

Example use (I put the Phoenix client jar on the classpath of an HBase client install to test):
{noformat}
# Create a pre-split table with 10 M rows using 5 clients (as threads)
./bin/hbase org.apache.phoenix.util.PerformanceEvaluation \
  --url=jdbc:phoenix:localhost:2181:/hbase \
  --blockEncoding=FAST_DIFF --split=5 --rows=2500000 --nomapred  \
  randomWrite 5

# Run the randomSeekScan test 100 times each with 10 clients (as threads)
./bin/hbase org.apache.phoenix.util.PerformanceEvaluation \
  --url=jdbc:phoenix:localhost:2181:/hbase \
  --rows=100 --nomapred \
  randomSeekScan 10

# Again, but emulating filterAll
# (We add an IS NOT NULL clause for a nonexistent dynamic column)
./bin/hbase org.apache.phoenix.util.PerformanceEvaluation \
  --url=jdbc:phoenix:localhost:2181:/hbase \
  --rows=100 --nomapred --filterAll \
  randomSeekScan 10
{noformat}

> Port HBase's PerformanceEvaluation to Phoenix
> ---------------------------------------------
>
>                 Key: PHOENIX-2703
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-2703
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>         Attachments: PHOENIX-2703.patch
>
>
> I know Phoenix has the very capable Pherf tool but I wanted a test tool as similar as
possible to HBase's PerformanceEvaluation when making comparisons between HBase-only and HBase+Phoenix
clusters and clients. Therefore I took HBase's PerformanceEvaluation, and replaced HBase API
calls with JDBC equivalents without touching code where not necessary. The result is a small
and independent test tool, useful even though we have Pherf. I have the write tests and some
of the read tests working and tested. I'll post a patch when all read tests have been tested,
and when I've had a chance to test everything using a MR framework.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message