phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <>
Subject [jira] [Updated] (PHOENIX-2703) Port HBase's PerformanceEvaluation to Phoenix
Date Mon, 22 Feb 2016 20:39:18 GMT


Andrew Purtell updated PHOENIX-2703:
    Attachment: PHOENIX-2703.patch

See attached.

Example use (I put the Phoenix client jar on the classpath of an HBase client install to test):
# Create a pre-split table with 10 M rows using 5 clients (as threads)
./bin/hbase org.apache.phoenix.util.PerformanceEvaluation \
  --url=jdbc:phoenix:localhost:2181:/hbase \
  --blockEncoding=FAST_DIFF --split=5 --rows=2500000 --nomapred  \
  randomWrite 5

# Run the randomSeekScan test 100 times each with 10 clients (as threads)
./bin/hbase org.apache.phoenix.util.PerformanceEvaluation \
  --url=jdbc:phoenix:localhost:2181:/hbase \
  --rows=100 --nomapred \
  randomSeekScan 10

# Again, but emulating filterAll
# (We add an IS NOT NULL clause for a nonexistent dynamic column)
./bin/hbase org.apache.phoenix.util.PerformanceEvaluation \
  --url=jdbc:phoenix:localhost:2181:/hbase \
  --rows=100 --nomapred --filterAll \
  randomSeekScan 10

> Port HBase's PerformanceEvaluation to Phoenix
> ---------------------------------------------
>                 Key: PHOENIX-2703
>                 URL:
>             Project: Phoenix
>          Issue Type: Improvement
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>         Attachments: PHOENIX-2703.patch
> I know Phoenix has the very capable Pherf tool but I wanted a test tool as similar as
possible to HBase's PerformanceEvaluation when making comparisons between HBase-only and HBase+Phoenix
clusters and clients. Therefore I took HBase's PerformanceEvaluation, and replaced HBase API
calls with JDBC equivalents without touching code where not necessary. The result is a small
and independent test tool, useful even though we have Pherf. I have the write tests and some
of the read tests working and tested. I'll post a patch when all read tests have been tested,
and when I've had a chance to test everything using a MR framework.

This message was sent by Atlassian JIRA

View raw message