lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mark Miller (JIRA)" <>
Subject [jira] [Commented] (SOLR-2646) Integrate Solr benchmarking support into the Benchmark module
Date Sun, 15 Jul 2012 22:57:34 GMT


Mark Miller commented on SOLR-2646:

I've got a fair amount of this automated now. It's still somewhat hackey though.

Because you need to apply the benchmark patch to get things working, I count on that checkout
existing and being patched in a specific location. It drives the benchmark, but talks to a
running Solr that is started from a checkout. I use git so that it's really cheap to flip
through revs and run benchmarks.

The main driver is an ugly .sh script - it accepts a few params (name of the chart, where
to write result files, location of alg file, date range of checkouts to run the alg against,
and the interval to try between days).

For instance, you might say, run the indexing benchmark over the period of 2012-01-04 to 2012-07-15
and do it once for every 5 days.

This happens and the output of the benchmarks are dumped into a folder.

Then I have a simple java cmd line app that will process the result folder. It takes a chart
name, the location of results folder, and a list of named regexes - each regex pointing to
the pertinent data to pull from the results file. The java app pulls out all the data, writes
a csv file, and outputs a simple line chart.

I don't know how cleaned up this will get, i won't post any of it for now - but I may get
to the point of running some stuff locally automatically and pushing to a webserver with the
charts etc, al la Lucene.
> Integrate Solr benchmarking support into the Benchmark module
> -------------------------------------------------------------
>                 Key: SOLR-2646
>                 URL:
>             Project: Solr
>          Issue Type: New Feature
>            Reporter: Mark Miller
>            Assignee: Mark Miller
>             Fix For: 4.0
>         Attachments: Dev-SolrBenchmarkModule.pdf, SOLR-2646.patch, SOLR-2646.patch, SOLR-2646.patch,
SOLR-2646.patch, SolrIndexingPerfHistory.pdf, chart.jpg
> As part of my buzzwords Solr pef talk, I did some work to allow some Solr benchmarking
with the benchmark module.
> I'll attach a patch with the current work I've done soon - there is still a fair amount
to clean up and fix - a couple hacks or three - but it's already fairly useful.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message