lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bhaumik Joshi <bjo...@asite.com>
Subject Solr Sharding Strategy
Date Mon, 11 Apr 2016 12:31:35 GMT
Hi,



We are using solr 5.2.0 and we have Index-heavy (100 index updates per sec) and Query-heavy
(100 queries per sec) scenario.

Index stats: 10 million documents and 16 GB index size



Which sharding strategy is best suited in above scenario?

Please share reference resources which states detailed comparison of single shard over multi
shard if any.



Meanwhile we did some tests with SolrMeter (Standalone java tool for stress tests with Solr)
for single shard and two shards.

Index stats of test solr cloud: 0.7 million documents and 1 GB index size.

As observed in test average query time with 2 shards is much higher than single shard.

Please find below detailed readings:
2 Shards

Intended queries per sec

Actual queries per min

Actual queries per sec

Intended updates per sec

Actual updates per min

Actual updates per sec

Total Queries

Total Q time (ms)

Avg Q Time (ms)

Avg Q Time (sec)

Total Client time (ms)

Avg Client time (ms)

10

198

3.3

10

600

10

302

662176

2192

2.192

756603

2505

25

168

2.8

25

1314

21.9

301

2019735

6710

6.71

2370018

7873


1 Shard

Intended queries per sec

Actual queries per min

Actual queries per sec

Intended updates per sec

Actual updates per min

Actual updates per sec

Total Queries

Total Q time (ms)

Avg Q Time (ms)

Avg Q Time (sec)

Total Client time (ms)

Avg Client time (ms)

10

582

9.7

10

618

10.3

302

25081

83

0.083

55612

184

25

1026

17.1

25

834

13.9

306

33366

109

0.109

259392

847


Note: Query returns 250 rows and matches 57880 documents




Thanks & Regards,


[Description: Description: Description: C:\Users\hparekh\AppData\Roaming\Microsoft\Signatures\images\logo.jpg]

Bhaumik Joshi
Developer



Asite, A4, Shivalik Business Center, B/h. Rajpath Club, Opp. Kens Ville Golf Academy, Bodakdev,
Ahmedabad 380054, Gujarat, India.
T: +91 (079) 4021 1900 Ext: 5234 | M: +91 94282 99055 | E: bjoshi@asite.com<mailto:bjoshi@asite.com>
W: www.asite.com<http://www.asite.com/> | Twitter: @Asite<https://twitter.com/Asite/>
| Facebook: facebook.com/Asite<http://www.facebook.com/pages/ASITE/201872569531>



[Asite]

The Hyperloop Station Design Competition - A 48hr design collaboration, from mid-day, 23rd
May 2016.
REGISTER HERE http://www.buildearthlive.com/hyperloop

[Build Earth Live Hyperloop]<http://www.buildearthlive.com/hyperloop>

[CC Award Winners 2015]

Mime
  • Unnamed multipart/related (inline, None, 0 bytes)
View raw message