lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From William Bell <billnb...@gmail.com>
Subject Re: How to do a Data sharding for data in a database table
Date Thu, 25 Jun 2015 06:24:22 GMT
1GB is too small to start. Try starting the same on both:

 -Xms8196m -Xmx8196m

We use 12GB for these on a similar sized index and it works good.

Send schema.xml and solrconfig.xml.

Try not to store fields as much as possible.

On Wed, Jun 24, 2015 at 8:08 AM, wwang525 <wwang525@gmail.com> wrote:

> Hi All,
>
> I built the Solr index with 14 M records.
>
> I have > 20 G RAM in my local machine, and the Solr instance was started
> with -Xms1024m -Xmx8196m
>
> The following query:
>
>
> http://localhost:8983/solr/db-mssql/select?q=*:*&fq=GatewayCode:(YYZ)&fq=DestCode:(CUN)&fq=Duration:(5
> OR 6 OR 7 OR 8)&fq=DateDep:([20150610 TO
>
> 20150810])&facet=true&facet.field=DestCode&facet.field=DateDep&facet.field=GatewayCode&facet.field=HotelName&facet.sort=count&facet.limit=40&facet.mincount=1&rows=30&group=true&group.field=HotelCode&group.ngroups=true&group.facet=true&debugQuery=true
>
> The response found a total matched base records of 98105, these records
> were
> grouped at hotelcode level to give the ngroups: 143, however, the query
> only
> retrieve the first base record of each group, and only 30 groups were
> retrieved.
>
> The performance statistics:
>
> Total response time in solr.log: 1791 ms
> From the query response page: the query took 764 ms and facet took 1007 ms.
> Debug took 13 ms
>
> This is a typical query that business need. Previously, I was testing the
> data size of 6 M and no faceted search, the typical response time at single
> request scenario was around 200 ms.
>
> Please let me know if additional information is needed.
>
> Thanks
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/How-to-do-a-Data-sharding-for-data-in-a-database-table-tp4212765p4213648.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>



-- 
Bill Bell
billnbell@gmail.com
cell 720-256-8076

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message