lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "rajat.rastogi@hindustantimes.com" <rajat.rast...@hindustantimes.com>
Subject Solr Issue While indexing Data
Date Wed, 07 Jun 2017 11:10:34 GMT
Hi All,


My enviorment

os :Ubuntu 14.04.1 LTS
java : Orcale hotspot 1.8.0_121
solr version :6.4.2
cpu :16 cores
ram :124 gb

Solr Running in a Master slave Architecture  . Indexing is being done on Master using a cron
job in every 30 Minutes .
Solr instance has 3 cores on which indexing happens simultaneously(cores with different views
of same data).

We Migrated from solr 4.2 to solr 6.4.2 .
Indexing code is in java  which reads from multiple sources than pushes a javabin object.
All setting are set to default in solrconfig  with a change of auto commit off .

Problem :we  have been Facing indexing issues while indexing data

Observation: Addition of documents taking too long in index . some times addition of a document
takes hours . Commits are taking very long due to this.
Two Cpu cores have a close to 100 % utilisation

PFA hprof analysis and object distribution .


regards
Rajat
[cid:622f6e86-772f-47fb-9ef2-39cb0b9490ae@apcprd06.prod.outlook.com]
[cid:99669178-012a-48bb-82fb-6741c9e546f6@apcprd06.prod.outlook.com]









IMPORTANT NOTICE: "This email is confidential containing HT Media confidential information,
may be legally privileged, and is for the intended recipient only. Access, disclosure, copying,
distribution, or reliance on any of it by anyone else is prohibited and may be a criminal
offense. Please delete if obtained in error and email confirmation to the sender." Experience
news. Like never before. Only on www.hindustantimes.com

Mime
View raw message