lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rodrigo Oliveira <adamantina.rodr...@gmail.com>
Subject [SOLR] - Best Practices/node down
Date Fri, 26 Jul 2019 13:16:47 GMT
Hi,

Anyone can help me?

I have a cluster from Solr with Zookeeper (5 nodes - 48 Gb each node -
Xms:28 Gb - Xmx:32 Gb). The bigger problem is my environment, because I am
in a process of migration from MYSQL to SOLR.

In this case, I've had just 10% of my migration completed, and the problem
it ocurred.

At the log, I've had the message.

*LOG1*

2399323.AUTOCREATED/lang/stopwords_sv.txt
2019-07-24 22:37:00.620 INFO
 (OverseerThreadFactory-13-thread-75-processing-n:54.54.54.152:8983_solr) [
  ] o.a.s.c.c.ZkConfigManager Copying zk node
/configs/_default/lang/stopwords_fi.txt to
/configs/list_2399323.AUTOCREATED/lang/stopwords_fi.txt
2019-07-24 22:37:00.681 INFO  (qtp1157726741-24363) [
x:list_2356456_shard2_replica_n4] o.a.s.h.a.CoreAdminOperation core create
command
qt=/admin/cores&coreNodeName=core_node7&collection.configName=list_2356456.AUTOCREATED&newCollection=true&name=list_2356456_shard2_replica_n4&action=CREATE&numShards=2&collection=list_2356456&shard=shard2&wt=javabin&version=2&replicaType=NRT
2019-07-24 22:37:00.760 INFO
 (OverseerThreadFactory-13-thread-75-processing-n:54.54.54.152:8983_solr) [
  ] o.a.s.c.c.ZkConfigManager Copying zk node
/configs/_default/lang/hyphenations_ga.txt to
/configs/list_2399323.AUTOCREATED/lang/hyphenations_ga.txt
2019-07-24 22:37:00.878 INFO  (qtp1157726741-24771) [c:list_2389896
s:shard1 r:core_node6 x:list_2389896_shard1_replica_n2]
o.a.s.c.ZkController Persisted config data to node
/configs/list_2389896.AUTOCREATED/managed-schema
2019-07-24 22:37:00.878 INFO  (zkCallback-5-thread-59) [   ]
o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent
state:SyncConnected type:NodeDataChanged
path:/configs/list_2389896.AUTOCREATED/managed-schema, has occurred -
updating schema from ZooKeeper ...
2019-07-24 22:37:00.923 INFO
 (OverseerThreadFactory-13-thread-75-processing-n:54.54.54.152:8983_solr) [
  ] o.a.s.c.c.ZkConfigManager Copying zk node
/configs/_default/lang/stopwords_gl.txt to
/configs/list_2399323.AUTOCREATED/lang/stopwords_gl.txt
2019-07-24 22:37:00.923 INFO  (Thread-1476) [   ] o.a.s.c.SolrCore config
update listener called for core list_2389896_shard1_replica_n2
2019-07-24 22:37:01.033 INFO  (Thread-1476) [   ] o.a.s.c.SolrCore core
reload list_2389896_shard1_replica_n2
2019-07-24 22:37:01.068 INFO
 (OverseerThreadFactory-13-thread-75-processing-n:54.54.54.152:8983_solr) [
  ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json
to /configs/list_2399323.AUTOCREATED/params.json
2019-07-24 22:37:01.134 INFO  (Thread-1471) [   ] o.a.s.c.CoreContainer
Reloading SolrCore 'list_1217965_shard2_replica_n6' using configuration
from collection list_1217965
2019-07-24 22:37:01.150 INFO  (Thread-1471) [c:list_1217965 s:shard2
r:core_node8 x:list_1217965_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter
JMX monitoring for 'solr.core.list_1217965.shard2.replica_n6' (registry
'solr.core.list_1217965.shard2.replica_n6') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@62bd765
2019-07-24 22:37:01.150 INFO  (Thread-1471) [c:list_1217965 s:shard2
r:core_node8 x:list_1217965_shard2_replica_n6] o.a.s.c.SolrCore
[[list_1217965_shard2_replica_n6] ] Opening new SolrCore at
[/solr/server/solr/list_1217965_shard2_replica_n6],
dataDir=[/solr/server/solr/list_1217965_shard2_replica_n6/data/]
2019-07-24 22:37:01.152 INFO  (Thread-1471) [c:list_1217965 s:shard2
r:core_node8 x:list_1217965_shard2_replica_n6] o.a.s.r.XSLTResponseWriter
xsltCacheLifetimeSeconds=5

*LOG2*

Running OOM killer script for process 21252 for Solr on port 8983
Killed process 21252

I got it. Out Of Memory.

Any workaround to this case? Any suggestion? Any tips? 10% of migration and
Out Of Memory. Why the Solr it's consumed all memory?

Regards,

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message