lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From sunnyfr <johanna...@gmail.com>
Subject command is still running ? delta-import?
Date Mon, 06 Oct 2008 12:55:49 GMT

Hi,

A command is still running... How can I know exactly what does it do ? 
Cuz really , it looks like it does something, but I've cron job for
delta-import every five minutes and nothing change .. 
last 20 minutes I would say, nothing changed at all, row fetched or request
made .. 
And I checked log files, no exception there.
It's the first time this delta import has been started after a tomcat
restart, so maybe it's normal.
How can I check what does it really do right now ? 

root@solr-test:/data/solr/books/data# ps aux | grep solr
tomcat55 18780  0.0  0.0   9452  1512 ?        S    10:45   0:00 /bin/bash
/data/solr/video/bin/snapshooter
root     18786  0.0  0.0  23112  1216 ?        S    10:45   0:00 sudo -u
root /data/solr/video/bin/snapshooter
root     18851  0.0  0.0   3944   620 pts/1    S+   11:17   0:00 grep solr

Thanks a lot guys for all your help,

</lst>
<str name="status">busy</str>
<str name="importResponse">A command is still running...</str>
−
<lst name="statusMessages">
<str name="Time Elapsed">0:28:38.8</str>
<str name="Total Requests made to DataSource">393</str>
<str name="Total Rows Fetched">9184</str>
<str name="Total Documents Processed">55</str>
<str name="Total Documents Skipped">0</str>
<str name="Delta Dump started">2008-10-06 10:45:01</str>
<str name="Identifying Delta">2008-10-06 10:45:01</str>
<str name="Deltas Obtained">2008-10-06 10:45:44</str>
<str name="Building documents">2008-10-06 10:45:44</str>
<str name="Total Changed Documents">8863</str>
</lst>
−

Still the same, 3hours later :

<str name="status">busy</str>
<str name="importResponse">A command is still running...</str>
−
<lst name="statusMessages">
<str name="Time Elapsed">4:1:51.416</str>
<str name="Total Requests made to DataSource">393</str>
<str name="Total Rows Fetched">9184</str>
<str name="Total Documents Processed">55</str>
<str name="Total Documents Skipped">0</str>
<str name="Delta Dump started">2008-10-06 10:45:01</str>
<str name="Identifying Delta">2008-10-06 10:45:01</str>
<str name="Deltas Obtained">2008-10-06 10:45:44</str>
<str name="Building documents">2008-10-06 10:45:44</str>
<str name="Total Changed Documents">8863</str>
</lst>

And my logs :

Oct  6 10:45:01 solr-test /USR/SBIN/CRON[18775]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.video.com:8180/solr/video/dataimport?command=delta-import&entity=b)
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0  Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DataImporter doDeltaImport
INFO: Starting Delta Import
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO:
Read dataimport.properties
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder doDelta INFO: Starting delta
collection.
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_group_ids
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_group_ids rows obtained : 0
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
DeletedRowKey() for Entity: rel_group_ids
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_group_ids rows obtained : 0
Oct  6 10:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
parentDeltaQuery for Entity: rel_group_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_playlist_ids rows obtained : 0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Running DeletedRowKey() for Entity: rel_playlist_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_playlist_ids rows obtained : 0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed parentDeltaQuery for Entity: rel_playlist_ids Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Ru
Oct  6 10:45:01 solr-test jsvc.exec[18716]: fan_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_fan_ids rows obtained : 0 Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Running DeletedRowKey() for Entity: rel_fan_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_fan_ids rows obtained : 0 Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed parentDeltaQuery for Entity: rel_fan_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_featured_home_country Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed ModifiedRowKey for Entity: rel_featured_home_country rows obtained
: 0 Oct 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuil
Oct  6 10:45:01 solr-test jsvc.exec[18716]: owKey() for Entity:
rel_featured_home_country Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: rel_featured_home_country rows obtained : 0 Oct 6,
2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta
INFO: Completed parentDeltaQuery for Entity: rel_featured_home_country Oct
6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder
collectDelta INFO: Running ModifiedRowKey() for Entity:
rel_featured_user_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_featured_user_ids rows obtained : 0 Oct 6,
2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta
INFO: Running DeletedRowKey() for Entity: rel_featured_user_ids Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed DeletedRowKey for Entity: rel_featured_user_ids rows ob
Oct  6 10:45:01 solr-test jsvc.exec[18716]:
apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
parentDeltaQuery for Entity: rel_featured_user_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
ModifiedRowKey() for Entity: rel_featured_group_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: rel_featured_group_ids rows obtained : 0 Oct 6,
2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta
INFO: Running DeletedRowKey() for Entity: rel_featured_group_ids Oct 6, 2008
10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO:
Completed DeletedRowKey for Entity: rel_featured_group_ids rows obtained : 0
Oct 6, 2008 10:45:01 AM org.apache.solr.handler.dataimport.DocBuilder
collectDelta INFO: Completed parentDeltaQuery for Entity:
rel_featured_group_ids Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelt
Oct  6 10:45:01 solr-test jsvc.exec[18716]: tity: video Oct 6, 2008 10:45:01
AM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity video with URL:
jdbc:mysql://master-spare.vip.videos.com/videos Oct 6, 2008 10:45:01 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0 


Oct  6 10:45:42 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:42 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
ModifiedRowKey for Entity: video rows obtained : 8863
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Running
DeletedRowKey() for Entity: video
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
DeletedRowKey for Entity: video rows obtained : 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.DocBuilder collectDelta INFO: Completed
parentDeltaQuery for Entity: video
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity video with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_group_ids with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_playlist_ids with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_fan_ids with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_home_country with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_user_ids with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a
connection for entity rel_featured_group_ids with URL:
jdbc:mysql://master-spare.vip.videos.com/videos
Oct  6 10:45:44 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:44 AM
org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken
for getConnection(): 0
Oct  6 10:45:45 solr-test jsvc.exec[18716]: Oct 6, 2008 10:45:45 AM
org.apache.solr.update.DirectUpdateHandler2 commit INFO: start
commit(optimize=false,waitFlush=true,waitSearcher=true)
Oct  6 10:47:22 solr-test jsvc.exec[18716]: Oct 6, 2008 10:47:22 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 10:48:02 solr-test jsvc.exec[18716]: Oct 6, 2008 10:48:02 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 10:50:01 solr-test /USR/SBIN/CRON[18788]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct  6 10:50:01 solr-test /USR/SBIN/CRON[18791]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 10:50:01 solr-test jsvc.exec[18716]: Oct 6, 2008 10:50:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0

.....
Oct  6 11:17:01 solr-test /USR/SBIN/CRON[18844]: (root) CMD (   cd / &&
run-parts --report /etc/cron.hourly)
Oct  6 11:17:02 solr-test ntpdate[18849]: adjust time server 195.8.215.137
offset -0.036227 sec
Oct  6 11:20:01 solr-test /USR/SBIN/CRON[18853]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct  6 11:20:01 solr-test /USR/SBIN/CRON[18856]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 11:20:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:20:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct  6 11:24:08 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:08 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:24:16 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:16 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:24:19 solr-test jsvc.exec[18716]: Oct 6, 2008 11:24:19 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:25:01 solr-test /USR/SBIN/CRON[18864]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Oct  6 11:25:01 solr-test /USR/SBIN/CRON[18866]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 11:25:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:25:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct  6 11:30:01 solr-test /USR/SBIN/CRON[18870]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct  6 11:30:01 solr-test /USR/SBIN/CRON[18872]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 11:30:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:30:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct  6 11:33:29 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:29 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:33:30 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:30 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:33:30 solr-test jsvc.exec[18716]: Oct 6, 2008 11:33:30 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:35:01 solr-test /USR/SBIN/CRON[18880]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Oct  6 11:35:01 solr-test /USR/SBIN/CRON[18882]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 11:35:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:35:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct  6 11:36:26 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:26 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:36:36 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:36 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:36:37 solr-test jsvc.exec[18716]: Oct 6, 2008 11:36:37 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={} status=0 QTime=0
Oct  6 11:40:01 solr-test /USR/SBIN/CRON[18885]: (root) CMD (/root/memmon.sh
>> /root/memmon.txt)
Oct  6 11:40:01 solr-test /USR/SBIN/CRON[18888]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 11:40:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:40:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0
Oct  6 11:45:01 solr-test /USR/SBIN/CRON[18896]: (root) CMD ([ -x
/usr/lib/sysstat/sa1 ] && { [ -r "$DEFAULT" ] && . "$DEFAULT" ; [ "$ENABLED"
= "true" ] && exec /usr/lib/sysstat/sa1 $SA1_OPTIONS 1 1 ; })
Oct  6 11:45:01 solr-test /USR/SBIN/CRON[18898]: (root) CMD (/usr/bin/wget
-q --output-document=/home/tot.txt
http://solr-test.adm.videos.com:8180/solr/videos/dataimport?command=delta-import&entity=b)
Oct  6 11:45:01 solr-test jsvc.exec[18716]: Oct 6, 2008 11:45:01 AM
org.apache.solr.core.SolrCore execute INFO: [video] webapp=/solr
path=/dataimport params={command=delta-import} status=0 QTime=0


-- 
View this message in context: http://www.nabble.com/command-is-still-running---delta-import--tp19837392p19837392.html
Sent from the Solr - User mailing list archive at Nabble.com.


Mime
View raw message