nutch-user mailing list archives: July 2016

Site index · List index
Message listThread · Author · Date
Jose Marcio Martins da Cruz Regular expressions in regex-urlfilter.txt Fri, 01 Jul, 09:25
Markus Jelsma   RE: Regular expressions in regex-urlfilter.txt Fri, 01 Jul, 11:44
Jose Marcio Martins da Cruz     Re: Regular expressions in regex-urlfilter.txt Fri, 01 Jul, 11:48
Jose Marcio Martins da Cruz bin/crawl sequencing algorithm Sun, 03 Jul, 07:49
Sebastian Nagel   Re: bin/crawl sequencing algorithm Wed, 06 Jul, 07:50
Jose-Marcio Martins da Cruz     Re: bin/crawl sequencing algorithm Wed, 06 Jul, 09:33
Nana Pandiawan Scoring data from nutch solrindex Sun, 03 Jul, 09:38
Nana Pandiawan   Re: Scoring data from nutch solrindex Sun, 03 Jul, 21:43
Re: Remove Header from content
Nana Pandiawan   Re: Remove Header from content Mon, 04 Jul, 04:16
Markus Jelsma   RE: Remove Header from content Mon, 04 Jul, 09:37
Nana Pandiawan     Re: Remove Header from content Mon, 04 Jul, 13:14
Markus Jelsma   RE: Remove Header from content Tue, 05 Jul, 08:38
Jose-Marcio Martins da Cruz Problem cleaning solr index (nutch clean command). Tue, 05 Jul, 13:11
Sebastian Nagel   Re: Problem cleaning solr index (nutch clean command). Wed, 06 Jul, 07:51
Jose-Marcio Martins da Cruz     Re: Problem cleaning solr index (nutch clean command). Wed, 06 Jul, 09:32
Jose Marcio Martins da Cruz       Follow-up : Re: Problem cleaning solr index (nutch clean command). Wed, 06 Jul, 18:22
Jose Marcio Martins da Cruz         Re: Follow-up : Re: Problem cleaning solr index (nutch clean command). Sat, 09 Jul, 20:14
Manish Verma Nutch Redirect Skip Indexing Orignal Url Tue, 05 Jul, 19:52
Markus Jelsma   RE: Nutch Redirect Skip Indexing Orignal Url Tue, 05 Jul, 22:03
Sebastian Nagel   Re: Nutch Redirect Skip Indexing Orignal Url Wed, 06 Jul, 08:13
Manish Verma readdb get db_gone count Tue, 05 Jul, 22:59
Markus Jelsma   RE: readdb get db_gone count Wed, 13 Jul, 22:16
Megha Bhandari Nutch 1.11 | memory leak? Thu, 07 Jul, 08:56
Markus Jelsma   RE: Nutch 1.11 | memory leak? Thu, 07 Jul, 16:03
Megha Bhandari     RE: Nutch 1.11 | memory leak? Fri, 08 Jul, 11:09
Megha Bhandari Nutch 1.11 | Ignoring content header and footer content while parsing HTML Fri, 08 Jul, 12:56
Markus Jelsma   RE: Nutch 1.11 | Ignoring content header and footer content while parsing HTML Fri, 08 Jul, 15:07
Webmaster Duke Elasticsearch not indexing crawl data Mon, 11 Jul, 04:42
Jamal, Sarfaraz Question(s) hadoop errors Mon, 11 Jul, 14:15
Jamal, Sarfaraz Does Nutch work with JRE8? Mon, 11 Jul, 16:50
Markus Jelsma   RE: Does Nutch work with JRE8? Mon, 11 Jul, 17:06
Jamal, Sarfaraz Running into an Issue Mon, 11 Jul, 20:46
Markus Jelsma   RE: Running into an Issue Tue, 12 Jul, 08:51
Jamal, Sarfaraz     RE: Running into an Issue Tue, 12 Jul, 15:26
Jamal, Sarfaraz     RE: Running into an Issue Wed, 13 Jul, 14:09
Markus Jelsma   RE: Running into an Issue Wed, 13 Jul, 14:44
Jamal, Sarfaraz     RE: Running into an Issue Thu, 14 Jul, 14:22
Jamal, Sarfaraz     RE: Running into an Issue Thu, 14 Jul, 15:00
Manish Verma Delete db_gone from crawdb Tue, 12 Jul, 06:08
Markus Jelsma   RE: Delete db_gone from crawdb Tue, 12 Jul, 08:48
Manish Verma     Re: Delete db_gone from crawdb Tue, 12 Jul, 14:09
Markus Jelsma   RE: Delete db_gone from crawdb Tue, 12 Jul, 16:46
Jigal van Hemert | alterNET internet BV Indexed URLs not re-indexed Tue, 12 Jul, 11:43
Markus Jelsma   RE: Indexed URLs not re-indexed Wed, 13 Jul, 22:12
Markus Jelsma RE: Nutch db_gone Wed, 13 Jul, 22:20
Markus Jelsma RE: Nutch with Alluxio? Wed, 13 Jul, 22:26
Otis Gospodneti─ç   Re: Nutch with Alluxio? Sat, 16 Jul, 04:20
Jamal, Sarfaraz Newbie Nutch/Solr Question(s) Fri, 15 Jul, 13:46
Markus Jelsma   RE: Newbie Nutch/Solr Question(s) Mon, 18 Jul, 20:21
Musshorn, Kris T CTR USARMY RDECOM ARL (US) Integration (UNCLASSIFIED) Tue, 19 Jul, 11:47
Jorge Luis Betancourt Gonz├ílez   Re: Integration (UNCLASSIFIED) Tue, 19 Jul, 22:34
Musshorn, Kris T CTR USARMY RDECOM ARL (US) tutorial help (UNCLASSIFIED) Tue, 19 Jul, 13:37
Jamal, Sarfaraz   RE: tutorial help (UNCLASSIFIED) Tue, 19 Jul, 15:02
Musshorn, Kris T CTR USARMY RDECOM ARL (US)     RE: [Non-DoD Source] RE: tutorial help (UNCLASSIFIED) Wed, 20 Jul, 17:57
Musshorn, Kris T CTR USARMY RDECOM ARL (US)       RE: [Non-DoD Source] RE: tutorial help (UNCLASSIFIED) Wed, 20 Jul, 19:08
Indexing to remote Solr server
BlackIce   Indexing to remote Solr server Wed, 20 Jul, 13:11
Lewis John Mcgibbney   Re: Indexing to remote Solr server Wed, 20 Jul, 13:28
BlackIce     Re: Indexing to remote Solr server Wed, 20 Jul, 14:12
Harry Waye Generate segment of only unfetched urls Wed, 20 Jul, 13:39
Markus Jelsma   RE: Generate segment of only unfetched urls Wed, 20 Jul, 16:30
Harry Waye     Re: Generate segment of only unfetched urls Thu, 21 Jul, 10:19
Harry Waye   Re: Generate segment of only unfetched urls Thu, 21 Jul, 10:26
Markus Jelsma   RE: Generate segment of only unfetched urls Thu, 21 Jul, 11:10
Harry Waye     Re: Generate segment of only unfetched urls Thu, 21 Jul, 11:13
Musshorn, Kris T CTR USARMY RDECOM ARL (US) tutorial work thru (UNCLASSIFIED) Thu, 21 Jul, 11:38
Musshorn, Kris T CTR USARMY RDECOM ARL (US)   RE: [Non-DoD Source] tutorial work thru (UNCLASSIFIED) Thu, 21 Jul, 12:01
Musshorn, Kris T CTR USARMY RDECOM ARL (US)     RE: [Non-DoD Source] tutorial work thru (UNCLASSIFIED) Thu, 21 Jul, 12:08
Musshorn, Kris T CTR USARMY RDECOM ARL (US) solr connection (UNCLASSIFIED) Thu, 21 Jul, 14:18
Jamal, Sarfaraz   RE: solr connection (UNCLASSIFIED) Fri, 22 Jul, 21:49
Jamal, Sarfaraz     RE: solr connection (UNCLASSIFIED) Fri, 22 Jul, 21:52
Musshorn, Kris T CTR USARMY RDECOM ARL (US)       RE: solr connection (UNCLASSIFIED) Tue, 26 Jul, 11:46
Musshorn, Kris T CTR USARMY RDECOM ARL (US) help with integration (UNCLASSIFIED) Thu, 21 Jul, 15:56
Markus Jelsma   RE: help with integration (UNCLASSIFIED) Wed, 27 Jul, 10:55
shakiba davari mapping files created by: nutch dump to the URL from which each file has been dumped. Thu, 21 Jul, 22:57
Markus Jelsma   RE: mapping files created by: nutch dump to the URL from which each file has been dumped. Thu, 21 Jul, 23:10
shakiba davari     Re: mapping files created by: nutch dump to the URL from which each file has been dumped. Fri, 22 Jul, 20:21
Markus Jelsma     RE: mapping files created by: nutch dump to the URL from which each file has been dumped. Wed, 27 Jul, 10:51
Musshorn, Kris T CTR USARMY RDECOM ARL (US) tutorial issue (UNCLASSIFIED) Tue, 26 Jul, 18:34
shakiba davari No FileSystem for scheme: https Tue, 26 Jul, 21:42
shakiba davari   Re: No FileSystem for scheme: https Tue, 26 Jul, 22:41
Nana Pandiawan Error Enable Feed Plugin Wed, 27 Jul, 10:42
Musshorn, Kris T CTR USARMY RDECOM ARL (US) progress (UNCLASSIFIED) Wed, 27 Jul, 13:52
Markus Jelsma   RE: progress (UNCLASSIFIED) Fri, 29 Jul, 11:34
RE: [Non-DoD Source] Re: config question (UNCLASSIFIED)
Musshorn, Kris T CTR USARMY RDECOM ARL (US)   RE: [Non-DoD Source] Re: config question (UNCLASSIFIED) Thu, 28 Jul, 16:04
Manish Verma Indexing Mapper Count Thu, 28 Jul, 22:02
Markus Jelsma   RE: Indexing Mapper Count Fri, 29 Jul, 11:29
Alexandre Rafalovitch Reviewing Solr+Nutch tutorial: which version of Solr? Fri, 29 Jul, 00:21
Markus Jelsma   RE: Reviewing Solr+Nutch tutorial: which version of Solr? Fri, 29 Jul, 11:25
Nutch is taking very long time to complete crawl job :Nutch 2.3.1 + hadoop 2.7.1 +yarn
shubham.gupta   Nutch is taking very long time to complete crawl job :Nutch 2.3.1 + hadoop 2.7.1 +yarn Fri, 29 Jul, 04:00
Markus Jelsma     RE: Nutch is taking very long time to complete crawl job :Nutch 2.3.1 + hadoop 2.7.1 +yarn Fri, 29 Jul, 11:33
shubham.gupta   Nutch is taking very long time to complete crawl job :Nutch 2.3.1 + hadoop 2.7.1 +yarn Fri, 29 Jul, 04:09
mark mark Nutch 1.x log directory Sun, 31 Jul, 18:42
Message listThread · Author · Date
Box list
Jan 20212
Dec 20202
Oct 20206
Sep 20206
Aug 20207
Jul 202020
Jun 202014
Apr 20207
Mar 20206
Feb 20202
Jan 20205
Dec 201912
Nov 20199
Oct 201946
Sep 201911
Aug 20196
Jul 201919
Jun 20193
May 201910
Apr 201912
Mar 201941
Feb 201920
Jan 20192
Dec 201833
Nov 201841
Oct 201852
Sep 201823
Aug 201830
Jul 201823
Jun 201835
May 201823
Apr 201825
Mar 2018117
Feb 201845
Jan 201825
Dec 201744
Nov 201779
Oct 201744
Sep 201770
Aug 201787
Jul 201752
Jun 201757
May 201776
Apr 201759
Mar 201752
Feb 201736
Jan 201773
Dec 201660
Nov 201678
Oct 2016144
Sep 201672
Aug 201669
Jul 201692
Jun 201696
May 201683
Apr 201677
Mar 201687
Feb 2016137
Jan 2016106
Dec 201579
Nov 201584
Oct 201583
Sep 201590
Aug 201527
Jul 201568
Jun 201572
May 201593
Apr 2015127
Mar 2015137
Feb 2015158
Jan 2015126
Dec 201487
Nov 201473
Oct 201474
Sep 2014177
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167