nutch-user mailing list archives: August 2013

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Re: SolrClean not available in nutch 2.x
claudiuchis   Re: SolrClean not available in nutch 2.x Thu, 01 Aug, 00:45
Lewis John Mcgibbney     Re: SolrClean not available in nutch 2.x Thu, 01 Aug, 15:48
Julien Nioche     Re: SolrClean not available in nutch 2.x Thu, 01 Aug, 15:55
Re: Nutch 1.6 - sequence in which crawler works its way to a URL
Ahme Emre Aladağ   Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 01:27
A Laxmi     Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 10:48
A Laxmi       Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 10:57
Talat UYARER         Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 12:48
A Laxmi           Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 13:00
Julien Nioche         Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 13:28
A Laxmi           Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 13:34
Julien Nioche             Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 13:40
A Laxmi               Re: Nutch 1.6 - sequence in which crawler works its way to a URL Thu, 01 Aug, 13:47
Re: Revaluation
Ahme Emre Aladağ   Re: Revaluation Thu, 01 Aug, 01:30
Re: Nutch 2.2.1 - scripts "crawl" and "nutch"
H. Coskun Gunduz   Re: Nutch 2.2.1 - scripts "crawl" and "nutch" Thu, 01 Aug, 06:00
devang pandey nutch webgraph analysis Thu, 01 Aug, 06:26
Markus Jelsma   RE: nutch webgraph analysis Thu, 01 Aug, 09:26
devang pandey   Re: nutch webgraph analysis Thu, 01 Aug, 09:46
Markus Jelsma     RE: nutch webgraph analysis Thu, 01 Aug, 09:49
devang pandey       Re: nutch webgraph analysis Thu, 01 Aug, 09:52
devang pandey nutch analytics Thu, 01 Aug, 12:02
Re: Nutch 1.6 - Parse Meta-tags plugin question
A Laxmi   Re: Nutch 1.6 - Parse Meta-tags plugin question Thu, 01 Aug, 13:02
feng lu     Re: Nutch 1.6 - Parse Meta-tags plugin question Sun, 04 Aug, 14:12
Jayadeep Reddy Way to fetch only new sites Thu, 01 Aug, 13:03
A Laxmi   Re: Way to fetch only new sites Thu, 01 Aug, 13:17
Jayadeep Reddy     Re: Way to fetch only new sites Thu, 01 Aug, 13:25
Julien Nioche   Re: Way to fetch only new sites Thu, 01 Aug, 13:30
Jayadeep Reddy     Re: Way to fetch only new sites Thu, 01 Aug, 13:32
Julien Nioche       Re: Way to fetch only new sites Thu, 01 Aug, 13:38
A Laxmi         Re: Way to fetch only new sites Thu, 01 Aug, 13:40
Jayadeep Reddy           Re: Way to fetch only new sites Thu, 01 Aug, 14:01
Tejas Patil             Re: Way to fetch only new sites Fri, 02 Aug, 04:55
A Laxmi               Re: Way to fetch only new sites Fri, 02 Aug, 10:43
devang pandey using nutch to generate directed graph Thu, 01 Aug, 17:34
Re: URL in crawldb not appearing in Solr after indexing.
Sebastian Nagel   Re: URL in crawldb not appearing in Solr after indexing. Thu, 01 Aug, 20:52
Os Tyler   RE: URL in crawldb not appearing in Solr after indexing. Thu, 01 Aug, 22:10
Sebastian Nagel     Re: URL in crawldb not appearing in Solr after indexing. Thu, 01 Aug, 22:48
A Laxmi fetch failed with: Http code = 403 Thu, 01 Aug, 20:56
Sebastian Nagel   Re: fetch failed with: Http code = 403 Thu, 01 Aug, 22:27
A Laxmi     Re: fetch failed with: Http code = 403 Thu, 01 Aug, 23:16
feng lu       Re: fetch failed with: Http code = 403 Sun, 04 Aug, 13:53
RE: regex-urlfilter test shows negative, but URL still crawled
Os Tyler   RE: regex-urlfilter test shows negative, but URL still crawled Thu, 01 Aug, 22:20
Sebastian Nagel     Re: regex-urlfilter test shows negative, but URL still crawled Thu, 01 Aug, 22:37
A Laxmi Nutch 1.6: Error parsing failed(2,0): XML parse error Fri, 02 Aug, 14:48
A Laxmi   Re: Nutch 1.6: Error parsing failed(2,0): XML parse error Fri, 02 Aug, 19:22
A Laxmi     Re: Nutch 1.6: Error parsing failed(2,0): XML parse error Fri, 02 Aug, 19:23
feng lu       Re: Nutch 1.6: Error parsing failed(2,0): XML parse error Sun, 04 Aug, 13:49
A Laxmi         Re: Nutch 1.6: Error parsing failed(2,0): XML parse error Mon, 05 Aug, 14:25
Re: Nutch returns index as document
stone2dbone   Re: Nutch returns index as document Fri, 02 Aug, 18:49
Sebastian Nagel     Re: Nutch returns index as document Fri, 02 Aug, 21:15
Otis Gospodnetic 2.x vs. 1.x speed Tue, 06 Aug, 08:08
Julien Nioche   Re: 2.x vs. 1.x speed Tue, 06 Aug, 08:54
Lewis John Mcgibbney     Re: 2.x vs. 1.x speed Tue, 06 Aug, 15:17
Otis Gospodnetic     Re: 2.x vs. 1.x speed Wed, 07 Aug, 00:20
Julien Nioche       Re: 2.x vs. 1.x speed Wed, 07 Aug, 08:00
Lewis John Mcgibbney         Re: 2.x vs. 1.x speed Sat, 24 Aug, 04:51
Lewis John Mcgibbney         Re: 2.x vs. 1.x speed Sat, 24 Aug, 05:11
Otis Gospodnetic   Re: 2.x vs. 1.x speed Tue, 06 Aug, 23:23
Os Tyler Fetch "Read time out" and crawl_parse "Input path does not exist" Tue, 06 Aug, 13:21
Sebastian Nagel   Re: Fetch "Read time out" and crawl_parse "Input path does not exist" Tue, 06 Aug, 17:00
Os Tyler   RE: Fetch "Read time out" and crawl_parse "Input path does not exist" Tue, 06 Aug, 17:30
Os Tyler     RE: Fetch "Read time out" and crawl_parse "Input path does not exist" Wed, 07 Aug, 04:50
Sebastian Nagel       Re: Fetch "Read time out" and crawl_parse "Input path does not exist" Wed, 07 Aug, 06:45
Rui Gao Parameter 'depth' is still supported in 2.2.1? Tue, 06 Aug, 14:15
Sebastian Nagel   Re: Parameter 'depth' is still supported in 2.2.1? Tue, 06 Aug, 17:05
Rui Gao     Re:Re: Parameter 'depth' is still supported in 2.2.1? Thu, 08 Aug, 02:27
Lewis John Mcgibbney       Re: Re: Parameter 'depth' is still supported in 2.2.1? Thu, 08 Aug, 02:30
Rui Gao         Re:Re: Re: Parameter 'depth' is still supported in 2.2.1? Thu, 08 Aug, 02:34
Lewis John Mcgibbney           Re: Re: Re: Parameter 'depth' is still supported in 2.2.1? Thu, 08 Aug, 02:40
Rui Gao             Re:Re: Re: Re: Parameter 'depth' is still supported in 2.2.1? Thu, 08 Aug, 13:54
Lewis John Mcgibbney file:/// URLS with spaces in path Tue, 06 Aug, 20:58
Lewis John Mcgibbney   Re: file:/// URLS with spaces in path Tue, 06 Aug, 21:59
Bai Shen   Re: file:/// URLS with spaces in path Wed, 07 Aug, 13:22
Lewis John Mcgibbney   Re: file:/// URLS with spaces in path Wed, 07 Aug, 14:51
Markus Jelsma     RE: file:/// URLS with spaces in path Wed, 07 Aug, 14:58
Lewis John Mcgibbney       Re: file:/// URLS with spaces in path Wed, 07 Aug, 15:09
Bai Shen         Re: file:/// URLS with spaces in path Thu, 08 Aug, 12:19
Lewis John Mcgibbney protocol-file org.apache.nutch.protocol.file.FileError: File Error: 404 Wed, 07 Aug, 02:24
Tejas Patil   Re: protocol-file org.apache.nutch.protocol.file.FileError: File Error: 404 Wed, 07 Aug, 04:51
Sebastian Nagel     Re: protocol-file org.apache.nutch.protocol.file.FileError: File Error: 404 Wed, 07 Aug, 07:01
Lewis John Mcgibbney       Re: protocol-file org.apache.nutch.protocol.file.FileError: File Error: 404 Wed, 07 Aug, 17:24
Lewis John Mcgibbney     Re: protocol-file org.apache.nutch.protocol.file.FileError: File Error: 404 Wed, 07 Aug, 17:21
devang pandey nutch relation between depth parameter and segment Wed, 07 Aug, 09:09
Markus Jelsma   RE: nutch relation between depth parameter and segment Wed, 07 Aug, 09:26
Re: Incorrect fetch time
Bai Shen   Re: Incorrect fetch time Wed, 07 Aug, 13:30
Sebastian Nagel     Re: Incorrect fetch time Wed, 07 Aug, 19:59
Bai Shen       Re: Incorrect fetch time Thu, 08 Aug, 12:21
Sebastian Nagel         Re: Incorrect fetch time Thu, 08 Aug, 13:20
Re: 2 day Nutch training course
Julien Nioche   Re: 2 day Nutch training course Wed, 07 Aug, 13:59
Julien Nioche     Re: 2 day Nutch training course Wed, 21 Aug, 11:36
Nicholas Roberts       Re: 2 day Nutch training course Wed, 21 Aug, 15:54
Julien Nioche         Re: 2 day Nutch training course Wed, 21 Aug, 16:09
Joe Zhang Boilerplate removal Wed, 07 Aug, 18:11
Markus Jelsma   RE: Boilerplate removal Wed, 07 Aug, 18:30
Joe Zhang     Re: Boilerplate removal Wed, 07 Aug, 18:44
Markus Jelsma   RE: Boilerplate removal Wed, 07 Aug, 18:55
Re: How to configure nutch to crawl only url in the seed.txt
weishenyun   Re: How to configure nutch to crawl only url in the seed.txt Thu, 08 Aug, 08:21
feng lu     Re: How to configure nutch to crawl only url in the seed.txt Thu, 08 Aug, 16:09
RE: Prevent crawl of parent URL
stone2dbone   RE: Prevent crawl of parent URL Thu, 08 Aug, 13:09
feng lu     Re: Prevent crawl of parent URL Thu, 08 Aug, 16:05
stone2dbone       Re: Prevent crawl of parent URL Mon, 12 Aug, 18:05
stone2dbone         Re: Prevent crawl of parent URL Tue, 13 Aug, 12:13
feng lu           Re: Prevent crawl of parent URL Tue, 13 Aug, 16:08
jefferyyuan How to ask Nutch to get value of extra fields in IndexerJob/IndexerMapper? Thu, 08 Aug, 18:37
Lewis John Mcgibbney   Re: How to ask Nutch to get value of extra fields in IndexerJob/IndexerMapper? Sat, 24 Aug, 04:41
Ralf R. Kotowski Hbase is able to connect to Zookeeper but the connection closes immediatly Fri, 09 Aug, 14:46
Lewis John Mcgibbney   Re: Hbase is able to connect to Zookeeper but the connection closes immediatly Fri, 09 Aug, 15:39
Ralf R. Kotowski     RE: Hbase is able to connect to Zookeeper but the connection closes immediatly Fri, 09 Aug, 17:01
kaveh minooie       Re: Hbase is able to connect to Zookeeper but the connection closes immediatly Mon, 12 Aug, 20:51
Ralf R. Kotowski         RE: Hbase is able to connect to Zookeeper but the connection closes immediatly Tue, 13 Aug, 18:49
kaveh minooie           Re: Hbase is able to connect to Zookeeper but the connection closes immediatly Tue, 13 Aug, 20:52
brian4   Re: Hbase is able to connect to Zookeeper but the connection closes immediatly Tue, 13 Aug, 17:48
kaveh minooie need help with store.CassandraStore Fri, 09 Aug, 22:36
Lewis John Mcgibbney   Re: need help with store.CassandraStore Fri, 09 Aug, 22:51
Arian Azin Nutch crawl configuration Sun, 11 Aug, 07:12
kaveh minooie   Re: Nutch crawl configuration Mon, 12 Aug, 20:24
kaveh minooie   crawlID doesn't work? Mon, 12 Aug, 20:25
Lewis John Mcgibbney     Re: crawlID doesn't work? Tue, 13 Aug, 03:39
kaveh minooie   Re: Nutch crawl configuration Mon, 12 Aug, 20:35
Unable to parse SWF file completely in Nutch 1.x
jagadeesh9.k   Unable to parse SWF file completely in Nutch 1.x Tue, 13 Aug, 13:01
jagadeesh9.k     Re: Unable to parse SWF file completely in Nutch 1.x Tue, 13 Aug, 13:42
jagadeesh9.k   Unable to parse SWF file completely in Nutch 1.x Tue, 13 Aug, 13:52
Re: Not crawling SWF pages using Nutch1.x
jagadeesh9.k   Re: Not crawling SWF pages using Nutch1.x Tue, 13 Aug, 14:03
jagadeesh9.k Unable to crawl flash based webpages(SWF) in Nutch1.x Tue, 13 Aug, 14:19
brian4 SolrIndexerJob connection reset - job failed Tue, 13 Aug, 18:19
Lewis John Mcgibbney   Re: SolrIndexerJob connection reset - job failed Wed, 14 Aug, 04:38
brian4     Re: SolrIndexerJob connection reset - job failed Tue, 20 Aug, 15:14
Ralf R. Kotowski Nutch DMOZ parser Tue, 13 Aug, 18:51
Kzjnet   Re: Nutch DMOZ parser Tue, 13 Aug, 19:02
Ralf R. Kotowski     RE: Nutch DMOZ parser Sat, 17 Aug, 05:43
Nicholas Roberts Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 18:10
Markus Jelsma   RE: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 18:33
Nicholas Roberts     Re: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 19:21
Nicholas Roberts       Re: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 19:44
Markus Jelsma         RE: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 19:48
Nicholas Roberts           Re: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 20:02
Markus Jelsma             RE: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 20:06
Nicholas Roberts               Re: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 20:55
Markus Jelsma   RE: Nutch 1.7 on Hadoop Exception in thread "main" java.lang.ClassNotFoundException: org.apache.nutch.indexer.solr.SolrIndexer Wed, 14 Aug, 19:47
porcelet Nutch doen't crawl all links Thu, 15 Aug, 07:16
Lewis John Mcgibbney   Re: Nutch doen't crawl all links Thu, 15 Aug, 19:03
kaveh minooie     Re: Nutch doen't crawl all links Thu, 15 Aug, 19:10
kaveh minooie       Re: Nutch doen't crawl all links Thu, 15 Aug, 19:20
porcelet     Re: Nutch doen't crawl all links Thu, 15 Aug, 20:53
Os Tyler     RE: Nutch doen't crawl all links Thu, 15 Aug, 21:46
Amit Sela Nucth 1.7 and ElasticSearch Thu, 15 Aug, 09:19
Markus Jelsma   RE: Nucth 1.7 and ElasticSearch Thu, 15 Aug, 09:25
Amit Sela     Re: Nucth 1.7 and ElasticSearch Thu, 15 Aug, 10:54
Markus Jelsma       RE: Nucth 1.7 and ElasticSearch Thu, 15 Aug, 11:02
Amit Sela         Re: Nucth 1.7 and ElasticSearch Sun, 18 Aug, 11:59
Markus Jelsma   RE: Nucth 1.7 and ElasticSearch Sun, 18 Aug, 13:47
Andrew Pennebaker Automating nutch installation Fri, 16 Aug, 13:35
Lewis John Mcgibbney   Re: Automating nutch installation Fri, 16 Aug, 16:06
Andrew Pennebaker     Re: Automating nutch installation Fri, 16 Aug, 16:19
Lewis John Mcgibbney       Re: Automating nutch installation Sun, 18 Aug, 22:50
Nicholas Roberts         Re: Automating nutch installation Mon, 19 Aug, 04:43
Andrew Pennebaker           Re: Automating nutch installation Mon, 19 Aug, 15:54
Nicholas Roberts             Re: Automating nutch installation Mon, 19 Aug, 16:27
Andrew Pennebaker               Re: Automating nutch installation Mon, 19 Aug, 16:37
Andrew Pennebaker                 Re: Automating nutch installation Mon, 19 Aug, 18:11
Lewis John Mcgibbney                   Re: Automating nutch installation Mon, 19 Aug, 19:00
Nicholas Roberts                     Re: Automating nutch installation Mon, 19 Aug, 19:03
Andrew Pennebaker                       Re: Automating nutch installation Mon, 19 Aug, 20:27
S.L Issues Running Nutch 1.7 in Eclipse-- Please Help Mon, 19 Aug, 03:02
Tejas Patil   Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Mon, 19 Aug, 08:07
S.L     Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Mon, 19 Aug, 21:22
Tejas Patil       Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Tue, 20 Aug, 04:44
S.L         Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Tue, 20 Aug, 05:40
Tejas Patil           Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Wed, 21 Aug, 04:04
S.L         Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Wed, 21 Aug, 05:22
Tejas Patil           Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Wed, 21 Aug, 05:28
S.L             Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Wed, 21 Aug, 05:43
S.L               Re: Issues Running Nutch 1.7 in Eclipse-- Please Help Wed, 21 Aug, 23:54
Allan Macmillan Nutch - Dead urls not marked as DB_GONE Mon, 19 Aug, 13:56
Message list1 · 2 · Next »Thread · Author · Date
Box list
Jan 20212
Dec 20202
Oct 20206
Sep 20206
Aug 20207
Jul 202020
Jun 202014
Apr 20207
Mar 20206
Feb 20202
Jan 20205
Dec 201912
Nov 20199
Oct 201946
Sep 201911
Aug 20196
Jul 201919
Jun 20193
May 201910
Apr 201912
Mar 201941
Feb 201920
Jan 20192
Dec 201833
Nov 201841
Oct 201852
Sep 201823
Aug 201830
Jul 201823
Jun 201835
May 201823
Apr 201825
Mar 2018117
Feb 201845
Jan 201825
Dec 201744
Nov 201779
Oct 201744
Sep 201770
Aug 201787
Jul 201752
Jun 201757
May 201776
Apr 201759
Mar 201752
Feb 201736
Jan 201773
Dec 201660
Nov 201678
Oct 2016144
Sep 201672
Aug 201669
Jul 201692
Jun 201696
May 201683
Apr 201677
Mar 201687
Feb 2016137
Jan 2016106
Dec 201579
Nov 201584
Oct 201583
Sep 201590
Aug 201527
Jul 201568
Jun 201572
May 201593
Apr 2015127
Mar 2015137
Feb 2015158
Jan 2015126
Dec 201487
Nov 201473
Oct 201474
Sep 2014177
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167