nutch-user mailing list archives: February 2011

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Re: nutch crawl command takes 98% of cpu
Kirby Bohling   Re: nutch crawl command takes 98% of cpu Tue, 01 Feb, 00:39
Andrzej Bialecki     Re: nutch crawl command takes 98% of cpu Tue, 01 Feb, 11:39
Ken Krugler     Re: nutch crawl command takes 98% of cpu Mon, 07 Feb, 20:00
Alexis       Re: nutch crawl command takes 98% of cpu Tue, 08 Feb, 17:58
Arkadi.Kosmy...@csiro.au   RE: Restarting Tomcat after a crawl. Wed, 02 Feb, 00:10
Re: Index while crawling
.: Abhishek :.   Re: Index while crawling Tue, 01 Feb, 01:35
Markus Jelsma     Re: Index while crawling Tue, 01 Feb, 10:25
.: Abhishek :.       Re: Index while crawling Wed, 09 Feb, 08:15
Tim Pease document boost of "Infinity" Tue, 01 Feb, 04:09
.: Abhishek :. Implementing a negative keyword filter in index Tue, 01 Feb, 04:10
.: Abhishek :.   Re: Implementing a negative keyword filter in index Tue, 01 Feb, 08:07
.: Abhishek :.     Re: Implementing a negative keyword filter in index Wed, 02 Feb, 01:03
Markus Jelsma     Re: Implementing a negative keyword filter in index Wed, 02 Feb, 01:57
Amna Waqar help:Nutch segment architecture Tue, 01 Feb, 05:08
Amna Waqar Help : Nutch indexing mechanism Tue, 01 Feb, 09:48
a a   RE: Help : Nutch indexing mechanism Tue, 01 Feb, 14:15
RE: parse-html plugin
a a   RE: parse-html plugin Tue, 01 Feb, 14:25
Markus Jelsma     Re: parse-html plugin Tue, 01 Feb, 17:28
Markus Jelsma     Re: parse-html plugin Tue, 01 Feb, 17:42
a a       RE: parse-html plugin Tue, 01 Feb, 17:54
Markus Jelsma         Re: parse-html plugin Tue, 01 Feb, 18:04
.: Abhishek :.           Re: parse-html plugin Wed, 02 Feb, 01:28
Markus Jelsma             Re: parse-html plugin Wed, 02 Feb, 01:44
.: Abhishek :.             Re: parse-html plugin Wed, 02 Feb, 01:45
Markus Jelsma               Re: parse-html plugin Wed, 02 Feb, 01:46
a a                 RE: parse-html plugin Wed, 02 Feb, 03:28
.: Abhishek :.                   Re: parse-html plugin Wed, 02 Feb, 05:31
a a                     RE: parse-html plugin Wed, 02 Feb, 21:05
Markus Jelsma                       Re: parse-html plugin Wed, 02 Feb, 21:10
webdev1977 NUTCH-844 back port to 1.2?? Tue, 01 Feb, 14:31
Mike Baranczak CrawlDatum.getFetchTime() Tue, 01 Feb, 22:15
Markus Jelsma   Re: CrawlDatum.getFetchTime() Tue, 01 Feb, 23:08
Markus Jelsma     Re: CrawlDatum.getFetchTime() Tue, 01 Feb, 23:35
.: Abhishek :. Custom HtmlParseFilter configurations Wed, 02 Feb, 02:49
Mike Baranczak   Re: Custom HtmlParseFilter configurations Wed, 02 Feb, 03:29
.: Abhishek :.     Re: Custom HtmlParseFilter configurations Wed, 02 Feb, 05:09
Mike Baranczak       Re: Custom HtmlParseFilter configurations Wed, 02 Feb, 16:07
.: Abhishek :.         Re: Custom HtmlParseFilter configurations Fri, 04 Feb, 01:36
.: Abhishek :. When does parsing and application of parsing filter happen? Wed, 02 Feb, 05:48
Markus Jelsma   Re: When does parsing and application of parsing filter happen? Wed, 02 Feb, 10:08
.: Abhishek :.     Re: When does parsing and application of parsing filter happen? Wed, 02 Feb, 10:53
Arjun Kumar Reddy How to speed up nutch crawling! Wed, 02 Feb, 07:52
McGibbney, Lewis John   RE: How to speed up nutch crawling! Wed, 02 Feb, 12:39
Adam Estrada     Re: How to speed up nutch crawling! Wed, 02 Feb, 15:21
Amna Waqar help with reading segment Wed, 02 Feb, 08:04
Markus Jelsma   Re: help with reading segment Wed, 02 Feb, 10:05
Amna Waqar help with readseg Wed, 02 Feb, 11:46
Arjun Kumar Reddy   Re: help with readseg Wed, 02 Feb, 12:01
Amna Waqar     Re: help with readseg Wed, 02 Feb, 12:19
Amna Waqar       Re: help with readseg Wed, 02 Feb, 12:27
David Saile ScoringFilter always increasing a fetched site's score Wed, 02 Feb, 12:18
Tim Pease   Re: ScoringFilter always increasing a fetched site's score Wed, 02 Feb, 16:04
David Saile     Re: ScoringFilter always increasing a fetched site's score Thu, 03 Feb, 12:40
Julien Nioche       Re: ScoringFilter always increasing a fetched site's score Thu, 03 Feb, 13:10
David Saile         Re: ScoringFilter always increasing a fetched site's score Fri, 04 Feb, 15:03
David Saile           Fwd: ScoringFilter always increasing a fetched site's score Mon, 07 Feb, 07:02
Joshua J Pavel Enabling logging breaks parsing? Wed, 02 Feb, 15:42
axierr Nutch 1.2 performance and memory issues Wed, 02 Feb, 17:51
Julien Nioche   Re: Nutch 1.2 performance and memory issues Wed, 02 Feb, 20:50
axierr     Re: Nutch 1.2 performance and memory issues Wed, 02 Feb, 21:04
axierr       Re: Nutch 1.2 performance and memory issues Thu, 03 Feb, 00:28
Julien Nioche         Re: Nutch 1.2 performance and memory issues Thu, 03 Feb, 13:05
axierr           Re: Nutch 1.2 performance and memory issues Thu, 03 Feb, 18:38
Julien Nioche             Re: Nutch 1.2 performance and memory issues Fri, 04 Feb, 11:06
axierr               Re: Nutch 1.2 performance and memory issues Sat, 05 Feb, 19:24
Julien Nioche       Re: Nutch 1.2 performance and memory issues Thu, 03 Feb, 12:59
axierr         Re: Nutch 1.2 performance and memory issues Thu, 03 Feb, 17:56
axierr           Re: Nutch 1.2 performance and memory issues Thu, 03 Feb, 19:53
Andrey Sapegin Nutch 1.2 fetcher aborting with N hung threads Thu, 03 Feb, 08:56
rishi pathak Upgrade to hadoop-0.21.0 Thu, 03 Feb, 14:06
rishi pathak   Re: Upgrade to hadoop-0.21.0 Fri, 04 Feb, 09:07
Patricio Galeas     move from a single node to 4 node structure Sun, 06 Feb, 16:32
.: Abhishek :. Crawling and re-crawling huge sites Fri, 04 Feb, 01:42
.: Abhishek :.   Re: Crawling and re-crawling huge sites Fri, 04 Feb, 14:02
Amine BENHAMZA     Re: Crawling and re-crawling huge sites Fri, 04 Feb, 14:32
Charan K       Re: Crawling and re-crawling huge sites Fri, 04 Feb, 21:17
.: Abhishek :.         Re: Crawling and re-crawling huge sites Sat, 05 Feb, 03:52
AW: Problems bu upgrading Nutch-1.0 -> Nutch-1.2
Patricio Galeas   AW: Problems bu upgrading Nutch-1.0 -> Nutch-1.2 Sun, 06 Feb, 13:47
.: Abhishek :. Standalone GUI tool for Nutch crawl scheduling Mon, 07 Feb, 01:16
.: Abhishek :. Indexing question - Setting low boost Mon, 07 Feb, 01:27
Markus Jelsma   Re: Indexing question - Setting low boost Mon, 07 Feb, 01:34
.: Abhishek :.     Re: Indexing question - Setting low boost Mon, 07 Feb, 02:01
Markus Jelsma       Re: Indexing question - Setting low boost Mon, 07 Feb, 02:07
.: Abhishek :.         Re: Indexing question - Setting low boost Mon, 07 Feb, 02:46
.: Abhishek :.           Re: Indexing question - Setting low boost Tue, 08 Feb, 00:44
Arkadi.Kosmy...@csiro.au             RE: Indexing question - Setting low boost Tue, 08 Feb, 00:48
.: Abhishek :.               Re: Indexing question - Setting low boost Tue, 08 Feb, 01:23
.: Abhishek :.                 Re: Indexing question - Setting low boost Tue, 08 Feb, 02:18
Amin Bandeali I would like to subscribe Mon, 07 Feb, 02:17
Amin Bandeali Installing Nutch Mon, 07 Feb, 02:34
Paul Tomblin   Re: Installing Nutch Mon, 21 Feb, 19:44
Alexander Aristov     Re: Installing Nutch Tue, 22 Feb, 08:29
Paul Tomblin       Re: Installing Nutch Wed, 23 Feb, 14:04
Alexander Aristov         Re: Installing Nutch Thu, 24 Feb, 09:45
Re: Performance Configuration on Focused Web Crawl
Ken Krugler   Re: Performance Configuration on Focused Web Crawl Mon, 07 Feb, 21:32
Joshua J Pavel Nutch not respecting a NOINDEX,FOLLOW tag Mon, 07 Feb, 21:41
Julien Nioche   Re: Nutch not respecting a NOINDEX,FOLLOW tag Tue, 08 Feb, 10:14
.: Abhishek :.     Re: Nutch not respecting a NOINDEX,FOLLOW tag Wed, 09 Feb, 01:04
Joshua J Pavel       Re: Nutch not respecting a NOINDEX,FOLLOW tag Wed, 09 Feb, 14:34
.: Abhishek :. Nutch in Windows Tue, 08 Feb, 05:52
.: Abhishek :.   Re: Nutch in Windows Tue, 08 Feb, 06:23
Amna Waqar searching mechanism and vector in index Tue, 08 Feb, 08:49
Markus Jelsma   Re: searching mechanism and vector in index Mon, 14 Feb, 22:56
Marco Didonna Distributed Indexing with nutch Tue, 08 Feb, 10:06
Julien Nioche   Re: Distributed Indexing with nutch Tue, 08 Feb, 10:23
Claudio Martella     Re: Distributed Indexing with nutch Tue, 08 Feb, 10:46
Marco Didonna       Re: Distributed Indexing with nutch Tue, 08 Feb, 11:35
Claudio Martella         Re: Distributed Indexing with nutch Tue, 08 Feb, 11:48
Marco Didonna           Re: Distributed Indexing with nutch Tue, 08 Feb, 12:07
Marco Didonna     Re: Distributed Indexing with nutch Tue, 08 Feb, 11:45
Julien Nioche       Re: Distributed Indexing with nutch Tue, 08 Feb, 12:26
.: Abhishek :. Running crawls between a specified time interval Wed, 09 Feb, 01:17
Markus Jelsma   Re: Running crawls between a specified time interval Thu, 10 Feb, 11:01
Sonal Goyal     Re: Running crawls between a specified time interval Thu, 10 Feb, 11:22
Alexander Aristov   Re: Running crawls between a specified time interval Thu, 10 Feb, 14:11
.: Abishek :.     Re: Running crawls between a specified time interval Thu, 10 Feb, 14:27
Markus Jelsma       Re: Running crawls between a specified time interval Thu, 10 Feb, 14:29
.: Abishek :.         Re: Running crawls between a specified time interval Fri, 11 Feb, 04:23
Amna Waqar Urgent help: Deleting the fetched pages in segment Wed, 09 Feb, 10:31
.: Abhishek :.   Re: Urgent help: Deleting the fetched pages in segment Wed, 09 Feb, 13:56
Wenhao Xu How to use Nutch index files on localdisk? Wed, 09 Feb, 18:19
Markus Jelsma   Re: How to use Nutch index files on localdisk? Thu, 10 Feb, 10:59
Wenhao Xu     Re: How to use Nutch index files on localdisk? Sun, 13 Feb, 00:01
McGibbney, Lewis John Index with Solr to my own webapp Wed, 09 Feb, 23:36
Markus Jelsma   Re: Index with Solr to my own webapp Thu, 10 Feb, 10:58
McGibbney, Lewis John   RE: Index with Solr to my own webapp Thu, 10 Feb, 13:31
Markus Jelsma     Re: Index with Solr to my own webapp Thu, 10 Feb, 13:34
.: Abishek :. -solr parameter in Crawl Thu, 10 Feb, 03:18
McGibbney, Lewis John   RE: -solr parameter in Crawl Thu, 10 Feb, 10:27
Estrada Groups     Re: -solr parameter in Crawl Thu, 10 Feb, 13:49
.: Abishek :.       Re: -solr parameter in Crawl Thu, 10 Feb, 14:28
.: Abishek :. Decoupling crawling and indexing Thu, 10 Feb, 07:23
.: Abishek :. Meaning of -noParsing keyword in Fetcher Thu, 10 Feb, 10:30
Markus Jelsma   Re: Meaning of -noParsing keyword in Fetcher Thu, 10 Feb, 10:54
firespin Can nutch index webpages based on footprints, or do I need a plugin? Thu, 10 Feb, 11:04
Sonal Goyal   Re: Can nutch index webpages based on footprints, or do I need a plugin? Thu, 10 Feb, 17:31
Adam Estrada Stupid Question Fri, 11 Feb, 03:00
Mattmann, Chris A (388J)   Re: Stupid Question Sat, 12 Feb, 02:38
Estrada Groups     Re: Stupid Question Sat, 12 Feb, 15:31
Gora Mohanty       Re: Stupid Question Sat, 12 Feb, 16:08
.: Abishek :. Approx time for fetching, parsing and indexing a page Fri, 11 Feb, 04:05
.: Abishek :.   Re: Approx time for fetching, parsing and indexing a page Fri, 11 Feb, 08:03
Message list1 · 2 · Next »Thread · Author · Date
Box list
Jan 20213
Dec 20202
Oct 20206
Sep 20206
Aug 20207
Jul 202020
Jun 202014
Apr 20207
Mar 20206
Feb 20202
Jan 20205
Dec 201912
Nov 20199
Oct 201946
Sep 201911
Aug 20196
Jul 201919
Jun 20193
May 201910
Apr 201912
Mar 201941
Feb 201920
Jan 20192
Dec 201833
Nov 201841
Oct 201852
Sep 201823
Aug 201830
Jul 201823
Jun 201835
May 201823
Apr 201825
Mar 2018117
Feb 201845
Jan 201825
Dec 201744
Nov 201779
Oct 201744
Sep 201770
Aug 201787
Jul 201752
Jun 201757
May 201776
Apr 201759
Mar 201752
Feb 201736
Jan 201773
Dec 201660
Nov 201678
Oct 2016144
Sep 201672
Aug 201669
Jul 201692
Jun 201696
May 201683
Apr 201677
Mar 201687
Feb 2016137
Jan 2016106
Dec 201579
Nov 201584
Oct 201583
Sep 201590
Aug 201527
Jul 201568
Jun 201572
May 201593
Apr 2015127
Mar 2015137
Feb 2015158
Jan 2015126
Dec 201487
Nov 201473
Oct 201474
Sep 2014177
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167