nutch-user mailing list archives: March 2012

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Re: nutch crawling
Elisabeth Adler   Re: nutch crawling Thu, 01 Mar, 09:51
Frank Scholten Distributed Indexing on MapReduce Thu, 01 Mar, 10:08
Stany Fargose Featured link support in Nutch Thu, 01 Mar, 19:59
Markus Jelsma   Re: Featured link support in Nutch Thu, 01 Mar, 23:59
Stany Fargose     Re: Featured link support in Nutch Fri, 02 Mar, 07:15
Markus Jelsma       Re: Featured link support in Nutch Fri, 02 Mar, 07:45
Re: http.redirect.max
alx...@aim.com   Re: http.redirect.max Thu, 01 Mar, 20:09
Lewis John Mcgibbney     Re: http.redirect.max Fri, 02 Mar, 11:21
Jeremy Villalobos multiple small crawlers on single machine conflict at /tmp/hadoop-username/mapred Thu, 01 Mar, 21:26
Markus Jelsma   Re: multiple small crawlers on single machine conflict at /tmp/hadoop-username/mapred Fri, 02 Mar, 00:01
Jeremy Villalobos     Re: multiple small crawlers on single machine conflict at /tmp/hadoop-username/mapred Fri, 02 Mar, 01:17
remi tassing       Re: multiple small crawlers on single machine conflict at /tmp/hadoop-username/mapred Fri, 02 Mar, 03:57
Jeremy Villalobos         Re: multiple small crawlers on single machine conflict at /tmp/hadoop-username/mapred Fri, 02 Mar, 05:49
Markus Jelsma           Re: multiple small crawlers on single machine conflict at /tmp/hadoop-username/mapred Fri, 02 Mar, 06:33
James Ford Only fetching initial seedlist Thu, 01 Mar, 22:28
remi tassing   Re: Only fetching initial seedlist Fri, 02 Mar, 03:59
Markus Jelsma     Re: Only fetching initial seedlist Fri, 02 Mar, 06:34
James Ford       Re: Only fetching initial seedlist Fri, 02 Mar, 11:52
Lewis John Mcgibbney         Re: Only fetching initial seedlist Fri, 02 Mar, 12:04
James Ford           Re: Only fetching initial seedlist Fri, 02 Mar, 12:07
Lewis John Mcgibbney             Re: Only fetching initial seedlist Fri, 02 Mar, 12:26
Jean-François Gingras   Re: Only fetching initial seedlist Fri, 02 Mar, 13:23
alx...@aim.com different fetch interval for each depth urls Fri, 02 Mar, 05:19
Markus Jelsma   Re: different fetch interval for each depth urls Fri, 02 Mar, 06:36
alx...@aim.com     Re: different fetch interval for each depth urls Fri, 02 Mar, 19:32
Markus Jelsma       Re: different fetch interval for each depth urls Sat, 03 Mar, 12:21
Rafael Pappert Webgraph / getmerge Fri, 02 Mar, 11:31
Jason Trost [Blog Post]: Accumulo and Pig play together now Fri, 02 Mar, 13:48
Bill Graham   Re: [Blog Post]: Accumulo and Pig play together now Fri, 02 Mar, 18:03
varunpandeyengg Nutch with Letor Sat, 03 Mar, 04:36
Lewis John Mcgibbney   Re: Nutch with Letor Fri, 09 Mar, 11:52
varunpandeyengg     Re: Nutch with Letor Fri, 09 Mar, 12:29
Lewis John Mcgibbney       Re: Nutch with Letor Fri, 09 Mar, 12:54
varunpandeyengg         Re: Nutch with Letor Fri, 09 Mar, 13:35
Lewis John Mcgibbney           Re: Nutch with Letor Fri, 09 Mar, 14:58
varunpandeyengg             Re: Nutch with Letor Fri, 09 Mar, 15:44
Lewis John Mcgibbney               Re: Nutch with Letor Fri, 09 Mar, 16:02
Dean Pullen   Nutch 1.4 with Hadoop - how does Nutch know where Hadoop is running Tue, 20 Mar, 10:51
Markus Jelsma     Re: Nutch 1.4 with Hadoop - how does Nutch know where Hadoop is running Tue, 20 Mar, 11:03
Dean Pullen       Re: Nutch 1.4 with Hadoop - how does Nutch know where Hadoop is running Tue, 20 Mar, 10:59
Markus Jelsma         Re: Nutch 1.4 with Hadoop - how does Nutch know where Hadoop is running Tue, 20 Mar, 11:10
shlomi java       Re: Nutch 1.4 with Hadoop - how does Nutch know where Hadoop is running Tue, 20 Mar, 11:02
dafna Incompatible format version 2 expected 1 or lower Sat, 03 Mar, 18:30
Markus Jelsma   Re: Incompatible format version 2 expected 1 or lower Sun, 04 Mar, 10:30
dafna     Re: Incompatible format version 2 expected 1 or lower Sun, 04 Mar, 20:22
Haya AL-Tuwaijri Solrindex job failed ! Sun, 04 Mar, 06:18
shlomi java   Re: Solrindex job failed ! Sun, 04 Mar, 07:07
HaYa aziz   RE: Solrindex job failed ! Sun, 04 Mar, 10:23
hadi java.net.UnknownHostException during fetching Sun, 04 Mar, 12:19
remi tassing   Re: java.net.UnknownHostException during fetching Sun, 04 Mar, 16:43
hadi     Re: java.net.UnknownHostException during fetching Sun, 04 Mar, 18:49
remi tassing       Re: java.net.UnknownHostException during fetching Sun, 04 Mar, 19:05
hadi         Re: java.net.UnknownHostException during fetching Mon, 05 Mar, 06:50
alessio crisantemi nutch craling file system Sun, 04 Mar, 16:02
remi tassing   Re: nutch craling file system Sun, 04 Mar, 16:06
alessio crisantemi     Re: nutch craling file system Sun, 04 Mar, 17:05
remi tassing       Re: nutch craling file system Sun, 04 Mar, 17:09
Markus Jelsma       Re: nutch craling file system Sun, 04 Mar, 17:51
alessio crisantemi     Re: nutch craling file system Tue, 06 Mar, 23:02
Markus Jelsma Fwd: Re: java.net.UnknownHostException during fetching Sun, 04 Mar, 17:50
Dayal Java Script Crawling using nutch Tue, 06 Mar, 17:10
Ferdy Galema   Re: Java Script Crawling using nutch Wed, 07 Mar, 08:51
webdev1977 Optimizing crawling for small number of domains/sites (aka. intranet crawling) Tue, 06 Mar, 20:03
Ferdy Galema   Re: Optimizing crawling for small number of domains/sites (aka. intranet crawling) Wed, 07 Mar, 08:44
webdev1977     Re: Optimizing crawling for small number of domains/sites (aka. intranet crawling) Mon, 12 Mar, 11:38
nutch.bu...@gmail.com Multiple parsers Wed, 07 Mar, 13:34
Ferdy Galema   Re: Multiple parsers Wed, 07 Mar, 21:14
nutch buddy     Re: Multiple parsers Thu, 08 Mar, 07:29
Julien Nioche       Re: Multiple parsers Thu, 08 Mar, 09:34
Julien Nioche     Re: Multiple parsers Thu, 08 Mar, 09:33
Ferdy Galema       Re: Multiple parsers Thu, 08 Mar, 20:29
Christopher Gross Crawling with Certs Wed, 07 Mar, 20:22
remi tassing   Re: Crawling with Certs Wed, 07 Mar, 20:40
Christopher Gross     Re: Crawling with Certs Wed, 07 Mar, 20:48
remi tassing       Re: Crawling with Certs Wed, 07 Mar, 21:14
Christopher Gross         Re: Crawling with Certs Wed, 07 Mar, 21:22
Christopher Gross           Re: Crawling with Certs Wed, 07 Mar, 21:28
Lewis John Mcgibbney             Re: Crawling with Certs Thu, 08 Mar, 10:59
Christopher Gross               Re: Crawling with Certs Thu, 08 Mar, 13:16
Christopher Gross                 Re: Crawling with Certs Thu, 08 Mar, 14:28
Daniel Rosher NutchGora continuous indexing Thu, 08 Mar, 10:33
Mathijs Homminga   Re: NutchGora continuous indexing Thu, 08 Mar, 14:57
Piet van Remortel Nutch as crawler for text analysis: setup ? version ? Fri, 09 Mar, 15:19
Markus Jelsma   Re: Nutch as crawler for text analysis: setup ? version ? Fri, 09 Mar, 15:33
Mathijs Homminga   Re: Nutch as crawler for text analysis: setup ? version ? Fri, 09 Mar, 18:59
alessio crisantemi Re: nutch crawling file system SOLVED Sat, 10 Mar, 16:42
Lewis John Mcgibbney   Re: nutch crawling file system SOLVED Sun, 11 Mar, 16:59
alessio crisantemi     Re: nutch crawling file system SOLVED Sun, 11 Mar, 17:10
Lewis John Mcgibbney       Re: nutch crawling file system SOLVED Sun, 11 Mar, 17:32
alessio crisantemi         Re: nutch crawling file system SOLVED Sun, 11 Mar, 22:51
remi tassing           Re: nutch crawling file system SOLVED Mon, 12 Mar, 05:06
alessio crisantemi             Re: nutch crawling file system SOLVED Mon, 12 Mar, 08:39
alessio crisantemi               Re: nutch crawling file system SOLVED Sat, 17 Mar, 17:31
Lewis John Mcgibbney                 Re: nutch crawling file system SOLVED Sat, 17 Mar, 20:11
alessio crisantemi                   Re: nutch crawling file system SOLVED Sat, 17 Mar, 20:32
alessio crisantemi                     Re: nutch crawling file system SOLVED Sat, 17 Mar, 21:40
alessio crisantemi                   Re: nutch crawling file system SOLVED Sun, 18 Mar, 12:06
remi tassing       Re: nutch crawling file system SOLVED Sun, 11 Mar, 17:37
nutch.bu...@gmail.com crawling with -1 as fetch.interval causes all pages to be refetched at same running instance Sun, 11 Mar, 18:53
Re: Exception in thread "main" java.io.IOException: Job failed!
Pantelis   Re: Exception in thread "main" java.io.IOException: Job failed! Mon, 12 Mar, 12:32
Pantelis     Re: Exception in thread "main" java.io.IOException: Job failed! Tue, 13 Mar, 09:30
webdev1977 Hostnames changed for lots of URLS in crawldb, solr index, how to change? Mon, 12 Mar, 13:32
Markus Jelsma   Re: Hostnames changed for lots of URLS in crawldb, solr index, how to change? Mon, 12 Mar, 13:55
HaYa aziz split content field into two fields Tue, 13 Mar, 11:13
Lewis John Mcgibbney   Re: split content field into two fields Tue, 13 Mar, 14:09
kingping unable to crwal a specefic site- Lithium Based Tue, 13 Mar, 12:47
Lewis John Mcgibbney   Re: unable to crwal a specefic site- Lithium Based Tue, 13 Mar, 14:08
kingping     Re: unable to crwal a specefic site- Lithium Based Tue, 13 Mar, 17:02
Jean-François Gingras       Re: unable to crwal a specefic site- Lithium Based Tue, 13 Mar, 22:35
Magnús Skúlason Configuring nutch to run on hadoop Wed, 14 Mar, 10:38
Ferdy Galema   Re: Configuring nutch to run on hadoop Thu, 15 Mar, 07:35
Ferdy Galema     Re: Configuring nutch to run on hadoop Thu, 15 Mar, 07:36
Rafael Pappert       Re: Configuring nutch to run on hadoop Thu, 15 Mar, 10:01
Rafael Pappert         Re: Configuring nutch to run on hadoop Thu, 15 Mar, 10:05
Magnús Skúlason           Re: Configuring nutch to run on hadoop Mon, 19 Mar, 10:08
Mohammad Tambe Order of loading plugins Wed, 14 Mar, 12:50
Lewis John Mcgibbney   Re: Order of loading plugins Fri, 16 Mar, 14:25
Mohammad Tambe     RE: Order of loading plugins Mon, 19 Mar, 08:28
Rafael Pappert Blacklisted Tasktracker / AlreadyBeingCreatedException Fri, 16 Mar, 13:46
Mathijs Homminga   Re: Blacklisted Tasktracker / AlreadyBeingCreatedException Fri, 16 Mar, 14:10
Markus Jelsma   Re: Blacklisted Tasktracker / AlreadyBeingCreatedException Fri, 16 Mar, 14:13
Rafael Pappert     Re: Blacklisted Tasktracker / AlreadyBeingCreatedException Mon, 19 Mar, 09:26
Lewis John Mcgibbney       Re: Blacklisted Tasktracker / AlreadyBeingCreatedException Mon, 19 Mar, 12:53
Rafael Pappert         Re: Blacklisted Tasktracker / AlreadyBeingCreatedException Mon, 19 Mar, 18:22
Sudip Datta Running CrawlDbReader: _SUCCESS/data does not exist Fri, 16 Mar, 19:46
Adriana Farina   Re: Running CrawlDbReader: _SUCCESS/data does not exist Fri, 16 Mar, 20:00
Sudip Datta     Re: Running CrawlDbReader: _SUCCESS/data does not exist Fri, 16 Mar, 20:08
Adriana Farina       Re: Running CrawlDbReader: _SUCCESS/data does not exist Fri, 16 Mar, 20:29
Lewis John Mcgibbney         Re: Running CrawlDbReader: _SUCCESS/data does not exist Fri, 16 Mar, 23:22
George Fetching/Indexing process is taking a lot of time Sat, 17 Mar, 06:40
Mathijs Homminga   Re: Fetching/Indexing process is taking a lot of time Sat, 17 Mar, 18:26
George     Re: Fetching/Indexing process is taking a lot of time Sat, 17 Mar, 19:59
Mathijs Homminga       Re: Fetching/Indexing process is taking a lot of time Sun, 18 Mar, 12:59
George         Re: Fetching/Indexing process is taking a lot of time Mon, 19 Mar, 02:20
Mathijs Homminga           Re: Fetching/Indexing process is taking a lot of time Mon, 19 Mar, 09:02
George             Re: Fetching/Indexing process is taking a lot of time Tue, 20 Mar, 04:07
Mathijs Homminga           Re: Fetching/Indexing process is taking a lot of time Tue, 27 Mar, 08:57
George             Re: Fetching/Indexing process is taking a lot of time Tue, 27 Mar, 10:20
Re: Meta Tags
blunderboy   Re: Meta Tags Mon, 19 Mar, 11:23
Lewis John Mcgibbney     Re: Meta Tags Mon, 19 Mar, 12:48
blunderboy       Re: Meta Tags Tue, 20 Mar, 06:30
Lewis John Mcgibbney         Re: Meta Tags Tue, 20 Mar, 22:21
blunderboy           Re: Meta Tags Wed, 21 Mar, 11:04
Lewis John Mcgibbney             Re: Meta Tags Wed, 21 Mar, 13:41
Lewis John Mcgibbney NutchHadoopTutorial Updated Mon, 19 Mar, 15:19
Chris A Mattmann   Re: NutchHadoopTutorial Updated Mon, 19 Mar, 23:17
Mathijs Homminga   Re: NutchHadoopTutorial Updated Tue, 20 Mar, 13:23
Markus Jelsma     Re: NutchHadoopTutorial Updated Tue, 20 Mar, 13:32
Mathijs Homminga       Re: NutchHadoopTutorial Updated Tue, 20 Mar, 13:38
Lewis John Mcgibbney         Re: NutchHadoopTutorial Updated Tue, 20 Mar, 13:45
Julien Nioche           Re: NutchHadoopTutorial Updated Tue, 20 Mar, 14:19
Julien Nioche             Re: NutchHadoopTutorial Updated Tue, 20 Mar, 14:20
Lewis John Mcgibbney           Re: NutchHadoopTutorial Updated Tue, 20 Mar, 14:46
alessio crisantemi crawling sile system Mon, 19 Mar, 19:41
Sebastian Nagel   Re: crawling sile system Mon, 19 Mar, 20:32
blunderboy Job failed while creating SolrIndex Tue, 20 Mar, 10:56
Markus Jelsma   Re: Job failed while creating SolrIndex Tue, 20 Mar, 11:07
Re: urls won't get crawled
jepse   Re: urls won't get crawled Tue, 20 Mar, 11:41
Markus Jelsma     Re: urls won't get crawled Tue, 20 Mar, 12:06
jepse       Re: urls won't get crawled Tue, 20 Mar, 12:18
Markus Jelsma         Re: urls won't get crawled Tue, 20 Mar, 12:28
jepse           Re: urls won't get crawled Tue, 20 Mar, 12:35
Andy Xue Too much logging Wed, 21 Mar, 08:00
Markus Jelsma   Re: Too much logging Thu, 22 Mar, 11:00
Milica Bogicevic Nutch on Elastic Map Reduce Wed, 21 Mar, 15:46
James Ford Generator taking time Thu, 22 Mar, 10:48
Markus Jelsma   Re: Generator taking time Thu, 22 Mar, 11:02
James Ford     Re: Generator taking time Thu, 22 Mar, 11:18
Markus Jelsma       Re: Generator taking time Thu, 22 Mar, 11:35
Greg Fields         Re: Generator taking time Fri, 23 Mar, 10:24
Message list1 · 2 · Next »Thread · Author · Date
Box list
Sep 201662
Aug 201669
Jul 201692
Jun 201696
May 201683
Apr 201677
Mar 201687
Feb 2016137
Jan 2016106
Dec 201579
Nov 201584
Oct 201583
Sep 201590
Aug 201527
Jul 201568
Jun 201572
May 201593
Apr 2015127
Mar 2015137
Feb 2015158
Jan 2015126
Dec 201487
Nov 201473
Oct 201474
Sep 2014177
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167