nutch-user mailing list archives: November 2012

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Dr. Thomas Zastrow Information about compiling? Thu, 01 Nov, 09:40
Markus Jelsma   RE: Information about compiling? Thu, 01 Nov, 09:54
Sebastian Nagel     Re: Information about compiling? Thu, 01 Nov, 10:45
Re: Working with Twitter
dan   Re: Working with Twitter Thu, 01 Nov, 10:00
Lewis John Mcgibbney     Re: Working with Twitter Thu, 01 Nov, 10:32
Julien Nioche infoQ article Apache Nutch 2 Features and Product Roadmap Thu, 01 Nov, 11:39
Lewis John Mcgibbney   Re: [crawler-common] infoQ article Apache Nutch 2 Features and Product Roadmap Thu, 01 Nov, 17:25
Markus Jelsma     RE: [crawler-common] infoQ article Apache Nutch 2 Features and Product Roadmap Thu, 01 Nov, 17:34
Re: please how to parse image documents with multiple parser ?
Julien Nioche   Re: please how to parse image documents with multiple parser ? Thu, 01 Nov, 12:39
Eyeris Rodriguez Rueda     RE: please how to parse image documents with multiple parser ? Thu, 01 Nov, 16:48
Jorge Luis Betancourt Gonzalez     Re: please how to parse image documents with multiple parser ? Mon, 05 Nov, 18:47
Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails
kiran chitturi   Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails Thu, 01 Nov, 13:48
Julien Nioche     Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails Thu, 01 Nov, 14:15
kiran chitturi       Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails Thu, 01 Nov, 16:28
alx...@aim.com         Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails Thu, 01 Nov, 17:49
kiran chitturi           Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails Mon, 05 Nov, 14:50
Lewis John Mcgibbney             Re: bin/nutch parsechecker -dumpText works but bin/nutch parse fails Mon, 05 Nov, 14:58
Jason Stubblefield "Error in configuring object" when indexing with solr Thu, 01 Nov, 14:00
Julien Nioche   Re: "Error in configuring object" when indexing with solr Thu, 01 Nov, 14:22
Re: error at parse command in Nutch 2.x : java.sql.BatchUpdateException: data exception: string data, right truncation
Lewis John Mcgibbney   Re: error at parse command in Nutch 2.x : java.sql.BatchUpdateException: data exception: string data, right truncation Thu, 01 Nov, 17:16
kiran chitturi     Re: error at parse command in Nutch 2.x : java.sql.BatchUpdateException: data exception: string data, right truncation Thu, 01 Nov, 17:52
kiran chitturi nutch 2.x and hbas Thu, 01 Nov, 21:59
Lewis John Mcgibbney   Re: nutch 2.x and hbas Fri, 02 Nov, 19:18
cocofan Getting a NullPointerException in Nutch 2.1 Fri, 02 Nov, 03:17
kiran chitturi   Re: Getting a NullPointerException in Nutch 2.1 Fri, 02 Nov, 14:43
cocofan     Re: Getting a NullPointerException in Nutch 2.1 Fri, 02 Nov, 17:36
Lewis John Mcgibbney       Re: Getting a NullPointerException in Nutch 2.1 Fri, 02 Nov, 19:45
cocofan         Re: Getting a NullPointerException in Nutch 2.1 Fri, 02 Nov, 20:13
Nicholas Roberts           Re: Getting a NullPointerException in Nutch 2.1 Thu, 29 Nov, 00:18
Nicholas Roberts             Re: Getting a NullPointerException in Nutch 2.1 Thu, 29 Nov, 00:35
Nicholas Roberts               Re: Getting a NullPointerException in Nutch 2.1 Thu, 29 Nov, 00:40
j.sulli...@thomsonreuters.com         RE: Getting a NullPointerException in Nutch 2.1 Thu, 29 Nov, 06:14
Lewis John Mcgibbney     Re: Getting a NullPointerException in Nutch 2.1 Fri, 02 Nov, 19:41
Joe Zhang URL filtering: crawling time vs. indexing time Fri, 02 Nov, 08:58
Markus Jelsma   RE: URL filtering: crawling time vs. indexing time Fri, 02 Nov, 13:21
Joe Zhang     Re: URL filtering: crawling time vs. indexing time Fri, 02 Nov, 16:22
Rémy Amouroux       Re: URL filtering: crawling time vs. indexing time Fri, 02 Nov, 16:29
Joe Zhang         Re: URL filtering: crawling time vs. indexing time Fri, 02 Nov, 16:50
Markus Jelsma           RE: URL filtering: crawling time vs. indexing time Fri, 02 Nov, 16:57
Markus Jelsma           RE: URL filtering: crawling time vs. indexing time Fri, 02 Nov, 18:37
Joe Zhang             Re: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 05:02
Markus Jelsma               RE: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 09:15
Lewis John Mcgibbney                 Re: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 11:38
Joe Zhang                   Re: URL filtering: crawling time vs. indexing time Mon, 05 Nov, 01:39
Joe Zhang                     Re: URL filtering: crawling time vs. indexing time Sat, 17 Nov, 22:32
Jason Trost Large-scale web analytics with Accumulo (and Nutch/Gora, Pig, and Storm) Sat, 03 Nov, 01:43
Julien Nioche   Re: Large-scale web analytics with Accumulo (and Nutch/Gora, Pig, and Storm) Sat, 03 Nov, 09:51
Joe Zhang URGENT: URL filtering: crawling time vs. indexing time Sat, 03 Nov, 03:57
Stefan Scheffler   Re: URGENT: URL filtering: crawling time vs. indexing time Sat, 03 Nov, 05:36
Lewis John Mcgibbney   Re: URGENT: URL filtering: crawling time vs. indexing time Sat, 03 Nov, 11:16
Joe Zhang     Re: URGENT: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 01:50
Joe Zhang     Re: URGENT: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 06:10
Lewis John Mcgibbney       Re: URGENT: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 11:53
Joe Zhang         Re: URGENT: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 18:10
Lewis John Mcgibbney           Re: URGENT: URL filtering: crawling time vs. indexing time Sun, 04 Nov, 21:07
Joe Zhang             Re: URGENT: URL filtering: crawling time vs. indexing time Mon, 05 Nov, 01:19
Joe Zhang               Re: URGENT: URL filtering: crawling time vs. indexing time Sat, 17 Nov, 22:30
Joe Zhang timestamp in nutch schema Sun, 04 Nov, 04:38
Markus Jelsma   RE: timestamp in nutch schema Sun, 04 Nov, 09:27
Johannes Dorn Is Nutch 1.5.1/2.1 the right tool for me? Tue, 06 Nov, 08:42
Lewis John Mcgibbney   Re: Is Nutch 1.5.1/2.1 the right tool for me? Tue, 06 Nov, 09:05
Johannes Dorn     Re: Is Nutch 1.5.1/2.1 the right tool for me? Tue, 06 Nov, 09:14
Lewis John Mcgibbney Call to Arms Use Gora 0.3-SNAPSHOT dependencies in 2.x HEAD Tue, 06 Nov, 10:09
Joshua Jiang Crawl Jira using nutch Tue, 06 Nov, 16:14
kiran chitturi Nutch html parse error (java.io.IOException: Pushback buffer overflow ) Tue, 06 Nov, 23:16
Lewis John Mcgibbney   Re: Nutch html parse error (java.io.IOException: Pushback buffer overflow ) Thu, 08 Nov, 13:00
Sivasankari Configure non proxy host in nutch Thu, 08 Nov, 05:47
j.sulli...@thomsonreuters.com Tika Parsing not working in the latest version of 2.X? Thu, 08 Nov, 06:17
Markus Jelsma   RE: Tika Parsing not working in the latest version of 2.X? Thu, 08 Nov, 09:38
j.sulli...@thomsonreuters.com     RE: Tika Parsing not working in the latest version of 2.X? Fri, 09 Nov, 04:18
Lewis John Mcgibbney       Re: Tika Parsing not working in the latest version of 2.X? Fri, 09 Nov, 11:37
j.sulli...@thomsonreuters.com Primary Key with utf8mb4 up to 767 characters Fri, 09 Nov, 05:10
Julien Nioche Slides of Nutch talk at ApacheCon EU 2012 Fri, 09 Nov, 09:44
Lewis John Mcgibbney   Re: Slides of Nutch talk at ApacheCon EU 2012 Fri, 09 Nov, 11:30
Markus Jelsma   RE: Slides of Nutch talk at ApacheCon EU 2012 Fri, 09 Nov, 12:12
Ferdy Galema   Re: Slides of Nutch talk at ApacheCon EU 2012 Fri, 09 Nov, 12:39
Mattmann, Chris A (388J)   Re: Slides of Nutch talk at ApacheCon EU 2012 Fri, 09 Nov, 21:45
j.sulli...@thomsonreuters.com   RE: Slides of Nutch talk at ApacheCon EU 2012 Mon, 12 Nov, 13:32
Sourajit Basak rss feed plugin seems broken (1.5.1) Fri, 09 Nov, 10:55
Lewis John Mcgibbney   Re: rss feed plugin seems broken (1.5.1) Fri, 09 Nov, 11:26
Sourajit Basak     Re: rss feed plugin seems broken (1.5.1) Fri, 09 Nov, 11:34
Julien Nioche       Re: rss feed plugin seems broken (1.5.1) Mon, 12 Nov, 08:57
Sourajit Basak         Re: rss feed plugin seems broken (1.5.1) Wed, 14 Nov, 06:45
Lewis John Mcgibbney Simulating 2.x's page.putToInlinks() in trunk Mon, 12 Nov, 15:23
Ferdy Galema   Re: Simulating 2.x's page.putToInlinks() in trunk Tue, 13 Nov, 08:45
Markus Jelsma   RE: Simulating 2.x's page.putToInlinks() in trunk Tue, 13 Nov, 11:39
Lewis John Mcgibbney     Re: Simulating 2.x's page.putToInlinks() in trunk Tue, 13 Nov, 12:00
Mohammad wrk very slow generator step Mon, 12 Nov, 17:37
Markus Jelsma   RE: very slow generator step Mon, 12 Nov, 19:19
Mohammad wrk     Re: very slow generator step Mon, 12 Nov, 20:29
Julien Nioche       Re: very slow generator step Mon, 12 Nov, 20:38
Mohammad wrk         Re: very slow generator step Mon, 12 Nov, 21:12
Markus Jelsma           RE: very slow generator step Mon, 12 Nov, 21:21
Tejas Patil             Re: very slow generator step Tue, 13 Nov, 04:18
Erol Akarsu org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Mon, 12 Nov, 17:45
Erol Akarsu   org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Mon, 12 Nov, 18:02
Erol Akarsu     Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Mon, 12 Nov, 18:29
Ferdy Galema       Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 08:57
Lewis John Mcgibbney         Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 11:57
Erol Akarsu           Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 13:13
Lewis John Mcgibbney             Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 13:35
Erol Akarsu               Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 14:36
Lewis John Mcgibbney                 Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 14:53
Erol Akarsu                   Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 15:45
Mouradk                     Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 15:53
Erol Akarsu                       Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 16:00
Lewis John Mcgibbney                     Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 16:04
Erol Akarsu                       Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 16:22
Lewis John Mcgibbney                         Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 18:10
Erol Akarsu                           Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 18:32
Erol Akarsu                             Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Wed, 14 Nov, 15:08
Lewis John Mcgibbney                               Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Wed, 14 Nov, 15:49
Erol Akarsu                                 Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Wed, 14 Nov, 16:00
Lewis John Mcgibbney                                   Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Wed, 14 Nov, 16:15
tkessler                               Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Wed, 28 Nov, 15:11
Erol Akarsu                       Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 16:34
Erol Akarsu         Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 13:12
kiran chitturi   Re: org.apache.solr.common.SolrException: Document contains multiple values for uniqueKey field: id? Tue, 13 Nov, 13:12
Jorge Luis Betancourt Gonzalez How to restrict a plugin to some specific mimetype Mon, 12 Nov, 19:10
Julien Nioche   Re: How to restrict a plugin to some specific mimetype Mon, 12 Nov, 20:35
Jorge Luis Betancourt Gonzalez   Re: How to restrict a plugin to some specific mimetype Tue, 13 Nov, 00:19
Jacob Sisk How to find ids of pages that have been newly crawled or modified after a given date with Nutch 2.1 Mon, 12 Nov, 19:18
Ferdy Galema   Re: How to find ids of pages that have been newly crawled or modified after a given date with Nutch 2.1 Tue, 13 Nov, 09:30
j.sulli...@thomsonreuters.com     RE: How to find ids of pages that have been newly crawled or modified after a given date with Nutch 2.1 Tue, 13 Nov, 10:06
Markus Jelsma       RE: How to find ids of pages that have been newly crawled or modified after a given date with Nutch 2.1 Tue, 13 Nov, 10:24
Jacob Sisk         Re: How to find ids of pages that have been newly crawled or modified after a given date with Nutch 2.1 Tue, 13 Nov, 19:31
j.sulli...@thomsonreuters.com         RE: How to find ids of pages that have been newly crawled or modified after a given date with Nutch 2.1 Thu, 15 Nov, 03:32
Integrating Nutch and RabbitMQ
Jorge Luis Betancourt Gonzalez   Integrating Nutch and RabbitMQ Tue, 13 Nov, 19:56
Julien Nioche     Re: Integrating Nutch and RabbitMQ Tue, 13 Nov, 21:19
Jorge Luis Betancourt Gonzalez   Re: Integrating Nutch and RabbitMQ Wed, 14 Nov, 06:01
Sourajit Basak adding custom metadata to CrawlDatum during parse Wed, 14 Nov, 07:05
Markus Jelsma   RE: adding custom metadata to CrawlDatum during parse Wed, 14 Nov, 08:55
Sourajit Basak     Re: adding custom metadata to CrawlDatum during parse Wed, 14 Nov, 09:03
Joe Zhang site-specific crawling policies Wed, 14 Nov, 07:34
Tejas Patil   Re: site-specific crawling policies Wed, 14 Nov, 08:03
Sourajit Basak     Re: site-specific crawling policies Wed, 14 Nov, 08:33
Joe Zhang       Re: site-specific crawling policies Wed, 14 Nov, 18:52
Sourajit Basak         Re: site-specific crawling policies Thu, 15 Nov, 14:41
Joe Zhang           Re: site-specific crawling policies Thu, 15 Nov, 23:53
Lewis John Mcgibbney             Re: site-specific crawling policies Fri, 16 Nov, 02:52
Joe Zhang               Re: site-specific crawling policies Fri, 16 Nov, 04:10
Sourajit Basak                 Re: site-specific crawling policies Fri, 16 Nov, 10:28
Joe Zhang                   Re: site-specific crawling policies Fri, 16 Nov, 17:30
Markus Jelsma                     RE: site-specific crawling policies Fri, 16 Nov, 18:03
Joe Zhang                       Re: site-specific crawling policies Sat, 17 Nov, 22:36
Prashant Ladha IOException Hadoop Wed, 14 Nov, 18:07
Lewis John Mcgibbney   Re: IOException Hadoop Wed, 14 Nov, 18:14
Tejas Patil     Re: IOException Hadoop Wed, 14 Nov, 21:21
Prashant Ladha       Re: IOException Hadoop Tue, 20 Nov, 19:36
Prashant Ladha         Re: IOException Hadoop Wed, 21 Nov, 21:12
Lewis John Mcgibbney           Re: IOException Hadoop Wed, 21 Nov, 21:26
vetus re-Crawl re-fetch all pages each time Thu, 15 Nov, 12:18
Markus Jelsma   RE: re-Crawl re-fetch all pages each time Thu, 15 Nov, 14:47
vetus     RE: re-Crawl re-fetch all pages each time Thu, 15 Nov, 17:49
Lewis John Mcgibbney       Re: re-Crawl re-fetch all pages each time Thu, 15 Nov, 19:51
vetus         Re: re-Crawl re-fetch all pages each time Fri, 16 Nov, 07:33
vetus         Re: re-Crawl re-fetch all pages each time Fri, 16 Nov, 07:35
vetus         Re: re-Crawl re-fetch all pages each time Mon, 19 Nov, 08:48
Re: only fetch home page
vetus   Re: only fetch home page Thu, 15 Nov, 12:40
Markus Jelsma     RE: only fetch home page Thu, 15 Nov, 14:46
Re: How to re-fetch all the modified page?
vetus   Re: How to re-fetch all the modified page? Thu, 15 Nov, 12:41
Markus Jelsma     RE: How to re-fetch all the modified page? Thu, 15 Nov, 14:48
Sourajit Basak custom plugin's constructor unable to access hadoop conf Fri, 16 Nov, 10:23
Markus Jelsma   RE: custom plugin's constructor unable to access hadoop conf Fri, 16 Nov, 10:34
Sourajit Basak     Re: custom plugin's constructor unable to access hadoop conf Fri, 16 Nov, 11:42
Markus Jelsma       RE: custom plugin's constructor unable to access hadoop conf Fri, 16 Nov, 11:49
kiran chitturi Best practices for running Nutch Sun, 18 Nov, 17:32
Muzaffer Tolga Özses   Re: Best practices for running Nutch Mon, 19 Nov, 07:33
Markus Jelsma   RE: Best practices for running Nutch Mon, 19 Nov, 08:20
Julien Nioche     Re: Best practices for running Nutch Mon, 19 Nov, 12:10
kiran chitturi     Re: Best practices for running Nutch Mon, 19 Nov, 14:38
Re: Correct syntax for regex-urlfilter.txt - trying to exclude single path results
keitwagner   Re: Correct syntax for regex-urlfilter.txt - trying to exclude single path results Mon, 19 Nov, 21:50
Sebastian Nagel   Re: Correct syntax for regex-urlfilter.txt - trying to exclude single path results Tue, 20 Nov, 20:52
Jorge Luis Betancourt Gonzalez Get full content in a plugin extending HTMLParseFilter Wed, 21 Nov, 00:16
Jorge Luis Betancourt Gonzalez   Re: Get full content in a plugin extending HTMLParseFilter Wed, 21 Nov, 15:21
Lewis John Mcgibbney     Re: Get full content in a plugin extending HTMLParseFilter Wed, 21 Nov, 21:14
Joe Zhang timestamp in nutch/solr Wed, 21 Nov, 00:31
Lewis John Mcgibbney   Re: timestamp in nutch/solr Wed, 21 Nov, 11:42
Joe Zhang     Re: timestamp in nutch/solr Wed, 21 Nov, 21:25
Lewis John Mcgibbney       Re: timestamp in nutch/solr Wed, 21 Nov, 21:35
Joe Zhang         Re: timestamp in nutch/solr Wed, 21 Nov, 21:48
Lewis John Mcgibbney           Re: timestamp in nutch/solr Fri, 23 Nov, 01:35
Re: Jenkins build is back to normal : Nutch-trunk #2019
Lewis John Mcgibbney   Re: Jenkins build is back to normal : Nutch-trunk #2019 Wed, 21 Nov, 11:33
Message list1 · 2 · Next »Thread · Author · Date
Box list
May 201583
Apr 2015127
Mar 2015137
Feb 2015158
Jan 2015126
Dec 201487
Nov 201473
Oct 201474
Sep 2014177
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167