nutch-user mailing list archives: May 2012

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Re: Google Analytics in Hadoop ?
Lewis John Mcgibbney   Re: Google Analytics in Hadoop ? Tue, 01 May, 10:06
Re: Indexing meta tags in Nutch 1.4
Lewis John Mcgibbney   Re: Indexing meta tags in Nutch 1.4 Tue, 01 May, 10:15
ML mail     Re: Indexing meta tags in Nutch 1.4 Tue, 01 May, 11:38
Lewis John Mcgibbney       Re: Indexing meta tags in Nutch 1.4 Wed, 02 May, 10:49
ML mail         Re: Indexing meta tags in Nutch 1.4 Thu, 03 May, 07:25
Markus Jelsma   Re: Indexing meta tags in Nutch 1.4 Thu, 03 May, 07:32
ML mail     Re: Indexing meta tags in Nutch 1.4 Thu, 03 May, 08:52
Markus Jelsma       Re: Indexing meta tags in Nutch 1.4 Thu, 03 May, 08:59
ML mail         Re: Indexing meta tags in Nutch 1.4 Thu, 03 May, 09:22
Crawl sites with hashtags in url
Roberto Gardenier   Crawl sites with hashtags in url Tue, 01 May, 11:25
Markus Jelsma     Re: Crawl sites with hashtags in url Tue, 01 May, 11:44
Sebastian Nagel       Re: Crawl sites with hashtags in url Tue, 01 May, 21:20
Roberto Gardenier         RE: Crawl sites with hashtags in url Mon, 07 May, 07:39
remi tassing   Re: Crawl sites with hashtags in url Wed, 02 May, 00:20
Roberto Gardenier     RE: Crawl sites with hashtags in url Mon, 07 May, 07:41
Siddharth Jain     Re: Crawl sites with hashtags in url Mon, 07 May, 10:19
RE: [jira] [Closed] (NUTCH-1343) Crawl sites with hashtags in url
Roberto Gardenier   RE: [jira] [Closed] (NUTCH-1343) Crawl sites with hashtags in url Tue, 01 May, 11:55
Dean Pullen     Hadoop not doing anything Tue, 01 May, 15:26
Markus Jelsma       Re: Hadoop not doing anything Tue, 01 May, 16:22
Re: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local..
Sebastian Nagel   Re: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local.. Tue, 01 May, 21:15
Igor Salma     Re: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local.. Thu, 10 May, 08:26
Markus Jelsma       Re: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local.. Thu, 10 May, 08:35
Igor Salma         Re: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local.. Thu, 10 May, 08:43
Markus Jelsma           Re: org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/jobcache/job_local.. Thu, 10 May, 08:48
mendoza.juan No se indexan los metatags de algunas urls Wed, 02 May, 14:03
Lewis John Mcgibbney   Re: No se indexan los metatags de algunas urls Wed, 02 May, 14:52
Re: fields foreach document
Lewis John Mcgibbney   Re: fields foreach document Wed, 02 May, 18:01
Markus Jelsma     Re: fields foreach document Wed, 02 May, 19:17
Ing. Eyeris Rodriguez Rueda       RE: fields foreach document Thu, 03 May, 14:56
Re: Generator OOM
Markus Jelsma   Re: Generator OOM Thu, 03 May, 06:32
Xiao Li Avoid crawling nonsense calendar webpage Fri, 04 May, 19:13
Ferdy Galema   Re: Avoid crawling nonsense calendar webpage Sat, 05 May, 10:44
Markus Jelsma     Re: Avoid crawling nonsense calendar webpage Sat, 05 May, 11:18
Ali Safdar Kureishy Problem writing SerDe to read Nutch crawldb because Hive seems to ignore the Key and only reads the Value from SequenceFiles. Sat, 05 May, 20:05
Edward Capriolo   Re: Problem writing SerDe to read Nutch crawldb because Hive seems to ignore the Key and only reads the Value from SequenceFiles. Sat, 05 May, 21:44
Ali Safdar Kureishy     Re: Problem writing SerDe to read Nutch crawldb because Hive seems to ignore the Key and only reads the Value from SequenceFiles. Sat, 05 May, 21:48
Edward Capriolo       Re: Problem writing SerDe to read Nutch crawldb because Hive seems to ignore the Key and only reads the Value from SequenceFiles. Sat, 05 May, 22:16
Ali Safdar Kureishy         Re: Problem writing SerDe to read Nutch crawldb because Hive seems to ignore the Key and only reads the Value from SequenceFiles. Sun, 06 May, 11:34
Ali Safdar Kureishy Exception thrown when loading class org.apache.nutch.protocol.Protocol while reading the "crawldb" SequenceFile Sun, 06 May, 23:09
Mohammad wrk link without href Mon, 07 May, 06:19
Markus Jelsma   Re: link without href Mon, 07 May, 14:08
nutch.bu...@gmail.com How do I merge indexes so that the "indexes" folder is merged as well? Mon, 07 May, 10:07
Lewis John Mcgibbney   Re: How do I merge indexes so that the "indexes" folder is merged as well? Tue, 08 May, 10:46
Re: Client certificate authentication
Siddharth Jain   Re: Client certificate authentication Mon, 07 May, 10:24
Re: https authentication
Siddharth Jain   Re: https authentication Mon, 07 May, 10:30
nutch.bu...@gmail.com Is it possible to control the segment size? Tue, 08 May, 05:31
Markus Jelsma   Re: Is it possible to control the segment size? Tue, 08 May, 05:43
nutch.bu...@gmail.com     Re: Is it possible to control the segment size? Tue, 08 May, 05:52
Markus Jelsma       Re: Is it possible to control the segment size? Tue, 08 May, 06:02
nutch.bu...@gmail.com         Re: Is it possible to control the segment size? Tue, 08 May, 06:12
Vikas Hazrati De-duplication of Nutch parsed data Tue, 08 May, 11:14
Dean Pullen   Lower case URLs - correct regex? Tue, 08 May, 12:37
Markus Jelsma     Re: Lower case URLs - correct regex? Tue, 08 May, 12:46
Markus Jelsma       Re: Lower case URLs - correct regex? Tue, 08 May, 12:52
Dean Pullen       Re: Lower case URLs - correct regex? Tue, 08 May, 14:30
Vikas Hazrati   Re: De-duplication of Nutch parsed data Wed, 09 May, 18:56
Markus Jelsma   Re: De-duplication of Nutch parsed data Wed, 09 May, 19:04
Vikas Hazrati     Re: De-duplication of Nutch parsed data Thu, 10 May, 09:49
Markus Jelsma       Re: De-duplication of Nutch parsed data Thu, 10 May, 09:55
Vikas Hazrati         Re: De-duplication of Nutch parsed data Thu, 10 May, 10:10
Bai Shen HTML documents with TXT extension Tue, 08 May, 12:34
Markus Jelsma   Re: HTML documents with TXT extension Tue, 08 May, 12:44
Bai Shen     Re: HTML documents with TXT extension Fri, 11 May, 18:05
Tolga CLASSPATH Wed, 09 May, 07:00
Tolga   Fwd: CLASSPATH Wed, 09 May, 07:03
Lewis John Mcgibbney     Re: CLASSPATH Wed, 09 May, 10:25
Tolga       Re: CLASSPATH Wed, 09 May, 10:51
Lewis John Mcgibbney         Re: CLASSPATH Wed, 09 May, 11:31
Tolga           Re: CLASSPATH Wed, 09 May, 11:35
Lewis John Mcgibbney             Re: CLASSPATH Wed, 09 May, 12:45
Tolga               Re: CLASSPATH Wed, 09 May, 13:02
Lewis John Mcgibbney                 Re: CLASSPATH Wed, 09 May, 13:49
Ali Safdar Kureishy Consistent Checksum error using SequenceFileInputFormat against <segment>/content & <segment>/parse_text folders output by Nutch. Wed, 09 May, 08:01
Stephan Kristyn HTTP ERROR 400 Wed, 09 May, 10:11
Stephan Kristyn   Re: HTTP ERROR 400 Wed, 09 May, 10:17
Lewis John Mcgibbney     Re: HTTP ERROR 400 Wed, 09 May, 10:32
Stephan Kristyn       Re: HTTP ERROR 400 Wed, 09 May, 11:21
Lewis John Mcgibbney         Re: HTTP ERROR 400 Wed, 09 May, 11:33
Stephan Kristyn           RE: HTTP ERROR 400 Wed, 09 May, 12:26
Stephan Kristyn           RE: HTTP ERROR 400 Wed, 09 May, 12:28
Stephan Kristyn             Re: HTTP ERROR 400 Wed, 09 May, 14:04
Stephan Kristyn               Re: HTTP ERROR 400 Wed, 09 May, 14:33
Stephan Kristyn                 Re: HTTP ERROR 400 Wed, 09 May, 15:11
Lewis John Mcgibbney                 Re: HTTP ERROR 400 Wed, 09 May, 16:05
Stephan Kristyn                   Re: HTTP ERROR 400 Wed, 09 May, 16:25
Markus Jelsma                   Re: HTTP ERROR 400 Wed, 09 May, 16:36
Tolga               Re: HTTP ERROR 400 Wed, 09 May, 19:28
Markus Jelsma                 Re: HTTP ERROR 400 Wed, 09 May, 19:34
Tolga Working! Wed, 09 May, 12:45
James Ford Make Nutch to crawl internal urls only Wed, 09 May, 15:09
Markus Jelsma   Re: Make Nutch to crawl internal urls only Wed, 09 May, 19:09
Ken Krugler   Re: Make Nutch to crawl internal urls only Wed, 09 May, 21:28
James Ford     Re: Make Nutch to crawl internal urls only Thu, 10 May, 08:47
Markus Jelsma       Re: Make Nutch to crawl internal urls only Thu, 10 May, 08:56
Greg Fields         Re: Make Nutch to crawl internal urls only Thu, 10 May, 09:24
Julien Nioche         Re: Make Nutch to crawl internal urls only Thu, 10 May, 10:00
Michael Erickson Focused Crawling with Nutch (IndexingFilter:filter) Wed, 09 May, 18:07
Markus Jelsma   Re: Focused Crawling with Nutch (IndexingFilter:filter) Wed, 09 May, 18:18
Michael Erickson     Re: Focused Crawling with Nutch (IndexingFilter:filter) Wed, 09 May, 18:55
Tolga HTTP error 400 Thu, 10 May, 06:10
Markus Jelsma   Re: HTTP error 400 Thu, 10 May, 06:42
Tolga     Re: HTTP error 400 Thu, 10 May, 07:07
Stephan Kristyn       Re: HTTP error 400 Thu, 10 May, 10:22
keesp         Re: HTTP error 400 Thu, 24 May, 08:29
Tolga     Re: HTTP error 400 Thu, 10 May, 19:54
Markus Jelsma       Re: HTTP error 400 Thu, 10 May, 20:38
Tolga         Re: HTTP error 400 Fri, 11 May, 04:39
Michael Erickson   Re: HTTP error 400 Thu, 10 May, 12:56
Lewis John Mcgibbney     Re: HTTP error 400 Thu, 10 May, 13:35
Markus Jelsma       Re: HTTP error 400 Thu, 10 May, 13:45
Ferdy Galema         Re: HTTP error 400 Thu, 10 May, 14:03
Markus Jelsma   Re: HTTP error 400 Fri, 11 May, 06:40
Tolga     Re: HTTP error 400 Tue, 15 May, 10:40
Markus Jelsma       Re: HTTP error 400 Tue, 15 May, 11:05
Tolga         Re: HTTP error 400 Tue, 15 May, 12:01
Tolga         Re: HTTP error 400 Tue, 15 May, 12:49
Tolga         Re: HTTP error 400 Thu, 17 May, 10:07
Jean-Fran├žois Gingras           Re: HTTP error 400 Sat, 19 May, 01:43
m2000hsf             Re: HTTP error 400 Sat, 19 May, 06:43
Markus Jelsma Fwd: Re: Make Nutch to crawl internal urls only Thu, 10 May, 09:28
Vijith Running nutch in eclipse Thu, 10 May, 11:14
Lewis John Mcgibbney   Re: Running nutch in eclipse Thu, 10 May, 13:41
Julien Nioche     Re: Running nutch in eclipse Thu, 10 May, 14:02
Vijith       Re: Running nutch in eclipse Thu, 10 May, 16:22
Lewis John Mcgibbney         Re: Running nutch in eclipse Thu, 10 May, 18:13
Vijith           Re: Running nutch in eclipse Thu, 10 May, 18:58
Vijith             Re: Running nutch in eclipse Fri, 11 May, 08:49
Matthias Paul Crawl-tool for iterative crawling? Thu, 10 May, 16:18
Lewis John Mcgibbney   Re: Crawl-tool for iterative crawling? Thu, 10 May, 18:31
Markus Jelsma     Re: Crawl-tool for iterative crawling? Thu, 10 May, 18:39
Matthias Paul       Re: Crawl-tool for iterative crawling? Fri, 11 May, 13:52
Lewis John Mcgibbney         Re: Crawl-tool for iterative crawling? Fri, 11 May, 14:56
Vikas Hazrati           Re: Crawl-tool for iterative crawling? Tue, 15 May, 12:09
Markus Jelsma             Re: Crawl-tool for iterative crawling? Tue, 15 May, 12:37
Vikas Hazrati               Re: Crawl-tool for iterative crawling? Mon, 21 May, 09:13
Vikas Hazrati                 Re: Crawl-tool for iterative crawling? Mon, 21 May, 18:02
Vijith Separate logger for nutch Fri, 11 May, 09:37
Vijith   Re: Separate logger for nutch Fri, 11 May, 11:11
Ferdy Galema     Re: Separate logger for nutch Fri, 11 May, 12:14
Vijith       Re: Separate logger for nutch Fri, 11 May, 12:36
Ferdy Galema         Re: Separate logger for nutch Fri, 11 May, 12:59
Markus Jelsma           Re: Separate logger for nutch Fri, 11 May, 15:03
Vijith             Re: Separate logger for nutch Sat, 12 May, 11:54
ML mail Indexing HTML metatags from Nutch into Solr Fri, 11 May, 10:40
Ing. Eyeris Rodriguez Rueda   Re: Indexing HTML metatags from Nutch into Solr Fri, 11 May, 17:55
ML mail     Re: Indexing HTML metatags from Nutch into Solr Fri, 11 May, 18:37
Ing. Eyeris Rodriguez Rueda       Re: Indexing HTML metatags from Nutch into Solr Fri, 11 May, 20:38
ML mail         Re: Indexing HTML metatags from Nutch into Solr Sun, 13 May, 12:01
Ing. Eyeris Rodriguez Rueda           RE: Indexing HTML metatags from Nutch into Solr Sun, 13 May, 15:31
ML mail             Re: Indexing HTML metatags from Nutch into Solr Sun, 13 May, 13:55
Ing. Eyeris Rodriguez Rueda               RE: Indexing HTML metatags from Nutch into Solr Tue, 15 May, 20:04
Ramsel Ruiz Nutchgora - SQLTransientConnectionException? Fri, 11 May, 23:25
Lewis John Mcgibbney   Re: Nutchgora - SQLTransientConnectionException? Fri, 11 May, 23:33
Ramsel Ruiz     Re: Nutchgora - SQLTransientConnectionException? Wed, 16 May, 19:19
Lewis John Mcgibbney       Re: Nutchgora - SQLTransientConnectionException? Wed, 16 May, 20:36
nutch.bu...@gmail.com Heap space problem when running nutch on cluster Sun, 13 May, 15:16
Markus Jelsma   Re: Heap space problem when running nutch on cluster Sun, 13 May, 16:02
forwardswing Can't retrieve Tika parser for mime-type text/javascript Mon, 14 May, 03:24
Markus Jelsma   Re: Can't retrieve Tika parser for mime-type text/javascript Mon, 14 May, 07:50
forwardswing     Re: Can't retrieve Tika parser for mime-type text/javascript Mon, 14 May, 08:35
forwardswing       Re: Can't retrieve Tika parser for mime-type text/javascript Tue, 15 May, 04:50
Markus Jelsma       Re: Can't retrieve Tika parser for mime-type text/javascript Tue, 15 May, 11:04
forwardswing         Re: Can't retrieve Tika parser for mime-type text/javascript Wed, 16 May, 06:22
forwardswing         Re: Can't retrieve Tika parser for mime-type text/javascript Wed, 16 May, 14:15
Lewis John Mcgibbney           Re: Can't retrieve Tika parser for mime-type text/javascript Thu, 17 May, 09:50
forwardswing             Re: Can't retrieve Tika parser for mime-type text/javascript Fri, 18 May, 05:12
Lewis John Mcgibbney               Re: Can't retrieve Tika parser for mime-type text/javascript Fri, 18 May, 10:09
Lewis John Mcgibbney                 Re: Can't retrieve Tika parser for mime-type text/javascript Fri, 18 May, 10:14
forwardswing java.lang.NullPointerException:org.apache.hadoop.io.Text.encode(Text.java:388) Mon, 14 May, 03:28
Markus Jelsma   Re: java.lang.NullPointerException:org.apache.hadoop.io.Text.encode(Text.java:388) Mon, 14 May, 07:44
forwardswing     Re: java.lang.NullPointerException:org.apache.hadoop.io.Text.encode(Text.java:388) Tue, 15 May, 04:48
kh3rad Couldn't get robots.txt for site Mon, 14 May, 09:46
kh3rad   Re: Couldn't get robots.txt for site Mon, 14 May, 11:01
Ken Krugler   Re: Couldn't get robots.txt for site Mon, 14 May, 16:09
Taeseong Kim webpage download Tue, 15 May, 03:45
Markus Jelsma   Re: webpage download Tue, 15 May, 11:02
Taeseong Kim     Re: webpage download Tue, 22 May, 04:10
Lewis John Mcgibbney       Re: webpage download Tue, 22 May, 09:27
ramires nutch 1-4 with solr-4 Tue, 15 May, 07:47
Tolga solrindex Tue, 15 May, 13:27
Lewis John Mcgibbney   Re: solrindex Wed, 16 May, 10:26
LEVILLAIN Olivier Tika parser exception IndexOutOfBoundsException Tue, 15 May, 14:17
Julien Nioche   Re: Tika parser exception IndexOutOfBoundsException Tue, 15 May, 14:43
Piet van Remortel     Re: Tika parser exception IndexOutOfBoundsException Tue, 15 May, 14:47
Vijith Block irrelevant urls Tue, 15 May, 18:07
Vijith   Re: Block irrelevant urls Wed, 16 May, 10:40
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Sep 201417
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167