nutch-user mailing list archives: April 2013

Site index · List index
Message list1 · 2 · Next »Thread · Author · Date
Canan GİRGİN FetchSchedule and Metadata Mon, 01 Apr, 13:57
Re: error using generate in 2.x
kaveh minooie   Re: error using generate in 2.x Mon, 01 Apr, 21:45
Re: How to get page content of crawled pages
peterbarretto   Re: How to get page content of crawled pages Tue, 02 Apr, 10:52
Lewis John Mcgibbney     Re: How to get page content of crawled pages Tue, 02 Apr, 17:23
cleardot When does scoring-opic in nutch-default affect scoring? Tue, 02 Apr, 17:17
Re: Re: What urls does Nutch crawl?
Alvaro Cabrerizo   Re: Re: What urls does Nutch crawl? Tue, 02 Apr, 20:19
Lewis John Mcgibbney     Re: Re: What urls does Nutch crawl? Tue, 02 Apr, 20:50
Yves S. Garret Can't crawl the google glass site on Google+ Tue, 02 Apr, 22:27
Tejas Patil   Re: Can't crawl the google glass site on Google+ Tue, 02 Apr, 22:51
Yves S. Garret     Re: Can't crawl the google glass site on Google+ Tue, 02 Apr, 23:30
Alvaro Cabrerizo       Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 00:21
Yves S. Garret         Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 01:49
Yves S. Garret         Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 01:58
Tejas Patil           Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 03:58
Yves S. Garret             Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 04:38
Tejas Patil               Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 04:51
kaveh minooie               Re: Can't crawl the google glass site on Google+ Wed, 03 Apr, 04:57
Amit Sela nutch and ElasticSearch Thu, 04 Apr, 14:59
Julien Nioche   Re: nutch and ElasticSearch Thu, 04 Apr, 15:34
David Philip crawl time for depth param 50 and topN not passed Fri, 05 Apr, 07:08
Sebastian Nagel   Re: crawl time for depth param 50 and topN not passed Fri, 05 Apr, 19:24
David Philip     Re: crawl time for depth param 50 and topN not passed Sat, 06 Apr, 10:31
Tejas Patil       Re: crawl time for depth param 50 and topN not passed Sat, 06 Apr, 11:23
David Philip         Re: crawl time for depth param 50 and topN not passed Mon, 08 Apr, 05:43
Tejas Patil           Re: crawl time for depth param 50 and topN not passed Mon, 08 Apr, 06:11
David Philip             Re: crawl time for depth param 50 and topN not passed Tue, 09 Apr, 06:06
Tejas Patil               Re: crawl time for depth param 50 and topN not passed Tue, 09 Apr, 08:16
Amit Sela Setting up nutch 1.6 with Solr 4.2 Sat, 06 Apr, 15:25
Lewis John Mcgibbney   Re: Setting up nutch 1.6 with Solr 4.2 Mon, 08 Apr, 19:31
Amit Sela     Re: Setting up nutch 1.6 with Solr 4.2 Tue, 09 Apr, 07:49
Lewis John Mcgibbney       Setting up nutch 1.6 with Solr 4.2 Tue, 09 Apr, 16:14
Parin Jogani Nutch Sat, 06 Apr, 16:58
Tejas Patil   Re: Nutch Sat, 06 Apr, 21:58
Amine BENHAMZA     Re: Nutch Sun, 07 Apr, 09:41
Jun Zhou encode special characters in url Sat, 06 Apr, 23:26
Rajani Maski   Re: encode special characters in url Wed, 10 Apr, 12:17
feng lu     Re: encode special characters in url Wed, 10 Apr, 14:11
Jun Zhou       Re: encode special characters in url Thu, 11 Apr, 00:51
Jun Zhou     Re: encode special characters in url Thu, 11 Apr, 00:49
Amit Sela Indexing to Solr4.2 with nutch 1.6 Mon, 08 Apr, 11:13
Lewis John Mcgibbney   Re: Indexing to Solr4.2 with nutch 1.6 Mon, 08 Apr, 19:33
Amit Sela     Re: Indexing to Solr4.2 with nutch 1.6 Tue, 09 Apr, 07:53
Lewis John Mcgibbney       Re: Indexing to Solr4.2 with nutch 1.6 Tue, 09 Apr, 18:15
Amit Sela         Re: Indexing to Solr4.2 with nutch 1.6 Wed, 10 Apr, 15:01
Amit Sela           Re: Indexing to Solr4.2 with nutch 1.6 Wed, 10 Apr, 18:27
Lewis John Mcgibbney             Re: Indexing to Solr4.2 with nutch 1.6 Wed, 10 Apr, 18:31
Sourajit Basak how to force set fetch-status without actually fetching Mon, 08 Apr, 11:15
feng lu   Re: how to force set fetch-status without actually fetching Mon, 08 Apr, 15:15
Sourajit Basak     Re: how to force set fetch-status without actually fetching Wed, 10 Apr, 07:11
feng lu       Re: how to force set fetch-status without actually fetching Wed, 10 Apr, 15:01
Yves S. Garret Question about ivy/ivy.xml Mon, 08 Apr, 21:54
Tejas Patil   Re: Question about ivy/ivy.xml Mon, 08 Apr, 22:17
Yves S. Garret     Re: Question about ivy/ivy.xml Tue, 09 Apr, 00:00
Deals Collect Permgen size keeps increasing Mon, 08 Apr, 23:49
Sebastian Nagel   Re: Permgen size keeps increasing Tue, 09 Apr, 19:16
kaveh minooie question about running updatedb Tue, 09 Apr, 08:14
Lewis John Mcgibbney   Re: question about running updatedb Tue, 09 Apr, 18:13
Tianwei Sheng Only recrawl the pages with http code=500 Tue, 09 Apr, 19:16
feng lu   Re: Only recrawl the pages with http code=500 Wed, 10 Apr, 16:08
kiran chitturi     Re: Only recrawl the pages with http code=500 Wed, 10 Apr, 16:25
alx...@aim.com       Re: Only recrawl the pages with http code=500 Wed, 10 Apr, 17:24
kiran chitturi         Re: Only recrawl the pages with http code=500 Wed, 10 Apr, 18:01
Tianwei Sheng       Re: Only recrawl the pages with http code=500 Thu, 11 Apr, 03:17
kiran chitturi         Re: Only recrawl the pages with http code=500 Thu, 11 Apr, 13:25
Tianwei Sheng           Re: Only recrawl the pages with http code=500 Thu, 11 Apr, 17:08
alx...@aim.com         Re: Only recrawl the pages with http code=500 Thu, 11 Apr, 17:32
Tianwei Sheng     Re: Only recrawl the pages with http code=500 Thu, 11 Apr, 03:15
Yves S. Garret An Ant + Apache question Fri, 12 Apr, 18:31
Yves S. Garret   Fwd: An Ant + Apache question Fri, 12 Apr, 18:53
kaveh minooie     Re: Fwd: An Ant + Apache question Fri, 12 Apr, 19:45
Yves S. Garret       Re: Fwd: An Ant + Apache question Fri, 12 Apr, 20:06
Yves S. Garret Trying to output to db in MS-SQL on Azure Sat, 13 Apr, 01:02
Yves S. Garret   Fwd: Trying to output to db in MS-SQL on Azure Mon, 15 Apr, 21:24
Canan GİRGİN   Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 05:18
Yves S. Garret     Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 15:13
Renato Marroquín Mogrovejo       Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 17:27
Yves S. Garret         Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 19:00
Yves S. Garret         Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 19:36
Lewis John Mcgibbney           Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 19:44
Yves S. Garret             Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 20:43
Lewis John Mcgibbney   Re: Trying to output to db in MS-SQL on Azure Tue, 16 Apr, 22:59
Maximiliano Marin Question about Nutch and Hadoop Tue, 16 Apr, 03:59
Alexander Chepurnoy   Re: Question about Nutch and Hadoop Tue, 16 Apr, 05:05
Lewis John Mcgibbney     Question about Nutch and Hadoop Tue, 16 Apr, 17:29
Maximiliano Marin       Re: Question about Nutch and Hadoop Tue, 16 Apr, 17:44
Maximiliano Marin         Re: Question about Nutch and Hadoop Wed, 17 Apr, 15:07
kiran chitturi           Re: Question about Nutch and Hadoop Wed, 17 Apr, 16:01
Maximiliano Marin             Re: Question about Nutch and Hadoop Thu, 18 Apr, 19:34
Re: Nutch not crawling Matwali
scodebraker   Re: Nutch not crawling Matwali Wed, 17 Apr, 09:28
kneerosh Send parameters to a url Wed, 17 Apr, 16:06
feng lu   Re: Send parameters to a url Thu, 18 Apr, 14:48
vivekvl Whether Nutch AdaptiveFetchSchedule can do recrawling automatically? Thu, 18 Apr, 12:53
mesenthil1   Re: Whether Nutch AdaptiveFetchSchedule can do recrawling automatically? Thu, 18 Apr, 16:46
Walter Tietze     Re: Whether Nutch AdaptiveFetchSchedule can do recrawling automatically? Thu, 18 Apr, 17:39
Lewis John Mcgibbney     Re: Whether Nutch AdaptiveFetchSchedule can do recrawling automatically? Thu, 18 Apr, 17:41
Lewis John Mcgibbney   Re: Whether Nutch AdaptiveFetchSchedule can do recrawling automatically? Thu, 18 Apr, 23:54
vivekvl     Re: Whether Nutch AdaptiveFetchSchedule can do recrawling automatically? Fri, 19 Apr, 04:53
Rodney Barnett Period-terminated hostnames Thu, 18 Apr, 20:31
Markus Jelsma   RE: Period-terminated hostnames Thu, 18 Apr, 21:26
Rodney Barnett     RE: Period-terminated hostnames Fri, 19 Apr, 13:25
Nikunj Aggarwal Issue in web crawling with Apache Nutch 2.1 Fri, 19 Apr, 11:27
Lewis John Mcgibbney   Re: Issue in web crawling with Apache Nutch 2.1 Fri, 19 Apr, 17:56
imehesz Skipping domain because of large size? Fri, 19 Apr, 21:30
Tejas Patil   Re: Skipping domain because of large size? Sat, 20 Apr, 02:15
micklai [Exception in thread "main" java.io.IOException: Job failed!] Sat, 20 Apr, 19:00
kiran chitturi   Re: [Exception in thread "main" java.io.IOException: Job failed!] Sat, 20 Apr, 20:09
kiran chitturi   Re: [Exception in thread "main" java.io.IOException: Job failed!] Sat, 20 Apr, 20:11
kiran chitturi     Re: [Exception in thread "main" java.io.IOException: Job failed!] Sat, 20 Apr, 20:11
micklai       Re: [Exception in thread "main" java.io.IOException: Job failed!] Sun, 21 Apr, 08:15
kiran chitturi         Re: [Exception in thread "main" java.io.IOException: Job failed!] Sun, 21 Apr, 16:51
Lewis John Mcgibbney           Re: [Exception in thread "main" java.io.IOException: Job failed!] Mon, 22 Apr, 15:14
micklai           Re: [Exception in thread "main" java.io.IOException: Job failed!] Tue, 23 Apr, 15:38
kneerosh Nutch- not getting all content of page Mon, 22 Apr, 11:16
chethan   Re: Nutch- not getting all content of page Mon, 22 Apr, 14:34
Niels Boldt rewriting urls that are index Mon, 22 Apr, 13:56
kiran chitturi   Re: rewriting urls that are index Mon, 22 Apr, 14:14
Markus Jelsma   RE: rewriting urls that are index Mon, 22 Apr, 15:56
Julien Nioche     Re: rewriting urls that are index Mon, 22 Apr, 16:19
Niels Boldt       Re: rewriting urls that are index Wed, 24 Apr, 10:39
Maximiliano Marin Crawling and Hadoop problem Mon, 22 Apr, 17:27
Lewis John Mcgibbney   Re: Crawling and Hadoop problem Mon, 22 Apr, 17:46
Maximiliano Marin     Re: Crawling and Hadoop problem Mon, 22 Apr, 20:09
kaveh minooie       Re: Crawling and Hadoop problem Mon, 22 Apr, 21:17
kaveh minooie         need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 01:09
Tejas Patil           Re: need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 03:00
Lewis John Mcgibbney             Re: need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 03:09
Tejas Patil               Re: need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 03:21
kaveh minooie                 Re: need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 04:12
Lewis John Mcgibbney                 Re: need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 05:06
Lewis John Mcgibbney                 need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 05:07
kiran chitturi                   Re: need legends for fetch reduce jobtracker ouput Tue, 23 Apr, 05:37
Lewis John Mcgibbney       Re: Crawling and Hadoop problem Tue, 23 Apr, 01:25
Maximiliano Marin         Re: Crawling and Hadoop problem Tue, 23 Apr, 21:55
Lewis John Mcgibbney           Re: Crawling and Hadoop problem Tue, 23 Apr, 22:05
Maximiliano Marin             Re: Crawling and Hadoop problem Tue, 23 Apr, 22:24
Bai Shen Nutch 2 hanging after aborting hung threads Mon, 22 Apr, 18:18
Sebastian Nagel   Re: Nutch 2 hanging after aborting hung threads Mon, 22 Apr, 18:58
Bai Shen     Re: Nutch 2 hanging after aborting hung threads Mon, 22 Apr, 19:17
Sebastian Nagel       Re: Nutch 2 hanging after aborting hung threads Mon, 22 Apr, 19:39
Bai Shen         Re: Nutch 2 hanging after aborting hung threads Tue, 23 Apr, 11:06
Bai Shen         Re: Nutch 2 hanging after aborting hung threads Tue, 23 Apr, 11:19
Lewis John Mcgibbney           Re: Nutch 2 hanging after aborting hung threads Tue, 23 Apr, 15:49
Bai Shen             Re: Nutch 2 hanging after aborting hung threads Tue, 23 Apr, 16:17
Sebastian Nagel               Re: Nutch 2 hanging after aborting hung threads Tue, 23 Apr, 19:52
Bai Shen                 Re: Nutch 2 hanging after aborting hung threads Wed, 24 Apr, 11:34
Sebastian Nagel                   Re: Nutch 2 hanging after aborting hung threads Wed, 24 Apr, 21:17
Bai Shen                     Re: Nutch 2 hanging after aborting hung threads Thu, 25 Apr, 11:33
Lewis John Mcgibbney                       Re: Nutch 2 hanging after aborting hung threads Sat, 27 Apr, 21:30
Bai Shen                         Re: Nutch 2 hanging after aborting hung threads Tue, 30 Apr, 12:00
Lewis John Mcgibbney                           Re: Nutch 2 hanging after aborting hung threads Tue, 30 Apr, 16:50
Bai Shen     Re: Nutch 2 hanging after aborting hung threads Mon, 22 Apr, 19:37
Yves S. Garret Any way to run tasks after Nutch is done executing? Tue, 23 Apr, 18:57
Lewis John Mcgibbney   Re: Any way to run tasks after Nutch is done executing? Tue, 23 Apr, 19:30
Yves S. Garret     Re: Any way to run tasks after Nutch is done executing? Tue, 23 Apr, 19:52
Lewis John Mcgibbney       Re: Any way to run tasks after Nutch is done executing? Tue, 23 Apr, 20:25
Yves S. Garret         Re: Any way to run tasks after Nutch is done executing? Tue, 23 Apr, 20:51
Yves S. Garret         Re: Any way to run tasks after Nutch is done executing? Wed, 24 Apr, 01:03
Tejas Patil           Re: Any way to run tasks after Nutch is done executing? Wed, 24 Apr, 01:19
Lewis John Mcgibbney           Re: Any way to run tasks after Nutch is done executing? Wed, 24 Apr, 02:11
Yves S. Garret Unable to crawl a series of pages in tutorial Wed, 24 Apr, 02:01
Lewis John Mcgibbney   Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 02:09
Yves S. Garret     Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 18:41
Lewis John Mcgibbney       Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 19:13
Yves S. Garret     Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 18:45
Lewis John Mcgibbney       Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 19:14
Yves S. Garret         Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 20:15
Lewis John Mcgibbney   Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 20:37
Yves S. Garret     Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 22:07
Lewis John Mcgibbney       Re: Unable to crawl a series of pages in tutorial Wed, 24 Apr, 22:12
Maximiliano Marin Error Nutch2 and HBase Wed, 24 Apr, 03:08
Lewis John Mcgibbney   Re: Error Nutch2 and HBase Wed, 24 Apr, 03:27
Maximiliano Marin     Re: Error Nutch2 and HBase Wed, 24 Apr, 03:46
Lewis John Mcgibbney       Re: Error Nutch2 and HBase Wed, 24 Apr, 03:50
Maximiliano Marin         Re: Error Nutch2 and HBase Wed, 24 Apr, 04:07
Error when running Nutch, please help
Maohua Liu   Error when running Nutch, please help Wed, 24 Apr, 12:34
kiran chitturi     Re: Error when running Nutch, please help Wed, 24 Apr, 17:20
Lewis John Mcgibbney Re: GENERAL PROBLEMS LEARNING TO USE NUTCH Wed, 24 Apr, 19:53
Lewis John Mcgibbney Re: [nutch 2.1 with mysql] different batch id (null) Wed, 24 Apr, 19:55
Lewis John Mcgibbney   Re: [nutch 2.1 with mysql] different batch id (null) Thu, 25 Apr, 22:20
Lewis John Mcgibbney     Re: [nutch 2.1 with mysql] different batch id (null) Thu, 25 Apr, 22:30
Roland von Herget       Re: [nutch 2.1 with mysql] different batch id (null) Fri, 26 Apr, 07:13
Lewis John Mcgibbney         Re: [nutch 2.1 with mysql] different batch id (null) Fri, 26 Apr, 07:47
Lewis John Mcgibbney           Re: [nutch 2.1 with mysql] different batch id (null) Sat, 27 Apr, 00:16
Bai Shen Solrindex adding documents in small chunks Thu, 25 Apr, 13:35
Canan GİRGİN   Re: Solrindex adding documents in small chunks Tue, 30 Apr, 14:45
Benjamin Sznajder Running Nutch from Eclipse Thu, 25 Apr, 14:34
Lewis John Mcgibbney   Re: Running Nutch from Eclipse Fri, 26 Apr, 06:52
Benjamin Sznajder     Re: Running Nutch from Eclipse Sun, 28 Apr, 10:31
Lewis John Mcgibbney       Running Nutch from Eclipse Sun, 28 Apr, 16:53
Benjamin Sznajder         Re: Running Nutch from Eclipse Sun, 28 Apr, 17:14
brian4 solrdedup NullPointerException Fri, 26 Apr, 21:14
Lewis John Mcgibbney   Re: solrdedup NullPointerException Fri, 26 Apr, 23:31
Message list1 · 2 · Next »Thread · Author · Date
Box list
Jan 20212
Dec 20202
Oct 20206
Sep 20206
Aug 20207
Jul 202020
Jun 202014
Apr 20207
Mar 20206
Feb 20202
Jan 20205
Dec 201912
Nov 20199
Oct 201946
Sep 201911
Aug 20196
Jul 201919
Jun 20193
May 201910
Apr 201912
Mar 201941
Feb 201920
Jan 20192
Dec 201833
Nov 201841
Oct 201852
Sep 201823
Aug 201830
Jul 201823
Jun 201835
May 201823
Apr 201825
Mar 2018117
Feb 201845
Jan 201825
Dec 201744
Nov 201779
Oct 201744
Sep 201770
Aug 201787
Jul 201752
Jun 201757
May 201776
Apr 201759
Mar 201752
Feb 201736
Jan 201773
Dec 201660
Nov 201678
Oct 2016144
Sep 201672
Aug 201669
Jul 201692
Jun 201696
May 201683
Apr 201677
Mar 201687
Feb 2016137
Jan 2016106
Dec 201579
Nov 201584
Oct 201583
Sep 201590
Aug 201527
Jul 201568
Jun 201572
May 201593
Apr 2015127
Mar 2015137
Feb 2015158
Jan 2015126
Dec 201487
Nov 201473
Oct 201474
Sep 2014177
Aug 2014108
Jul 2014145
Jun 2014123
May 2014188
Apr 2014127
Mar 2014228
Feb 2014149
Jan 2014109
Dec 2013193
Nov 2013164
Oct 2013207
Sep 201383
Aug 2013251
Jul 2013362
Jun 2013481
May 2013215
Apr 2013219
Mar 2013305
Feb 2013350
Jan 2013279
Dec 2012174
Nov 2012309
Oct 2012314
Sep 2012206
Aug 2012387
Jul 2012336
Jun 2012309
May 2012348
Apr 2012208
Mar 2012235
Feb 2012349
Jan 2012319
Dec 2011319
Nov 2011322
Oct 2011291
Sep 2011305
Aug 2011305
Jul 2011606
Jun 2011283
May 2011159
Apr 2011178
Mar 2011222
Feb 2011241
Jan 2011236
Dec 2010184
Nov 2010266
Oct 2010240
Sep 2010279
Aug 2010230
Jul 2010204
Jun 2010151
May 2010173
Apr 2010194
Mar 2010148
Feb 2010136
Jan 2010193
Dec 2009259
Nov 2009308
Oct 2009258
Sep 2009184
Aug 2009199
Jul 2009312
Jun 2009196
May 2009163
Apr 2009247
Mar 2009408
Feb 2009214
Jan 2009204
Dec 2008249
Nov 2008194
Oct 2008171
Sep 2008269
Aug 2008165
Jul 2008122
Jun 2008243
May 2008220
Apr 2008294
Mar 2008209
Feb 2008194
Jan 2008284
Dec 2007146
Nov 2007233
Oct 2007268
Sep 2007273
Aug 2007301
Jul 2007339
Jun 2007392
May 2007242
Apr 2007309
Mar 2007283
Feb 2007188
Jan 2007370
Dec 2006225
Nov 2006160
Oct 2006251
Sep 2006412
Aug 2006450
Jul 2006315
Jun 2006380
May 2006232
Apr 2006458
Mar 2006659
Feb 2006581
Jan 2006592
Dec 2005430
Nov 2005398
Oct 2005304
Sep 2005404
Aug 2005278
Jul 2005342
Jun 2005216
May 2005151
Apr 2005220
Mar 2005167