lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject Re: Crawl Anywhere -
Date Mon, 11 Feb 2013 00:27:24 GMT
Have you looked at nutch?


On Fri, Feb 8, 2013 at 12:25 AM, SivaKarthik
<sivakarthik.kpaiya@gmail.com>wrote:

> Hi All,
>  in our project, we need to download around millions of pages...
>  so is there any support to do the crawling in distributed environment
> using
> crawl-anywhere apps?
>   or wat could be the alternatives...?
>
>  Thanks in advance..
>
>
>
>
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/ANNOUNCE-Web-Crawler-tp2607831p4039172.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message