nutch-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From <ogjunk-nu...@yahoo.com>
Subject OT: Looksmar,: fix your User-Agent
Date Sun, 01 May 2005 17:03:30 GMT
Hello,

I remember seeing somebody from Looksmart post here once, so here is
something for Looksmart.  It looks like Looksmart is using Nutch, but
with a default User Agent name and Nutch's old, default email address:


64.242.88.10 - - [01/May/2005:12:22:04 -0400] "GET / HTTP/1.0" 302 266
"-" "NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html;
nutch-agent@lists.sourceforge.net)"

$ nslookup  64.242.88.10

Non-authoritative answer:
10.88.242.64.in-addr.arpa       name = sv-crawl.looksmart.com.

Otis
____________________________________________________________________
Simpy -- simpy.com -- tags, social bookmarks, personal search engine


Mime
View raw message