Return-Path: Delivered-To: apmail-perl-docs-dev-archive@perl.apache.org Received: (qmail 53821 invoked by uid 500); 3 Mar 2002 14:26:00 -0000 Mailing-List: contact docs-dev-help@perl.apache.org; run by ezmlm Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: Delivered-To: mailing list docs-dev@perl.apache.org Received: (qmail 53809 invoked from network); 3 Mar 2002 14:26:00 -0000 To: Bill Moseley Cc: Stas Bekman , docs-dev@perl.apache.org Subject: Re: status update References: <3.0.3.32.20020302094922.02d57d50@pop3.hank.org> <3.0.3.32.20020302200629.0310e5bc@pop3.hank.org> From: merlyn@stonehenge.com (Randal L. Schwartz) Date: 03 Mar 2002 06:25:53 -0800 In-Reply-To: <3.0.3.32.20020302200629.0310e5bc@pop3.hank.org> Message-ID: Lines: 22 User-Agent: Gnus/5.0808 (Gnus v5.8.8) Emacs/20.3 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Spam-Rating: daedalus.apache.org 1.6.2 0/1000/N >>>>> "Bill" == Bill Moseley writes: Bill> It takes a while (on my machine instead of indexing the site in Bill> less then a minute it takes about 18 minutes to check all the Bill> links. Bill> Some don't make much sense, check out the www.modperl.com Bill> error?? -- I'll look into it next week. Again, it's just doing Bill> simple HEAD requests with LWP. Clearly a lot of those work in Bill> browsers, but they are returning errors here. If you need a decent spidering linkchecker with more tweaking configuration settings and parallel processing power than is reasonable (:-), check , downloadable from . It retries bad "HEAD" requests as "GET", for example. -- Randal L. Schwartz - Stonehenge Consulting Services, Inc. - +1 503 777 0095 Perl/Unix/security consulting, Technical writing, Comedy, etc. etc. See PerlTraining.Stonehenge.com for onsite and open-enrollment Perl training! --------------------------------------------------------------------- To unsubscribe, e-mail: docs-dev-unsubscribe@perl.apache.org For additional commands, e-mail: docs-dev-help@perl.apache.org