manifoldcf-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erlend Garåsen <e.f.gara...@usit.uio.no>
Subject Re: Timeout problems with web crawling
Date Tue, 23 Apr 2013 12:02:44 GMT
On 23.04.13 13.48, Erlend Garåsen wrote:

> -bash-3.2$ curl -vvv -H "User-Agent: Mozilla/5.0
> (ApacheManifoldCFWebCrawler; sok-core@usit.uio.no)"
> "http://www.ibsen.uio.no/REGINFO_peAGa.xhtml?bokstav=G|1366644879398+299979"

A small typo in the URL, so the correct command is:
curl -vvv -H "User-Agent: Mozilla/5.0 (ApacheManifoldCFWebCrawler; 
sok-core@usit.uio.no)" 
"http://www.ibsen.uio.no/REGINFO_peAGa.xhtml?bokstav=G"

But same result. An immediate response.

Erlend

-- 
Erlend Garåsen
Center for Information Technology Services
University of Oslo
P.O. Box 1086 Blindern, N-0317 OSLO, Norway
Ph: (+47) 22840193, Fax: (+47) 22852970, Mobile: (+47) 91380968, VIP: 31050

Mime
View raw message