Mailing-List: contact repository-help@apache.org; run by ezmlm
Precedence: bulk
Reply-To: repository@apache.org
Received-SPF: pass (nike.apache.org: domain of fmeschbe@gmail.com designates
 209.85.161.178 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=subject:from:to:in-reply-to:references:content-type:date:message-id
         :mime-version:x-mailer:content-transfer-encoding;
        b=R0xyFfgMQOw7OFnJfMT1fwc4CZQveZmv9bciQa5p9ZXmN2R+4QWK905qzTfvGpwlzj
         kLHhpxNa4VFzUfau1AweNbD19hQepKuMBXKrvdFRs2/ehCMfIy1hxDIxHxHaau6CbPAp
         c5nJvDnbOW8BuEjQS7q3iQBNozBOng6tGZdpQ=
Subject: Re: Changes on repository.apache.org?
From: Felix Meschberger <fmeschbe@gmail.com>
To: repository@apache.org
In-Reply-To: <AANLkTi=QuE5d568nL9_dZxBvGWPcPDTTKyU8Y8Gf3BHU@mail.gmail.com>
References: <4D70936A.2050208@apache.org> <1299232934.2691.2.camel@meschbix>
	 <AANLkTi=QuE5d568nL9_dZxBvGWPcPDTTKyU8Y8Gf3BHU@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"
Date: Fri, 04 Mar 2011 11:25:10 +0100
Message-ID: <1299234310.2691.3.camel@meschbix>
Mime-Version: 1.0
Content-Transfer-Encoding: 7bit

Hi,

Am Freitag, den 04.03.2011, 10:11 +0000 schrieb Stuart McCulloch:
> On 4 March 2011 10:02, Felix Meschberger <fmeschbe@gmail.com> wrote:
>         Hi,
>         
>         Some more background: These scripts use wget to download the
>         release
>         candidate. According to the wget man page wget respects
>         robots.txt 
> 
> 
> FWIW you could add the following line to your local ~/.wgetrc
> 
> 
>    robots=off
> 
> 
> this tells wget to ignore robots.txt - the script should then work

Thanks for the hint. Carsten found this out, too, and it works indeed.

Regards
Felix

>  
>         which in turn contains:
>         
>         > User-agent: *
>         > Disallow: /content/
>         > Disallow: /service/
>         > Allow: /
>         > Allow: /content/sites/
>         
>         Could it be that this prevents wget from working and that
>         robots.txt has
>         recently been changed (IIRC I could get a RC with the scripts
>         on
>         Monday).
>         
>         Thanks and Regards
>         Felix
>         
>         
>         Am Freitag, den 04.03.2011, 08:23 +0100 schrieb Carsten
>         Ziegeler: 
>         
>         > Hi,
>         >
>         > in the Felix and Sling project we use a script to download
>         artifacts
>         > from the staging repository to verify the releases.
>         > It stopped working at some point this week.
>         >
>         > The script uses wget and fetches index.html and traverses
>         the links of
>         > this html page recursively. It seems that now index.html is
>         not
>         > available anymore.
>         >
>         > While
>         >
>         https://repository.apache.org/content/repositories/orgapachefelix-003/org/apache/felix/
>         > returns the html
>         >
>         https://repository.apache.org/content/repositories/orgapachefelix-003/org/apache/felix/index.html
>         >
>         > does not.
>         >
>         > Is anyone aware of any changes here? Can we restore the old
>         behaviour?
>         > Or does someone know how to instruct wget to not append
>         index.html (I
>         > couldn't figure it out)
>         >
>         > Regards
>         > Carsten
>         
>         
>         
> 
> 
> 
> -- 
> Cheers, Stuart