Return-Path: X-Original-To: apmail-infrastructure-dev-archive@minotaur.apache.org Delivered-To: apmail-infrastructure-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0F4D710DE6 for ; Mon, 24 Nov 2014 15:38:46 +0000 (UTC) Received: (qmail 49266 invoked by uid 500); 24 Nov 2014 15:38:45 -0000 Delivered-To: apmail-infrastructure-dev-archive@apache.org Received: (qmail 49147 invoked by uid 500); 24 Nov 2014 15:38:45 -0000 Mailing-List: contact infrastructure-dev-help@apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: infrastructure-dev@apache.org Delivered-To: mailing list infrastructure-dev@apache.org Received: (qmail 49136 invoked by uid 99); 24 Nov 2014 15:38:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Nov 2014 15:38:45 +0000 X-ASF-Spam-Status: No, hits=0.3 required=10 tests=RCVD_IN_DNSWL_LOW,SPF_SOFTFAIL X-Spam-Check-By: apache.org Received-SPF: softfail (nike.apache.org: transitioning domain of adc@toolazydogs.com does not designate 209.85.192.176 as permitted sender) Received: from [209.85.192.176] (HELO mail-pd0-f176.google.com) (209.85.192.176) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 24 Nov 2014 15:38:19 +0000 Received: by mail-pd0-f176.google.com with SMTP id y10so9968905pdj.21 for ; Mon, 24 Nov 2014 07:38:18 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:content-transfer-encoding:message-id:references:to; bh=RZUQgfHn+3koi2zHg+Gy5fTJ0IMTIj8bJL/xDsnf93A=; b=fPwqjri6f9qKvmJTPiDveBjU3YJPfplJt0ERmUaAmpyJuObCabc22/+hPj6WDu0T0c 4hg0y30VaEUWAVwZBfyi1QViA4E4ZJwPbGv3syJymuVGFk8N/PxcoCigNImpcQfUIKjM VQGl+373B2AXwrPbu59v8+5AL+76JohnW/QBKJxIpBrPf0d1OIsmeETMpfGPIq97OxmS WcdYG5wiKWNGYj9u9rfqc1N123eInNpzkaMZN0xpfAwPSZWSqcYMs0GwUx1Wp2s2uowi M0yfgWtu7jWWhij8qz0K/s/zVNop56WV2o0WUeAFkx4QGszVHC0D4QHmmB7HjL1YNzcU YfxQ== X-Gm-Message-State: ALoCoQljtyv76yGkDR/uWZzu60O2FkN7IroN97WW734GzJRiUwCFVlp+s46GxqjBc+swqW6XaKqS X-Received: by 10.66.142.166 with SMTP id rx6mr34781499pab.33.1416843498302; Mon, 24 Nov 2014 07:38:18 -0800 (PST) Received: from acabrera-mn.linkedin.biz (dagmar1.corp.linkedin.com. [69.28.149.129]) by mx.google.com with ESMTPSA id is15sm12704882pbd.87.2014.11.24.07.38.16 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 24 Nov 2014 07:38:17 -0800 (PST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Apache mirror information From: "Alan D. Cabrera" In-Reply-To: Date: Mon, 24 Nov 2014 07:38:15 -0800 Content-Transfer-Encoding: quoted-printable Message-Id: <75A21861-AF00-481E-90F5-6CF71AA13F11@toolazydogs.com> References: <78608946-E716-4A07-B8A4-40CE5A51BE64@toolazydogs.com> <4610F933-845C-4A0F-B81F-D5E5A41938EB@toolazydogs.com> To: infrastructure-dev@apache.org X-Mailer: Apple Mail (2.1878.6) X-Virus-Checked: Checked by ClamAV on apache.org Nice! Thanks! Regards, Alan On Nov 23, 2014, at 4:43 PM, Alex Harui wrote: > Have you tried the asjson=3Dtrue URL parameter? For some URL that = uses > http://www.a.o/dyn/mirrors/mirrors.cgi appending that parameter will > return JSON instead of HTML. >=20 > -Alex >=20 > On 11/23/14, 7:00 AM, "Alan D. Cabrera" wrote: >=20 >> That seems to be a general description of what I already know. >>=20 >> Let me restate my question. :) >>=20 >> I need to write a python library that can find all the mirrors that = have >> distributions for a specific project. How can I do that without = scraping >> HTML? >>=20 >>=20 >> Regards, >> Alan >>=20 >>=20 >> On Nov 23, 2014, at 6:49 AM, Tony Stevenson wrote: >>=20 >>> Alan, >>>=20 >>> The system is quite simple. All mirrors who are in sync carry all >>> projects >>> except AOO. Only a subset carry this project. SF carry AOO and thus = the >>> majority of its downloads. >>>=20 >>> On Sunday, 23 November 2014, Alan D. Cabrera >>> wrote: >>>=20 >>>> Is there a document on how the Apache mirror system works? More >>>> specifically, what I=92d like to do is given a particular project, = find >>>> the >>>> mirrors that have distributions for that project. >>>>=20 >>>> I don=92t wish the scrape HTML pages. >>>>=20 >>>> Thanks! >>>>=20 >>>>=20 >>>> Regards, >>>> Alan >>>>=20 >>>>=20 >>>=20 >>> --=20 >>> Cheers, >>> Tony >>>=20 >>> ---------------------------------- >>> Tony Stevenson >>>=20 >>> tony@pc-tony.com >>> pctony@apache.org >>>=20 >>> http://www.pc-tony.com >>>=20 >>> GPG - 1024D/51047D66 >>> ---------------------------------- >>=20 >=20