www-infrastructure-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Henk Penning (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (INFRA-10859) Allow rsync to list entire contents of dist area
Date Wed, 02 Dec 2015 06:49:10 GMT

    [ https://issues.apache.org/jira/browse/INFRA-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035377#comment-15035377

Henk Penning commented on INFRA-10859:

>  They [.revision files] are very small, and could prove useful in checking how up to
date a mirror is.

They could, but they are not ; and as they are not, they are crap.
Also, sometimes all .revision files change, sometimes not ;
So, even for diagnostics that makes them pretty useless.

Also, for someone who maintains a mirror, .revision files are very anoying.
I see all my mirror's rsync-update-output, and the real changes are
often hidden in the flood of .revision file changes.

Can the .revision files please be excluded for the mirrors ?


> Allow rsync to list entire contents of dist area
> ------------------------------------------------
>                 Key: INFRA-10859
>                 URL: https://issues.apache.org/jira/browse/INFRA-10859
>             Project: Infrastructure
>          Issue Type: Improvement
>          Components: Mirrors, Website
>         Environment: ASF mirror hosts
>            Reporter: Sebb
> The ASF mirror hosts has an rsync module which allows most of the contents of the /www/www.apache.org/dist
area to be listed. However some files such as hashes, sigs, and the KEYS files are intentionally
excluded from the module.
> It would be useful to be able to list all the contents of the directory structure.
> It is obviously possible to scrape the web pages, but that is time-consuming, fragile
and uses more resources. Likewise, using SVN to list the folder structure is time consuming,
and it does not show the actual contents which will generally be different (e.g. the .revision
files are not in SVN)
> There is a module that allows listing all the files on minotaur, but it looks like the
module has either not been configured or it disallows listing on the ASF mirror hosts.
> Note: the incubator clutch tool currently relies on being able to list the incubator
files, including the KEYS and sig files. These don't appear in the standard rsync listings,
so the code relies on using find as a cron job on minotaur.

This message was sent by Atlassian JIRA

View raw message