www-infrastructure-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebb (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (INFRA-5096) Discrepancies between minotaur and EU/US mirrors
Date Sat, 28 Jul 2012 12:07:35 GMT

    [ https://issues.apache.org/jira/browse/INFRA-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13424324#comment-13424324
] 

Sebb commented on INFRA-5096:
-----------------------------

I see.

==

My test files and directories in zzz have been copied across. 
The files copied OK, but the directories have got incorrect permissions.

Here is the source listing on minotaur:

pwd ~ : ls -laR /www/www.apache.org/dist/zzz
total 33
drwxr-sr-x    5 apmirror  apmirror   15 Jul 28 12:48 .
drwxrwsr-x  117 apbackup  svnwc     123 Jul 24 19:39 ..
-rw-r--r--    1 apmirror  apmirror   30 Jul 27 10:41 HEADER
-rw-r--r--    1 apmirror  apmirror   64 Jul 26 12:00 HEADER.html
-rw-r--r--    1 apmirror  apmirror   34 Jul 27 10:41 HEADER.txt
-rw-r--r--    1 apmirror  apmirror   30 Jul 27 10:40 README
-rw-r--r--    1 apmirror  apmirror   79 Jul 26 07:53 README.html
-rw-r--r--    1 apmirror  apmirror   34 Jul 27 10:41 README.txt
dr-xr-sr-x    2 apmirror  apmirror    5 Jul 26 12:05 dir555
drwxr-sr-x    2 apmirror  apmirror    5 Jul 26 12:04 dir755
drwxrwsr-x    2 apmirror  apmirror    5 Jul 26 12:04 dir775
-r--r--r--    1 apmirror  apmirror    0 Jul 26 12:01 file444
-rw-r--r--    1 apmirror  apmirror    0 Jul 26 12:01 file644
-rw-rw-r--    1 apmirror  apmirror    0 Jul 26 12:01 file664
-rw-r--r--    1 apmirror  apmirror   11 Jul 28 12:48 time.txt

/www/www.apache.org/dist/zzz/dir555:
total 8
dr-xr-sr-x  2 apmirror  apmirror   5 Jul 26 12:05 .
drwxr-sr-x  5 apmirror  apmirror  15 Jul 28 12:48 ..
-r--r--r--  1 apmirror  apmirror   0 Jul 26 12:05 file444
-rw-r--r--  1 apmirror  apmirror   0 Jul 26 12:05 file644
-rw-r--r--  1 apmirror  apmirror   0 Jul 26 12:05 file664

/www/www.apache.org/dist/zzz/dir755:
total 8
drwxr-sr-x  2 apmirror  apmirror   5 Jul 26 12:04 .
drwxr-sr-x  5 apmirror  apmirror  15 Jul 28 12:48 ..
-r--r--r--  1 apmirror  apmirror   0 Jul 26 12:04 file444
-rw-r--r--  1 apmirror  apmirror   0 Jul 26 12:04 file644
-rw-r--r--  1 apmirror  apmirror   0 Jul 26 12:04 file664

/www/www.apache.org/dist/zzz/dir775:
total 8
drwxrwsr-x  2 apmirror  apmirror   5 Jul 26 12:04 .
drwxr-sr-x  5 apmirror  apmirror  15 Jul 28 12:48 ..
-r--r--r--  1 apmirror  apmirror   0 Jul 26 12:04 file444
-rw-r--r--  1 apmirror  apmirror   0 Jul 26 12:04 file644
-rw-r--r--  1 apmirror  apmirror   0 Jul 26 12:04 file664

pwd ~ : rsync -r minotaur.apache.org::apache-dist/zzz/
drwxr-sr-x          15 2012/07/28 12:48:00 .
-rw-r--r--          30 2012/07/27 10:41:37 HEADER
-rw-r--r--          64 2012/07/26 12:00:23 HEADER.html
-rw-r--r--          34 2012/07/27 10:41:31 HEADER.txt
-rw-r--r--          30 2012/07/27 10:40:59 README
-rw-r--r--          79 2012/07/26 07:53:22 README.html
-rw-r--r--          34 2012/07/27 10:41:14 README.txt
-r--r--r--           0 2012/07/26 12:01:51 file444
-rw-r--r--           0 2012/07/26 12:01:38 file644
-rw-rw-r--           0 2012/07/26 12:01:45 file664
-rw-r--r--          11 2012/07/28 12:48:00 time.txt
dr-xr-sr-x           5 2012/07/26 12:05:22 dir555
-r--r--r--           0 2012/07/26 12:05:22 dir555/file444
-rw-r--r--           0 2012/07/26 12:05:22 dir555/file644
-rw-r--r--           0 2012/07/26 12:05:22 dir555/file664
drwxr-sr-x           5 2012/07/26 12:04:39 dir755
-r--r--r--           0 2012/07/26 12:04:39 dir755/file444
-rw-r--r--           0 2012/07/26 12:04:39 dir755/file644
-rw-r--r--           0 2012/07/26 12:04:39 dir755/file664
drwxrwsr-x           5 2012/07/26 12:04:43 dir775
-r--r--r--           0 2012/07/26 12:04:43 dir775/file444
-rw-r--r--           0 2012/07/26 12:04:43 dir775/file644
-rw-r--r--           0 2012/07/26 12:04:43 dir775/file664

pwd ~ : rsync -r eos.apache.org::apache-dist/zzz/
drwxr-xr-x          15 2012/07/28 11:48:00 .
-rw-r--r--          30 2012/07/27 10:41:37 HEADER
-rw-r--r--          64 2012/07/26 12:00:23 HEADER.html
-rw-r--r--          34 2012/07/27 10:41:31 HEADER.txt
-rw-r--r--          30 2012/07/27 10:40:59 README
-rw-r--r--          79 2012/07/26 07:53:22 README.html
-rw-r--r--          34 2012/07/27 10:41:14 README.txt
-r--r--r--           0 2012/07/26 12:01:51 file444
-rw-r--r--           0 2012/07/26 12:01:38 file644
-rw-rw-r--           0 2012/07/26 12:01:45 file664
-rw-r--r--          11 2012/07/28 11:48:00 time.txt
rsync: opendir "/zzz/dir555" (in apache-dist) failed: Permission denied (13)
rsync: opendir "/zzz/dir755" (in apache-dist) failed: Permission denied (13)
dr-x------           2 2012/07/26 12:05:22 dir555
rsync: opendir "/zzz/dir775" (in apache-dist) failed: Permission denied (13)
drwx------           5 2012/07/26 12:04:39 dir755
drwx------           5 2012/07/26 12:04:43 dir775
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1518)
[generator=3.0.9]

=====

i had hoped that these files would help test 3rd party mirroring - but it seems they have
also revealed an issue with our own mirror setup.

I don't understand why the directory permissions are not correctly copied.
                
> Discrepancies between minotaur and EU/US mirrors
> ------------------------------------------------
>
>                 Key: INFRA-5096
>                 URL: https://issues.apache.org/jira/browse/INFRA-5096
>             Project: Infrastructure
>          Issue Type: Bug
>      Security Level: public(Regular issues) 
>          Components: Mirrors
>            Reporter: Sebb
>            Priority: Minor
>         Attachments: mirrordiff.sh, mirrordiff.txt
>
>
> There seem to be a lot of discrepancies between the dist/ directory structure on minotaur,
and the same files on the US and EU mirrors.
> The US/EU mirrors have different protections for files under
> incubator/amber, directmemory,kafka, syncope
> For example:
> Difference between Minotaur and US mirror
> --- mi.dat	2012-07-27 17:02:19.634202580 +0100
> +++ us.dat	2012-07-27 17:02:19.767202284 +0100
> -drwxr-sr-x           3 incubator/amber
> +drwxr-xr-x           3 incubator/amber
> -drwxr-sr-x           4 incubator/directmemory
> +drwxrwxr-x           4 incubator/directmemory
> -drwxrwsr-x           6 incubator/directmemory/0.1-incubating
> +drwxr-xr-x           6 incubator/directmemory/0.1-incubating
> -drwxr-sr-x           5 incubator/kafka
> +drwxrwxr-x           5 incubator/kafka
> It may be relevant that these are all directories which have caused problems for external
mirrors.
> There are other differences; full listing to be attached.
> Also attaching the script used to create the output.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message