www-infrastructure-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Rowe (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (INFRA-9170) Downloading from people.apache.org is unreliable
Date Tue, 17 Feb 2015 16:17:13 GMT

    [ https://issues.apache.org/jira/browse/INFRA-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324368#comment-14324368
] 

Steve Rowe edited comment on INFRA-9170 at 2/17/15 4:16 PM:
------------------------------------------------------------

I recorded timestamps for download successes and failures from one run of the Lucene smoke
tester and compared them to entries in the web server log at /var/log/www/people_access_log.

There were 128 successful downloads and 17 failures.  That's a 12% failure rate.  Seems pretty
bad to me.

I see three patterns in the log:

1. Some requests seem to have been auto-retried from the client side with very little delay
- I see two successive requests with the same timestamp.  (I didn't count these among the
failures.)
2. Some requests were logged but the client timed out.
3. Some requests were never logged.

In cases #1 (only the first request) and #2, the user agent string is recorded as "-"; on
successful requests the user agent string was "Python-urllib/3.2".

I didn't find anything at all concerning any of the requests in the error log at /var/log/www/people_error_log.

Here are the details (">>" is local, "<<" is people_access_log):

**(edited to change "after exception" to "with exception" in local log messages)**

>> [17/Feb/2015:14:02:21 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:21 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
HTTP/1.1" 200 3174 "-" "-" - 80
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:02:32 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:14:02:44 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:44 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
HTTP/1.1" 200 3174 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:02:48 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:48 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
HTTP/1.1" 200 1514 "-" "-" - 80
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:02:58 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:59 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
HTTP/1.1" 200 1514 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:27:18 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:27:29 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:14:27:43 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 8
seconds between download attempts.

>> [17/Feb/2015:14:28:00 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:28:00 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
HTTP/1.1" 200 51 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:53:24 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:53:36 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:14:53:49 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 8
seconds between download attempts.

>> [17/Feb/2015:14:54:07 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:53:24 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.md5
HTTP/1.1" 200 53 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:55:33 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:55:45 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:14:55:59 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:55:59 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
HTTP/1.1" 200 842 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:57:34 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.asc
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.asc
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:57:46 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.asc
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:57:34 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.sha1
HTTP/1.1" 200 57 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:15:25 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:15:15:36 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:15:43 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
HTTP/1.1" 200 32 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:16:49 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:15:17:00 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:00 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
HTTP/1.1" 200 40 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:17:11 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:15:17:22 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:15:17:34 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:35 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
HTTP/1.1" 200 40 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:17:35 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-phonetic/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:35 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-phonetic/
HTTP/1.1" 200 1768 "-" "-" - 80
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:35 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-phonetic/
HTTP/1.1" 200 1768 "-" "Python-urllib/3.2" - 80
>> socket.error: [Errno 60] Operation timed out (exception halted program)



was (Author: steve_rowe):
I recorded timestamps for download successes and failures from one run of the Lucene smoke
tester and compared them to entries in the web server log at /var/log/www/people_access_log.

There were 128 successful downloads and 17 failures.  That's a 12% failure rate.  Seems pretty
bad to me.

I see three patterns in the log:

1. Some requests seem to have been auto-retried from the client side with very little delay
- I see two successive requests with the same timestamp.  (I didn't count these among the
failures.)
2. Some requests were logged but the client timed out.
3. Some requests were never logged.

In cases #1 (only the first request) and #2, the user agent string is recorded as "-"; on
successful requests the user agent string was "Python-urllib/3.2".

I didn't find anything at all concerning any of the requests in the error log at /var/log/www/people_error_log.

Here are the details (">>" is local, "<<" is people_access_log):

>> [17/Feb/2015:14:02:21 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:21 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
HTTP/1.1" 200 3174 "-" "-" - 80
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:02:32 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:14:02:44 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:44 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/
HTTP/1.1" 200 3174 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:02:48 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:48 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
HTTP/1.1" 200 1514 "-" "-" - 80
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:02:58 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:02:59 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/changes/
HTTP/1.1" 200 1514 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:27:18 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 2
seconds between download attempts.

>> [17/Feb/2015:14:27:29 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 4
seconds between download attempts.

>> [17/Feb/2015:14:27:43 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
failed with exception <urlopen error [Errno 60] Operation timed out> - pausing for 8
seconds between download attempts.

>> [17/Feb/2015:14:28:00 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:28:00 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/lucene/lucene-5.0.0.zip.md5
HTTP/1.1" 200 51 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:53:24 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
2 seconds between download attempts.

>> [17/Feb/2015:14:53:36 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
4 seconds between download attempts.

>> [17/Feb/2015:14:53:49 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
8 seconds between download attempts.

>> [17/Feb/2015:14:54:07 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.sha1
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:53:24 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0-src.tgz.md5
HTTP/1.1" 200 53 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:55:33 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
2 seconds between download attempts.

>> [17/Feb/2015:14:55:45 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
4 seconds between download attempts.

>> [17/Feb/2015:14:55:59 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:55:59 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.tgz.asc
HTTP/1.1" 200 842 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:14:57:34 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.asc
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.asc
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
2 seconds between download attempts.

>> [17/Feb/2015:14:57:46 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.asc
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:14:57:34 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987/solr/solr-5.0.0.zip.sha1
HTTP/1.1" 200 57 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:15:25 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
2 seconds between download attempts.

>> [17/Feb/2015:15:15:36 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:15:43 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-common/5.0.0/lucene-analyzers-common-5.0.0-sources.jar.md5
HTTP/1.1" 200 32 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:16:49 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
2 seconds between download attempts.

>> [17/Feb/2015:15:17:00 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:00 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-kuromoji/maven-metadata.xml.sha1
HTTP/1.1" 200 40 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:17:11 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
2 seconds between download attempts.

>> [17/Feb/2015:15:17:22 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
<< (no log entry)
>> Download of url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
failed after exception <urlopen error [Errno 60] Operation timed out> - pausing for
4 seconds between download attempts.

>> [17/Feb/2015:15:17:34 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:35 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-morfologik/maven-metadata.xml.sha1
HTTP/1.1" 200 40 "-" "Python-urllib/3.2" - 80

-------

>> [17/Feb/2015:15:17:35 +0000] downloading url http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-phonetic/
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:35 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-phonetic/
HTTP/1.1" 200 1768 "-" "-" - 80
<< people.apache.org 24.59.105.223 - - [17/Feb/2015:15:17:35 +0000] "GET /~anshum/staging_area/lucene-solr-5.0.0-RC3-rev1659987//lucene/maven/org/apache/lucene/lucene-analyzers-phonetic/
HTTP/1.1" 200 1768 "-" "Python-urllib/3.2" - 80
>> socket.error: [Errno 60] Operation timed out (exception halted program)


> Downloading from people.apache.org is unreliable
> ------------------------------------------------
>
>                 Key: INFRA-9170
>                 URL: https://issues.apache.org/jira/browse/INFRA-9170
>             Project: Infrastructure
>          Issue Type: Bug
>          Components: Other/Misc
>         Environment: HTTP GET
>            Reporter: Jan H√łydahl
>         Attachments: people_access_log.excerpt.txt
>
>
> We (the Lucene devs) are currently experiencing problems reliably downloading release
candiate artifacts hosted in {{people.apache.org}}. HTTP transfers will sometimes fail/time
out. Please see LUCENE-6231 for details.
> One way people (at least once) have been able to reproduce this is by doing a recursive
wget fetch such as:
> {code}
> wget -rm --no-parent http://people.apache.org/~anshum/staging_area/lucene-solr-5.0.0-RC2-rev1658469/
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message