infra-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hoss Man (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (INFRA-16082) curl/scripts getting connection refused from builds.apache.org -- auto banned?
Date Thu, 22 Feb 2018 18:33:00 GMT

    [ https://issues.apache.org/jira/browse/INFRA-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373226#comment-16373226
] 

Hoss Man commented on INFRA-16082:
----------------------------------


> Thanks for the doc pointer -- I will read up on the tree & depth params and try to
make 
> the neccessary changes today -- although it looks like my laptop / home network has also

> been blocked? I can't even load this URL from the link you provided in my browser to
figure 
> out what exactly those options do... 

I used a diff jenkins server to read up on the details & experimented with the options,
and i think i've got everything fixed up so that all "/api/" URLs will incude either a depth
or tree param -- allthough i'm not 100% sure if the requests for the RSS or consoleText feeds
will be a problem?  (they don't seem to support the depth/tree options, so i assume hitting
them doesn't trigger any auto-ban?)

Here's examples of the types of URLs my script(s) should be hitting now...

Once per run...
https://builds.apache.org/view/L/view/Lucene/rssAll
Once per new job in the feed...
https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-Tests-master/2356//api/xml?depth=0
Once per job where tests were run...
https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-Tests-master/2356//testReport/api/xml?tree=suites%5Bcases%5BclassName,name,status%5D%5D
Once per job where any tests failed...
https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-Tests-master/2356//consoleText

Chris: Do you see any problems with those URLs?  If not, then if you can please remove 173.236.224.109
& 73.24.207.196 from the ban list I can test this out but we should be all good.

Thanks for your help and the doc pointers.



> curl/scripts getting connection refused from builds.apache.org -- auto banned?
> ------------------------------------------------------------------------------
>
>                 Key: INFRA-16082
>                 URL: https://issues.apache.org/jira/browse/INFRA-16082
>             Project: Infrastructure
>          Issue Type: Task
>          Components: Jenkins
>            Reporter: Hoss Man
>            Assignee: Chris Lambertus
>            Priority: Major
>
> I've been working on a "planet venus + custom scripts" setup for archiving information
about failed jenkins builds for the lucene/solr project, and it appears that i may have been
auto-blocked by builds.apache.org.
> full details on my scripts can be found in this github repo...
>   https://github.com/hossman/jenkins-reports/
> ...but in a nutshell: the planet.py script first fetches https://builds.apache.org/view/L/view/Lucene/rssAll
; then some subsequent custom scripts attempts to download the XML summary of each job;  if
a job says it ran tests: then download the test report xml file; and if the test report says
there were failures: then download the full console logs ... all via URLs like these...
> https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-Tests-master/2356//api/xml
> https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-Tests-master/2356//testReport/api/xml
> https://builds.apache.org/view/L/view/Lucene/job/Lucene-Solr-Tests-master/2356//consoleText
> However, it appears that something in the ASF network stack may have auto-blocked my
IP?  Both the planet.py logs and my curl commands seem to indicate a failure to connect to
the port.
> Here's what a (manual) verbose curl says when i try running it from the server where
i have these scripts setup (fucit.org) ...
> $ nslookup fucit.org
> Server:		127.0.1.1
> Address:	127.0.1.1#53
> Non-authoritative answer:
> Name:	fucit.org
> Address: 173.236.224.12
> $ ssh fucit.org
> hossman@william-whipple:~$ curl -o tmp.xml -D - --verbose https://builds.apache.org/view/L/view/Lucene/rssAll
> * Hostname was NOT found in DNS cache
>   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
>                                  Dload  Upload   Total   Spent    Left  Speed
>   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0*   Trying
62.210.60.235...
> * connect to 62.210.60.235 port 443 failed: Connection refused
> * Failed to connect to builds.apache.org port 443: Connection refused
> * Closing connection 0
> curl: (7) Failed to connect to builds.apache.org port 443: Connection refused



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message