infra-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Munteanu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (INFRA-17485) Consistently failing organisation scan log
Date Fri, 21 Dec 2018 16:04:00 GMT
Robert Munteanu created INFRA-17485:
---------------------------------------

             Summary: Consistently failing organisation scan log
                 Key: INFRA-17485
                 URL: https://issues.apache.org/jira/browse/INFRA-17485
             Project: Infrastructure
          Issue Type: Bug
          Components: Jenkins
            Reporter: Robert Munteanu


We've started setting up our Jenkins builds as part of a GitHub org folder - https://builds.apache.org/job/Sling%20(pipeline%20jobs)/
. However, we see that the scans fail consistently after 10-15 pages

ERROR: [Fri Dec 21 15:45:06 UTC 2018] Could not fetch sources from navigator org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator@10be6c99
org.kohsuke.github.GHException: Failed to retrieve https://api.github.com/organizations/47359/repos?per_page=0&page=13
	at org.kohsuke.github.Requester$PagingIterator.fetch(Requester.java:521)
	at org.kohsuke.github.Requester$PagingIterator.hasNext(Requester.java:486)
	at org.kohsuke.github.PagedIterator.fetch(PagedIterator.java:44)
	at org.kohsuke.github.PagedIterator.hasNext(PagedIterator.java:32)
	at org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:962)
	at jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:458)
	at com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:276)
	at com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:165)
	at jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:910)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
[Fri Dec 21 15:45:06 UTC 2018] Finished organization scan. Scan took 38 sec
FATAL: Failed to recompute children of Sling Pipeline Jobs
org.kohsuke.github.GHException: Failed to retrieve https://api.github.com/organizations/47359/repos?per_page=0&page=13
	at org.kohsuke.github.Requester$PagingIterator.fetch(Requester.java:521)
	at org.kohsuke.github.Requester$PagingIterator.hasNext(Requester.java:486)
	at org.kohsuke.github.PagedIterator.fetch(PagedIterator.java:44)
	at org.kohsuke.github.PagedIterator.hasNext(PagedIterator.java:32)
	at org.jenkinsci.plugins.github_branch_source.GitHubSCMNavigator.visitSources(GitHubSCMNavigator.java:962)
	at jenkins.branch.OrganizationFolder.computeChildren(OrganizationFolder.java:458)
	at com.cloudbees.hudson.plugins.folder.computed.ComputedFolder.updateChildren(ComputedFolder.java:276)
	at com.cloudbees.hudson.plugins.folder.computed.FolderComputation.run(FolderComputation.java:165)
	at jenkins.branch.OrganizationFolder$OrganizationScan.run(OrganizationFolder.java:910)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
Finished: FAILURE

There is no indication of what the root cause of the error is. We have considered rate limits,
but Github says we are fine

$ http --auth rombert:XXXXXX https://api.github.com/rate_limit
(snip)

{
    "rate": {
        "limit": 5000, 
        "remaining": 4715, 
        "reset": 1545410340
    }, 
    "resources": {
        "core": {
            "limit": 5000, 
            "remaining": 4715, 
            "reset": 1545410340
        }, 
        "graphql": {
            "limit": 5000, 
            "remaining": 5000, 
            "reset": 1545411571
        }, 
        "search": {
            "limit": 30, 
            "remaining": 30, 
            "reset": 1545408031
        }
    }
}

There seems to be some sort of event delivery via webhooks ( https://builds.apache.org/job/Sling%20(pipeline%20jobs)/computation/events
) but Sling projects are not included.

That would be a convenient workaround for us, but if it's something INFRA needs to manage
then it's probably a no-go since we have 200+ github repos and we create new ones from time
to time.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message