infra-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Potiuk (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (INFRA-18657) Travis CI builds wait for hours in queued state
Date Wed, 03 Jul 2019 03:39:00 GMT

    [ https://issues.apache.org/jira/browse/INFRA-18657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16877451#comment-16877451
] 

Jarek Potiuk edited comment on INFRA-18657 at 7/3/19 3:38 AM:
--------------------------------------------------------------

Hello Can you please help with that. 

It happens again and it is much worse than that. The Travis "execution time" does not take
into account the time it takes for the job in the queue. 

Just to give very concrete example: I submitted this PR https://github.com/apache/airflow/pull/5518
yesterday at 23:00 CET
When I did it - we had few PR waiting in a queue and not being executed on Travis the build
was https://travis-ci.org/apache/airflow/builds/553457518 appeared pretty immediately in Travis
CI but then it took 6 HOURS (!) for it to execute. When I woke up at 5:20 it just finished
execution. Even if execution time on Travis shows (totally wrongly) 1 hr 49 minutes. You can
clearly see that from the PR history.

So build times in Travis are not showing queuing time and the problem is much worse than you
thought it is.

This happens more and more and the delays are longer and longer. And it delays our release
process heavily (we are now at 1.10.4 RC2 and heading for official 1.10.4 soon). [~ash] -
maybe you can share your experience here as well.

Can we get some insight about some real options that we can have to improve the situation?








was (Author: higrys):
Hello Can you please help with that. 

It happens again and it is much worse than that. The Travis "execution time" does not take
into account the time it takes for the job in the queue. 

Just to give very concrete example: I submitted this PR https://github.com/apache/airflow/pull/5518
yesterday at 23:00 CET
When I did it we had few PR waiting in a queue and not being executed on Travis the build
was https://travis-ci.org/apache/airflow/builds/553457518 appeared pretty immediately in Travis
CI but then it took 6 HOURS (!) for it to execute - even if execution time on Travis shows
1 hr 49 minutes. You can clearly see that from the PR history.

This happens more and more and the delays are longer and longer. And it delays our release
process heavily (we are now at 1.10.4 RC2 and heading for official 1.10.4 soon). [~ash] -
maybe you can share your experience here as well.

Can we get some insight about some real options that we can have to improve the situation?







> Travis CI builds wait for hours in queued state
> -----------------------------------------------
>
>                 Key: INFRA-18657
>                 URL: https://issues.apache.org/jira/browse/INFRA-18657
>             Project: Infrastructure
>          Issue Type: Bug
>          Components: CI
>            Reporter: Jarek Potiuk
>            Assignee: Chris Thistlethwaite
>            Priority: Major
>
> During the last few days our Travis builds are waiting in a queue for hours before they
actually start. For example build https://travis-ci.org/apache/airflow/builds/550886398 was
submitted 4 hours ago but it is in "Job Received" state till now. It happens with every single
build now for the last two days. I believe it has something to do with a number of parallel
builds for the whole Apache organisation.
> Can we please fix it somehow?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message