continuum-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Murali Mohan (JIRA)" <j...@codehaus.org>
Subject [jira] (CONTINUUM-2704) Shell builds are not executing concurrently
Date Fri, 01 Mar 2013 14:53:52 GMT

    [ https://jira.codehaus.org/browse/CONTINUUM-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=320673#comment-320673
] 

Murali Mohan commented on CONTINUUM-2704:
-----------------------------------------

Log analysis and some observations:
==================================

The continuum logs when 2 shell builds attempt to run in parallel, is given below. Lines with
"MURALI:" are inserted manually by me to label what is happening, in my understanding.

The last log statement before the second build gets stuck is:
2013-03-01 13:59:40,825 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Performing action execute-builder

The logs from the DefaultShellCommandHelper is missing. This means that the second build is
not even reaching the DefaultShellCommandHelper. This should confirm that this is a continuum
bug and not related to my installation setup.

Logs:
=========

*****MURALI: 1st build STart ******

2013-03-01 13:58:50,534 [http-9000-Processor16] INFO  org.apache.continuum.buildmanager.ParallelBuildsManager
 - Queueing prepare-build-project task 'org.apache.continuum.taskqueue.PrepareBuildProjectsTask@186'
to prepare-build queue.
2013-03-01 13:58:50,534 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Initializing prepare build
2013-03-01 13:58:50,559 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Starting prepare build of project: Cleandb_Backend_Maint
2013-03-01 13:58:50,598 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Purging existing working copy
2013-03-01 13:58:50,598 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action clean-working-directory
2013-03-01 13:58:53,149 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Updating working dir
2013-03-01 13:58:53,149 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action check-working-directory
2013-03-01 13:58:53,161 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action checkout-project
2013-03-01 13:58:53,278 [pool-13-thread-1] INFO  action#checkout-project  - Checking out project:
'Cleandb_Backend_Maint', id: '77' to '/home/continuum/continuumDirectories/trunk/working-directory/77'.
2013-03-01 13:58:53,293 [pool-13-thread-1] INFO  org.apache.continuum.scm.manager.Slf4jScmLogger
 - Executing: /bin/sh -c cd /home/continuum/continuumDirectories/trunk/working-directory &&
svn --username v963061 --password '*****' --non-interactive checkout http://labscvs.superpages.com:7151/BidCenter/bidcenter/branches/BC_72_MAINT
77
2013-03-01 13:58:53,293 [pool-13-thread-1] INFO  org.apache.continuum.scm.manager.Slf4jScmLogger
 - Working directory: /home/continuum/continuumDirectories/trunk/working-directory
2013-03-01 13:59:40,600 [pool-13-thread-1] INFO  action#checkout-project  - Checked out 2760
files.
2013-03-01 13:59:40,642 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Merging SCM results
2013-03-01 13:59:40,642 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Ending prepare build of project: Cleandb_Backend_Maint
2013-03-01 13:59:40,642 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Ending prepare build
2013-03-01 13:59:40,663 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action create-build-project-task
2013-03-01 13:59:40,738 [pool-13-thread-1] INFO  org.apache.continuum.buildmanager.ParallelBuildsManager
 - Project '77' - 'Cleandb_Backend_Maint' added to overall build queue 'MAINT_BACKEND_QUEUE'.
2013-03-01 13:59:40,739 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Initializing build
2013-03-01 13:59:40,758 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Starting build of Cleandb_Backend_Maint
2013-03-01 13:59:40,820 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - FreshBuild configured, building
2013-03-01 13:59:40,820 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Performing action update-project-from-working-directory
2013-03-01 13:59:40,822 [pool-7-thread-17] INFO  action#update-project-from-working-directory
 - Updating project 'Cleandb_Backend_Maint' from checkout.
2013-03-01 13:59:40,825 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Performing action execute-builder

*****1st build executing statements below ******
2013-03-01 13:59:41,000 [pool-7-thread-17] INFO  org.apache.continuum.utils.shell.DefaultShellCommandHelper
 - Executing: /bin/sh -c cd /home/continuum/continuumDirectories/trunk/working-directory/77
&& cleandb2Continuum_maint_backend.sh
2013-03-01 13:59:41,000 [pool-7-thread-17] INFO  org.apache.continuum.utils.shell.DefaultShellCommandHelper
 - Working directory: /home/continuum/continuumDirectories/trunk/working-directory/77
2013-03-01 13:59:54,771 [http-9000-Processor23] INFO  org.apache.continuum.buildmanager.ParallelBuildsManager
 - Queueing prepare-build-project task 'org.apache.continuum.taskqueue.PrepareBuildProjectsTask@198'
to prepare-build queue.

*****MURALI: 2nd build start ******
2013-03-01 13:59:54,799 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Initializing prepare build
2013-03-01 13:59:54,823 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Starting prepare build of project: Cleandb_Backend_trunk
2013-03-01 13:59:54,874 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Updating working dir
2013-03-01 13:59:54,874 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action check-working-directory
2013-03-01 13:59:54,875 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action update-working-directory-from-scm
2013-03-01 13:59:54,968 [pool-13-thread-1] INFO  action#update-working-directory-from-scm
 - Updating project: Cleandb_Backend_trunk', id: '76' to '/home/continuum/continuumDirectories/trunk/working-directory/76'.
v963061 --password '*****' --non-interactive update /home/continuum/continuumDirectories/trunk/working-directory/76
2013-03-01 13:59:54,970 [pool-13-thread-1] INFO  org.apache.continuum.scm.manager.Slf4jScmLogger
 - Working directory: /home/continuum/continuumDirectories/trunk/working-directory/76
2013-03-01 13:59:57,887 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Merging SCM results
2013-03-01 13:59:57,887 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Ending prepare build of project: Cleandb_Backend_trunk
2013-03-01 13:59:57,887 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Ending prepare build
2013-03-01 13:59:57,944 [pool-13-thread-1] INFO  org.apache.maven.continuum.scm.queue.PrepareBuildProjectsTaskExecutor
 - Performing action create-build-project-task
2013-03-01 13:59:57,962 [pool-13-thread-1] INFO  org.apache.continuum.buildmanager.ParallelBuildsManager
 - Project '76' - 'Cleandb_Backend_trunk' added to overall build queue 'TRUNK_BACKEND_QUEUE'.
2013-03-01 13:59:57,962 [pool-5-thread-16] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Initializing build
2013-03-01 13:59:57,980 [pool-5-thread-16] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Starting build of Cleandb_Backend_trunk
2013-03-01 13:59:58,009 [pool-5-thread-16] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - AlwaysBuild configured, building
2013-03-01 13:59:58,009 [pool-5-thread-16] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Performing action update-project-from-working-directory
2013-03-01 13:59:58,011 [pool-5-thread-16] INFO  action#update-project-from-working-directory
 - Updating project 'Cleandb_Backend_trunk' from checkout.
2013-03-01 13:59:58,014 [pool-5-thread-16] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Performing action execute-builder

*****MURALI: 2nd build executing statements MISSING FOR SOME TIME, it is waiting for 1st build
to finish ******
2013-03-01 14:01:20,730 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:01:20,836 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:01:20,845 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:01:20,861 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:01:20,879 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:01:20,879 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:01:20,879 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'removePrepareBuildEntries.action' in namespace:
''. Form action defaulting to 'action' attribute's literal value.
2013-03-01 14:01:20,879 [http-9000-Processor16] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'removePrepareBuildEntries.action' in namespace:
''. Form action defaulting to 'action' attribute's literal value.
2013-03-01 14:01:54,204 [pool-7-thread-17] INFO  org.apache.maven.continuum.execution.shell.ShellBuildExecutor
 - Exit code: 0

*****MURALI: 2nd build executing statements NOW, after 1st build ends ******
2013-03-01 14:01:54,206 [pool-5-thread-16] INFO  org.apache.continuum.utils.shell.DefaultShellCommandHelper
 - Executing: /bin/sh -c cd /home/continuum/continuumDirectories/trunk/working-directory/76
&& cleandb2Continuum_trunk_backend.sh
2013-03-01 14:01:54,206 [pool-5-thread-16] INFO  org.apache.continuum.utils.shell.DefaultShellCommandHelper
 - Working directory: /home/continuum/continuumDirectories/trunk/working-directory/76
2013-03-01 14:01:54,484 [pool-7-thread-17] INFO  org.apache.maven.continuum.buildcontroller.DefaultBuildController
 - Performing action deploy-artifact
2013-03-01 14:02:21,697 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:02:21,699 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:02:21,699 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:02:21,700 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:02:21,700 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:02:21,700 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'none' in namespace: ''. Form action defaulting
to 'action' attribute's literal value.
2013-03-01 14:02:21,700 [http-9000-Processor23] WARN  org.apache.struts2.components.Form 
- No configuration found for the specified action: 'removePrepareBuildEntries.action' in namespace:
''. Form action defaulting to 'action' attribute's literal value.
2013-03-01 14:02:21,700 [http-9000-Processor23] WARN  org.apache.s




                
> Shell builds are not executing concurrently
> -------------------------------------------
>
>                 Key: CONTINUUM-2704
>                 URL: https://jira.codehaus.org/browse/CONTINUUM-2704
>             Project: Continuum
>          Issue Type: Bug
>          Components: Parallel Builds
>    Affects Versions: 1.3.8
>         Environment: Ubuntu, Tomcat
>            Reporter: Murali Mohan
>
> Continuum version 1.3.6. Deployed on Tomcat in Ubuntu.
> I have 2 projects, say A and B. Each has shell builds defined and set to run in different
queues. Number of parallel builds is set to 4.
> The problem is that, when the shell build from A runs, it will not execute the build
until the shell build from B is complete. it is almost  like A is waiting for B to finish.
Please note that maven builds are happily running in parallel in these 2 queues. It is only
the shell build that has a problem.
> To be sure that this is not an OS level problem, I started the build in B from Continuum
and ran the shell script for A from command line and it worked fine - both ran in parallel.
So, I think Continuum has a bottle neck somewhere. please help.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message