cloudstack-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Min Chen (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CLOUDSTACK-4399) [Templates] template entries are deleted from template_store_ref when downloadTemplate times out
Date Mon, 19 Aug 2013 18:26:49 GMT

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744086#comment-13744086
] 

Min Chen edited comment on CLOUDSTACK-4399 at 8/19/13 6:26 PM:
---------------------------------------------------------------

Found the reason, fixed by commit 956b170126cbb5c6da15c41bad96425b7d4c183d. SystemVM template
should be automatically downloaded when you restart SSVM.
                
      was (Author: minchen07):
    Found the reason, fixed. SystemVM template should be automatically downloaded when you
restart SSVM.
                  
> [Templates] template entries are deleted from template_store_ref when downloadTemplate
times out
> ------------------------------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-4399
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4399
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: Management Server
>    Affects Versions: 4.2.0
>         Environment: commit id # 3c40e8bb3f6278f78c24c6317d513bd5ad599944
>            Reporter: venkata swamybabu budumuru
>            Assignee: Min Chen
>            Priority: Critical
>             Fix For: 4.2.0
>
>         Attachments: logs.tgz
>
>
> Steps to reproduce :
> 1. Have a latest CloudStack setup with at least 1 advanced zone
> 2. Add at least 1 KVM cluster.
> 3. Make sure systemVMs are up 
> 4. As a non-ROOT admin, deploy at least 1 User VM (which includes router) on this host.
> 5. Add another cluster of type XenServer
> Observations:
> (i) As soon as the host is added, it initiated systemVM template from download.cloud.com
which it taking quite longtime to download.
> (ii) when this download was at round 11%, did SSVM restart and then destroy operations
on SSVM.
> (iii) The above operation resulted in template download timeout as per mgmt server logs.
> 2013-08-19 16:04:22,136 DEBUG [storage.download.DownloadListener] (Timer-8:null) Scheduling
timeout at 30000 ms, TEMPLATE: 1 at host 2
> (iv) Before the timeout happened, I could see an entry for template :1 in template_store_ref
saying DOWNLOAD_IN_PROGRESS but, after timeout this entry is totally deleted from template_store_ref.
> 2013-08-19 16:04:33,386 DEBUG [storage.download.DownloadListener] (Timer-8:null) Send
command failed
> com.cloud.utils.exception.CloudRuntimeException: Unable to send message
>         at org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessageAsync(RemoteHostEndPoint.java:179)
>         at com.cloud.storage.download.DownloadListener.sendCommand(DownloadListener.java:187)
>         at com.cloud.storage.download.DownloadListener$StatusTask.run(DownloadListener.java:82)
>         at java.util.TimerThread.mainLoop(Timer.java:534)
>         at java.util.TimerThread.run(Timer.java:484)
> Caused by: com.cloud.exception.AgentUnavailableException: Resource [Host:2] is unreachable:
Host 2: Host with specified id is not in the right state: Disconnected
>         at com.cloud.agent.manager.ClusteredAgentManagerImpl.getAttache(ClusteredAgentManagerImpl.java:540)
>         at com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:526)
>         at org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessageAsync(RemoteHostEndPoint.java:177)
>         ... 4 more
> 2013-08-19 16:04:33,386 WARN  [storage.download.DownloadListener] (Timer-8:null) Unable
to monitor download progress of TEMPLATE: 1 at host 2
> 2013-08-19 16:04:33,387 DEBUG [storage.image.BaseImageStoreDriverImpl] (Timer-8:null)
Performing image store createTemplate async callback
> 2013-08-19 16:04:33,531 WARN  [storage.download.DownloadListener] (Timer-8:null) Entering
download error state because the storage host disconnected, TEMPLATE: 1 at host 2
> (v) After the above incident happened, there is no way that I could get the systemVM
template automatically downloaded. Have tried SSVM restart / SSVM destroy but nothing happened.
> Expected Result:
> ============
> - when timeout happens, it should set the state as "DOWNLOAD_ERROR" so that SSVM during
sync will be able to identify the situation and download it again.
> Few more additional observations:
> ========================
> (a) Observed the same issue with user templates as well. below is the quick way to reproduce
it
> - login as a non-ROOT domain user
> - registerTemplate from download.cloud.com
> - while the above download is in progress, keep performing a reboot followed by a destroy
SSVM so that download command timeout after 30 seconds.
> - After it time-out then check cloud.template_store_ref table and the above user template
entry completely disappears.
> Attaching all the required logs along with db dump to the bug.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message