cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Simon Weller <swel...@ena.com>
Subject Re: Unable to create a New VM - Error message: Unable to start instance due to Unable to get answer that is of class com.cloud.agent.api.StartAnswer
Date Thu, 17 Mar 2016 22:12:03 GMT
I'm assuming you have other VMs successfully running, correct? So you can write to your primary
storage.



________________________________________
From: Nezar Madbouh <nezar.madbouh@ipscape.com.au>
Sent: Thursday, March 17, 2016 4:43 PM
To: users@cloudstack.apache.org
Subject: Re: Unable to create a New VM - Error message: Unable to start instance due to Unable
to get answer that is of class com.cloud.agent.api.StartAnswer

Hi Simon and Shweta,

Please see the result below:

root@s-11-VM:~# /usr/local/cloud/systemvm/ssvm-check.sh
================================================
First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 48 data bytes
56 bytes from 8.8.8.8: icmp_seq=0 ttl=57 time=5.209 ms
56 bytes from 8.8.8.8: icmp_seq=1 ttl=57 time=0.936 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.936/3.072/5.209/2.137 ms
Good: Can ping DNS server
================================================
Good: DNS resolves download.cloud.com
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/d11d5c92-6950-30e8-a0b5-3cd46a17ec14
Good: Can write to mount point
================================================
Management server is 10.61.153.20. Checking connectivity.
Good: Can connect to management server port 8250
================================================
Good: Java process is running
================================================
Tests Complete. Look for ERROR or WARNING above.
root@s-11-VM:~#

Thanks & Regards,
Nezar.

On 17 March 2016 at 09:42, Simon Weller <sweller@ena.com> wrote:

> Nezar,
>
> Log into the Cloudstack UI.
>
> Click on "Infrastructure" on the left menu. Click on  View All below
> "System VMs". find the item marked "Secondary Storage VM"  and then click
> on the Name of that VM on the left (it will be s-XXXX-VM). You'll see a
> bunch of information about the VM. Find the Host line and also the Link
> Local IP Address line and then follow the original instructions in my
> previous email.
>
> - Si
>
>
>
>
>
> ________________________________________
> From: Shweta Agarwal <shweta.agarwal1@accelerite.com>
> Sent: Wednesday, March 16, 2016 12:16 AM
> To: users@cloudstack.apache.org
> Subject: Re: Unable to create a New VM - Error message: Unable to start
> instance due to Unable to get answer that is of class
> com.cloud.agent.api.StartAnswer
>
> Hi Nezar,
>
> You can find host name on detail view of SSVM in UI .
> You can also use list api command listSystemVms to get the host details of
> system vms.
>
> Thanks
> Shweta
>
>
> ________________________________________
> From: Nezar Madbouh <nezar.madbouh@ipscape.com.au>
> Sent: Wednesday, March 16, 2016 9:58 AM
> To: users@cloudstack.apache.org
> Subject: Re: Unable to create a New VM - Error message: Unable to start
> instance due to Unable to get answer that is of class
> com.cloud.agent.api.StartAnswer
>
> Hi Simon,
>
> How can I find out which host the SSVM is on?
>
> Thanks & Regards,
> Nezar.
>
> On 16 March 2016 at 12:28, Simon Weller <sweller@ena.com> wrote:
>
> > Can you ssh into the Secondary Storage VM?
> >
> > This can be done by getting the link-local-ip address from the
> > infrastructure menu in the UI and then sshing into the host the SSVM is
> on
> > and issuing this command as root: ssh -i /root/.ssh/id_rsa.cloud -p 3922
> > root@link-local-ip  (replace link-local-ip with the link local ip).
> >
> > Try  running the SSVM diangnostic script:
> > usr/local/cloud/systemvm/ssvm-check.sh
> >
> > - Si
> > ________________________________________
> > From: Nezar Madbouh <nezar.madbouh@ipscape.com.au>
> > Sent: Tuesday, March 15, 2016 7:49 PM
> > To: users@cloudstack.apache.org
> > Subject: Re: Unable to create a New VM - Error message: Unable to start
> > instance due to Unable to get answer that is of class
> > com.cloud.agent.api.StartAnswer
> >
> > Hi Simon,
> >
> > Please see details below:
> >
> >
> > mysql> use cloud; select id, name, status, type from host where id = 5;
> > Reading table information for completion of table and column names
> > You can turn off this feature to get a quicker startup with -A
> >
> > Database changed
> > +----+------------------------------+--------+---------+
> > | id | name                         | status | type    |
> > +----+------------------------------+--------+---------+
> > | 5 | eqx-cs-cmp-02.ipscape.com.au | up | routing |
> > +----+------------------------------+--------+---------+
> > 1 row in set (0.00 sec)
> >
> >
> >
> > cat /var/log/cloudstack/agent/agent.log
> > com.cloud.utils.exception.CloudRuntimeException:
> > com.cloud.utils.exception.CloudRuntimeException: Can't find
> > volume:089ff3ca-9bff-402c-a14e-ea7a35aaad5c
> >         at
> >
> >
> com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.getPhysicalDisk(KVMStoragePoolManager.java:262)
> >         at
> >
> >
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.createVbd(LibvirtComputingResource.java:3921)
> >         at
> >
> >
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3789)
> >         at
> >
> >
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1333)
> >         at com.cloud.agent.Agent.processRequest(Agent.java:501)
> >         at
> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)
> >         at com.cloud.utils.nio.Task.run(Task.java:84)
> >         at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >         at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >         at java.lang.Thread.run(Thread.java:745)
> > agent.log.2016-03-03.gz (END)
> >
> >
> >
> > [root@eqx-cs-cmp-02 agent]# virsh pool-list
> > Name                 State      Autostart
> > -----------------------------------------
> > 2d0967f8-50d6-4d6d-87b7-4da0596f6924 active     no
> > b3647480-5709-36eb-9ddd-e2c666f30b57 active     no
> > e3831246-ff55-4af4-9964-a17565edaccc active no
> >
> >
> >
> >
> > [Root @ eqx-cs-cmp-02 agent] # df -h
> > Filesystem            Size  Used Avail Use% Mounted on
> > /dev/mapper/vg_root-lv_root
> >                       203G 215G 1.3G 1% /
> > tmpfs 48g 48g 0 0% / dev / shm
> > / Dev / sda1 477m 427m 25M 6% / boot
> > xx.xx.xx.xx:/Cloudstack/primary
> >                       7.6T  4.1T  3.5T  54%
> > /mnt/b3647480-5709-36eb-9ddd-e2c666f30b57
> >
> >
> >
> >
> > I also noticed the following in cloudstack-agent.err
> >
> > libvirt: QEMU Driver error : Domain not found: no domain with matching
> name
> > 'i-11-600-VM'
> > libvirt: Storage Driver error : Storage volume not found: no storage vol
> > with matching name '089ff3ca-9bff-402c-a14e-ea7a35aaad5c'
> >
> > Your help is much appreciated,
> > Nezar
> >
> >
> > On 16 March 2016 at 11:03, Simon Weller <sweller@ena.com> wrote:
> >
> > > Nezar,
> > >
> > > ok, I just took a look at a pastebin you posted.
> > >
> > > I see it complaining about the inability to find a volume prior to
> > > throwing the host exception.
> > >
> > > Firstly, let's find out who host 5 is. Can you log into your MySQL
> server
> > > and run this:
> > >
> > > use cloud;select id,name,status,type from host where id=5;
> > >
> > > Can you post the results?
> > >
> > > If it's a host, can you post the /var/log/cloudstack/agent/agent.log
> from
> > > that host?
> > >
> > > And also run virsh pool-list on the host in question?
> > >
> > > - Si
> > >
> > >
> > >
> > >
> > >
> > > ________________________________________
> > > From: Nezar Madbouh <nezar.madbouh@ipscape.com.au>
> > > Sent: Tuesday, March 15, 2016 6:11 PM
> > > To: users@cloudstack.apache.org
> > > Subject: Re: Unable to create a New VM - Error message: Unable to start
> > > instance due to Unable to get answer that is of class
> > > com.cloud.agent.api.StartAnswer
> > >
> > > Hi Simon,
> > >
> > > When you say "double check your routers tied to the network", do you
> mean
> > > the physical routers or the virtual routers?
> > >
> > > When I try to create a VM in Prod Environment it fails. I can't ping
> the
> > > Prod virtual router from management server or Host.
> > >
> > > But I can ping Dev virtual router from management server and Host and I
> > was
> > > able to create a VM in Dev Environment.
> > >
> > > How can I troubleshoot the Prod Virtual router. I launched the console
> > but
> > > couldn't login.
> > >
> > >
> > > Please note that we need to take into consideration that the affected
> > > network is the Production network and we need to minimise service
> outage
> > as
> > > much as possible.
> > >
> > > Your help is much appreciated,
> > > Nezar
> > >
> > >
> > >
> > > On 16 March 2016 at 08:37, Simon Weller <sweller@ena.com> wrote:
> > >
> > > > I've seen this before where a Virtual Router has crashed and the
> > > > management server can't communicate with it.
> > > > Are you using an advanced network setup?
> > > >
> > > > If so, double check your routers tied to the network where you are
> > > > attempting to start an instance.
> > > >
> > > > - Si
> > > >
> > > >
> > > > ________________________________________
> > > > From: Nezar Madbouh <nezar.madbouh@ipscape.com.au>
> > > > Sent: Tuesday, March 15, 2016 4:02 PM
> > > > To: users@cloudstack.apache.org
> > > > Subject: Re: Unable to create a New VM - Error message: Unable to
> start
> > > > instance due to Unable to get answer that is of class
> > > > com.cloud.agent.api.StartAnswer
> > > >
> > > > Hi Glenn,
> > > >
> > > > We have 16 hosts, all KVM.
> > > >
> > > > The error is not specific to Host 5. Every time I try to create a VM
> it
> > > > gives me the same error message but on different host.
> > > >
> > > > How do I restart the agent on the host. Is it service affecting?
> > > >
> > > > Thanks very much for your help.
> > > > Neza
> > > >
> > > > On 15 March 2016 at 17:37, Glenn Wagner <glenn.wagner@shapeblue.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Can you explain your environment first , how many hosts , what is
> > your
> > > > > hypervisors (KVM,Xenserver,VMware)
> > > > >
> > > > > The error seems to be with your Host 5 Hypervisor
> > > > > Resource [Host:5] is unreachable:
> > > > >
> > > > > Go to the infrastructure section and see what host5 is reporting,
> > > > > Have you tried to restart the agent on the Host?
> > > > >
> > > > > Thanks
> > > > > Glenn
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > [image: ShapeBlue] <http://www.shapeblue.com>
> > > > > Glenn Wagner
> > > > > Senior Consultant ,  ShapeBlue
> > > > > d:  * | s: +27 21 527 0091* <%7C%20s:%20+27%2021%20527%200091>
 |
> > m:
> > > > > *+27 73 917 4111* <+27%2073%20917%204111>
> > > > > e:  *glenn.wagner@shapeblue.com | t: *
> > > > > <glenn.wagner@shapeblue.com%20%7C%20t:>  |  w:  *www.shapeblue.com
> *
> > > > > <http://www.shapeblue.com>
> > > > > a:
> > > > > 2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West Cape Town
> 7130
> > > > South Africa
> > > > > Shape Blue Ltd is a company incorporated in England & Wales.
> > ShapeBlue
> > > > > Services India LLP is a company incorporated in India and is
> operated
> > > > under
> > > > > license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is
> a
> > > > > company incorporated in Brasil and is operated under license from
> > Shape
> > > > > Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The
> > Republic
> > > of
> > > > > South Africa and is traded under license from Shape Blue Ltd.
> > ShapeBlue
> > > > is
> > > > > a registered trademark.
> > > > > This email and any attachments to it may be confidential and are
> > > intended
> > > > > solely for the use of the individual to whom it is addressed. Any
> > views
> > > > or
> > > > > opinions expressed are solely those of the author and do not
> > > necessarily
> > > > > represent those of Shape Blue Ltd or related companies. If you are
> > not
> > > > the
> > > > > intended recipient of this email, you must neither take any action
> > > based
> > > > > upon its contents, nor copy or show it to anyone. Please contact
> the
> > > > sender
> > > > > if you believe you have received this email in error.
> > > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: Nezar Madbouh [mailto:nezar.madbouh@ipscape.com.au]
> > > > > Sent: Tuesday, 15 March 2016 5:45 AM
> > > > > To: users@cloudstack.apache.org
> > > > > Subject: Re: Unable to create a New VM - Error message: Unable to
> > start
> > > > > instance due to Unable to get answer that is of class
> > > > > com.cloud.agent.api.StartAnswer
> > > > >
> > > > > Hi Jeremy,
> > > > >
> > > > > I have uploaded the contents to http://pastebin.com/1J3mmgTh
> > > > >
> > > > > your help is much appreciated,
> > > > > Nezar.
> > > > >
> > > > > On 15 March 2016 at 13:46, Jeremy Peterson <jpeterson@acentek.net>
> > > > wrote:
> > > > >
> > > > > > I don't see any attachments can you create a pastebin. That's
> > easier
> > > > > > to look through as I think attachments are removed before being
> > sent
> > > > > > to user group.
> > > > > >
> > > > > > Jeremy
> > > > > >
> > > > > >
> > > > > > -------- Original message --------
> > > > > > From: Nezar Madbouh <nezar.madbouh@ipscape.com.au>
> > > > > > Date: 3/14/2016 6:38 PM (GMT-06:00)
> > > > > > To: users@cloudstack.apache.org
> > > > > > Subject: Unable to create a New VM - Error message: Unable to
> start
> > > > > > instance due to Unable to get answer that is of class
> > > > > > com.cloud.agent.api.StartAnswer
> > > > > >
> > > > > > Hi Shweta and Sadhu,
> > > > > >
> > > > > > Please find attached managerment-server.log which contains the
> logs
> > > > > > since I started creating a new VM (VM id 600).
> > > > > >
> > > > > > Please note that we don't have agent.log files
> > > > > >
> > > > > > Your help is much appreciated.
> > > > > >
> > > > > > Regards,
> > > > > > Nezar.
> > > > > >
> > > > > Find out more about ShapeBlue and our range of CloudStack related
> > > > services:
> > > > > IaaS Cloud Design & Build
> > > > > <http://shapeblue.com/iaas-cloud-design-and-build//> | CSForge
–
> > rapid
> > > > > IaaS deployment framework <http://shapeblue.com/csforge/>
> > > > > CloudStack Consulting <
> http://shapeblue.com/cloudstack-consultancy/>
> > |
> > > > CloudStack
> > > > > Software Engineering
> > > > > <http://shapeblue.com/cloudstack-software-engineering/>
> > > > > CloudStack Infrastructure Support
> > > > > <http://shapeblue.com/cloudstack-infrastructure-support/> |
> > CloudStack
> > > > > Bootcamp Training Courses <
> http://shapeblue.com/cloudstack-training/
> > >
> > > > >
> > > >
> > >
> >
>
>
>
> DISCLAIMER
> ==========
> This e-mail may contain privileged and confidential information which is
> the property of Accelerite, a Persistent Systems business. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Accelerite, a Persistent Systems business does not accept any
> liability for virus infected mails.
>

Mime
View raw message