From users-return-33225-archive-asf-public=cust-asf.ponee.io@cloudstack.apache.org Tue Jul 16 21:46:10 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id 185D418064E for ; Tue, 16 Jul 2019 23:46:10 +0200 (CEST) Received: (qmail 41475 invoked by uid 500); 16 Jul 2019 21:46:07 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 41463 invoked by uid 99); 16 Jul 2019 21:46:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 16 Jul 2019 21:46:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 016DA1825D5 for ; Tue, 16 Jul 2019 21:46:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.801 X-Spam-Level: * X-Spam-Status: No, score=1.801 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-he-de.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id VQjoA3bXxagp for ; Tue, 16 Jul 2019 21:46:05 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=2607:f8b0:4864:20::d2a; helo=mail-io1-xd2a.google.com; envelope-from=j.zolotarjov@gmail.com; receiver= Received: from mail-io1-xd2a.google.com (mail-io1-xd2a.google.com [IPv6:2607:f8b0:4864:20::d2a]) by mx1-he-de.apache.org (ASF Mail Server at mx1-he-de.apache.org) with ESMTPS id 2EC3D7E20D for ; Tue, 16 Jul 2019 21:46:04 +0000 (UTC) Received: by mail-io1-xd2a.google.com with SMTP id j5so38266091ioj.8 for ; Tue, 16 Jul 2019 14:46:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=qrCSRvolReJKdWWCLzPgi+sLyJfTFTcNpqdP9XJ2FeQ=; b=pLG/l0fUWbnzfpq2yWL2LACMgG7iZxvp8UiTYYNT9/aHTXxHYWpbBj7grwVoYskhg8 i4y7jUXZY0Fz9mgWmdWT48/o1O20ySWp9ZSqGWRRN95jg+gRxQaB+B89Tk6pHf4DHF9V /hUB07hYsBjOVVDRTX0Gcid/6q0k5jouDcctZlwjsOUF7VJh01RVAXEWHlrO5Hl2JtrF RVHhOwrAvKuW+WyaGFB0KOjWO6rkokSwo5q0NUxnD2jYRfYXyAq994fYQOxR6Ve25M15 kT1Ec3zBiLD2ChZlygQvELQpsYuQMj8yqSRmLr+5mrfihOh/mCKH2DTw3/SIXFWAGOGJ Lk9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=qrCSRvolReJKdWWCLzPgi+sLyJfTFTcNpqdP9XJ2FeQ=; b=ni8E/JOmn+MfkZUuhV+wznH+Xt5lAGblpCZrXvxgX0FUa6MrzuVfWeENKcVFr6vIaO sSZ72+Q30huBjZYLo5uE4wUDKoeE33nJ+yXYHtnKGn1lmXRXBO+6al/b4Oe4jxzrJi0L EUuQVWg5RN0ShEjxQTL9JC+r5ZlICd8c+Qj6PCK8+axg2DqZtioFipmN+6lZ9sCHpRwC fcn5qQpenYELG5IPk3YKsYrMiEx2Qqm9RgS8cJs0GQLApjGmJUiXpYEj/v09af/qOUoi 3tXUYj6PFB+OGtJ+Q5up4l1mddaAZSaMia+cmqqgw81AmqvjEFQE36GW0EZGfpVENpuv 56zw== X-Gm-Message-State: APjAAAWEsUOCc8eWllQLi5nyudnUD4IxmlQi/k3uvpI2aPtkny++XIuD eyX35M9y5wUqxjf0v5sqlhkUzKNIgDqKn2NPYu1PcA== X-Google-Smtp-Source: APXvYqx5dXXUhTIVRc5G/DisoUby1Fk793so24Jie4xS5ogjLCCnWB0gEi3czJG6OG45ZU4LL9HoCzPXMgQfBplzM6I= X-Received: by 2002:a02:cc8e:: with SMTP id s14mr9183887jap.142.1563313562661; Tue, 16 Jul 2019 14:46:02 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Jevgeni Zolotarjov Date: Wed, 17 Jul 2019 00:45:57 +0300 Message-ID: Subject: Re: "Command failed due to Internal Server Error" when stopping a VM To: users@cloudstack.apache.org Content-Type: multipart/alternative; boundary="000000000000933817058dd34d85" --000000000000933817058dd34d85 Content-Type: text/plain; charset="UTF-8" +1 Have experienced exactly the same problem. My host is centos7. Would be interested to get the solution. On Tue, 16 Jul 2019, 23:57 daniel bellido, wrote: > Hello, > > I've done a fresh install of cloudstack 4.11.3 on 2 ubuntu 18.04 servers > (1 server hosts the management server , the other hosts a KVM host). > I've configured the cloud using the wizard. > Everything works fine except that I receive "internal server errors" when > I stop the VMs . From the UI , the status stays as "stopping'; so the > workaround is to go to the DB and set the status as "stopped". Expunging > the VM results also in a internal server error too. > > Looking at the management server logs, I can see these errors : > > > 2019-07-16 22:49:59,967 DEBUG [o.a.c.n.t.BasicNetworkTopology] > (AgentManager-Handler-2:null) (logid:) REMOVING DHCP ENTRY RULE > 2019-07-16 22:49:59,967 DEBUG [o.a.c.n.t.BasicNetworkTopology] > (AgentManager-Handler-2:null) (logid:) Applying dhcp entry in network > Ntwk[204|Guest|6] > 2019-07-16 22:49:59,971 WARN [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-2:null) (logid:) Caught: > java.lang.NullPointerException > at > org.apache.cloudstack.network.topology.BasicNetworkVisitor.visit(BasicNetworkVisitor.java:201) > at com.cloud.network.rules.DhcpEntryRules.accept(DhcpEntryRules.java:64) > at > org.apache.cloudstack.network.topology.BasicNetworkTopology.applyRules(BasicNetworkTopology.java:390) > at > org.apache.cloudstack.network.topology.BasicNetworkTopology.removeDhcpEntry(BasicNetworkTopology.java:464) > at > com.cloud.network.element.VirtualRouterElement.removeDhcpEntry(VirtualRouterElement.java:972) > at > org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.cleanupNicDhcpDnsEntry(NetworkOrchestrator.java:2933) > at com.cloud.vm.UserVmManagerImpl.finalizeStop(UserVmManagerImpl.java:4389) > at > com.cloud.vm.VirtualMachineManagerImpl.sendStop(VirtualMachineManagerImpl.java:1485) > at > com.cloud.vm.VirtualMachineManagerImpl.handlePowerOffReportWithNoPendingJobsOnVM(VirtualMachineManagerImpl.java:4186) > at > com.cloud.vm.VirtualMachineManagerImpl.scanStalledVMInTransitionStateOnUpHost(VirtualMachineManagerImpl.java:4238) > at > com.cloud.vm.VirtualMachineManagerImpl.processCommands(VirtualMachineManagerImpl.java:3076) > at > com.cloud.agent.manager.AgentManagerImpl.handleCommands(AgentManagerImpl.java:317) > at > com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1296) > at > com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1383) > at > com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:712) > at com.cloud.utils.nio.Task.call(Task.java:83) > at com.cloud.utils.nio.Task.call(Task.java:29) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > > > > 2019-07-16 22:51:00,004 ERROR [o.a.c.f.m.MessageDispatcher] > (AgentManager-Handler-5:null) (logid:) Unexpected exception when calling > com.cloud.vm.ClusteredVirtualMachineManagerImpl.HandlePowerStateReport > java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor153.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.cloudstack.framework.messagebus.MessageDispatcher.dispatch(MessageDispatcher.java:75) > at > org.apache.cloudstack.framework.messagebus.MessageDispatcher.onPublishMessage(MessageDispatcher.java:45) > at > org.apache.cloudstack.framework.messagebus.MessageBusBase$SubscriptionNode.notifySubscribers(MessageBusBase.java:441) > at > org.apache.cloudstack.framework.messagebus.MessageBusBase.publish(MessageBusBase.java:178) > at > com.cloud.vm.VirtualMachinePowerStateSyncImpl.processReport(VirtualMachinePowerStateSyncImpl.java:147) > at > com.cloud.vm.VirtualMachinePowerStateSyncImpl.processHostVmStatePingReport(VirtualMachinePowerStateSyncImpl.java:68) > at > com.cloud.vm.VirtualMachineManagerImpl.processCommands(VirtualMachineManagerImpl.java:3071) > at > com.cloud.agent.manager.AgentManagerImpl.handleCommands(AgentManagerImpl.java:317) > at > com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1296) > at > com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1383) > at > com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:712) > at com.cloud.utils.nio.Task.call(Task.java:83) > at com.cloud.utils.nio.Task.call(Task.java:29) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.lang.NullPointerException > at > org.apache.cloudstack.network.topology.BasicNetworkVisitor.visit(BasicNetworkVisitor.java:201) > at com.cloud.network.rules.DhcpEntryRules.accept(DhcpEntryRules.java:64) > at > org.apache.cloudstack.network.topology.BasicNetworkTopology.applyRules(BasicNetworkTopology.java:390) > ... 27 more > 2019-07-16 22:51:00,005 WARN [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-5:null) (logid:) Caught: > java.lang.RuntimeException: InvocationTargetException when invoking event > handler for subject: vm.powerstate > at > org.apache.cloudstack.framework.messagebus.MessageDispatcher.dispatch(MessageDispatcher.java:84) > at > org.apache.cloudstack.framework.messagebus.MessageDispatcher.onPublishMessage(MessageDispatcher.java:45) > at > org.apache.cloudstack.framework.messagebus.MessageBusBase$SubscriptionNode.notifySubscribers(MessageBusBase.java:441) > at > org.apache.cloudstack.framework.messagebus.MessageBusBase.publish(MessageBusBase.java:178) > at > com.cloud.vm.VirtualMachinePowerStateSyncImpl.processReport(VirtualMachinePowerStateSyncImpl.java:147) > at > com.cloud.vm.VirtualMachinePowerStateSyncImpl.processHostVmStatePingReport(VirtualMachinePowerStateSyncImpl.java:68) > at > com.cloud.vm.VirtualMachineManagerImpl.processCommands(VirtualMachineManagerImpl.java:3071) > at > com.cloud.agent.manager.AgentManagerImpl.handleCommands(AgentManagerImpl.java:317) > at > com.cloud.agent.manager.AgentManagerImpl$AgentHandler.processRequest(AgentManagerImpl.java:1296) > at > com.cloud.agent.manager.AgentManagerImpl$AgentHandler.doTask(AgentManagerImpl.java:1383) > at > com.cloud.agent.manager.ClusteredAgentManagerImpl$ClusteredAgentHandler.doTask(ClusteredAgentManagerImpl.java:712) > at com.cloud.utils.nio.Task.call(Task.java:83) > at com.cloud.utils.nio.Task.call(Task.java:29) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > > Any help would be greatly appreciated > Regards > D. > > --000000000000933817058dd34d85--