cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jayapal Reddy Uradi <jayapalreddy.ur...@citrix.com>
Subject Re: Failed to mount error in Agent log file - Fresh installation
Date Mon, 21 Apr 2014 12:04:00 GMT
Hi Sandeep,

send your host table content.
SELECT * FROM cloud.host;

I want to check the URL which you have given for nfs secondary storage.

-Jayapal

On 21-Apr-2014, at 5:14 PM, sandeep khandekar <cloudstack.sandeep@gmail.com>
 wrote:

> Hi Jaypal,
> 
> How to resolve from management server secondary?
> 
> mount command shows the following information
> 
> root@cloudstack:/var/log/cloudstack/management# mount
> /dev/sda5 on / type ext4 (rw,errors=remount-ro)
> proc on /proc type proc (rw,noexec,nosuid,nodev)
> sysfs on /sys type sysfs (rw,noexec,nosuid,nodev)
> none on /sys/fs/fuse/connections type fusectl (rw)
> none on /sys/kernel/debug type debugfs (rw)
> none on /sys/kernel/security type securityfs (rw)
> udev on /dev type devtmpfs (rw,mode=0755)
> devpts on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
> tmpfs on /run type tmpfs (rw,noexec,nosuid,size=10%,mode=0755)
> none on /run/lock type tmpfs (rw,noexec,nosuid,nodev,size=5242880)
> none on /run/shm type tmpfs (rw,nosuid,nodev)
> cgroup on /sys/fs/cgroup type tmpfs (rw,relatime,mode=755)
> cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,relatime,cpuset)
> cgroup on /sys/fs/cgroup/cpu type cgroup (rw,relatime,cpu)
> cgroup on /sys/fs/cgroup/cpuacct type cgroup (rw,relatime,cpuacct)
> cgroup on /sys/fs/cgroup/memory type cgroup (rw,relatime,memory)
> cgroup on /sys/fs/cgroup/devices type cgroup (rw,relatime,devices)
> cgroup on /sys/fs/cgroup/freezer type cgroup (rw,relatime,freezer)
> cgroup on /sys/fs/cgroup/blkio type cgroup (rw,relatime,blkio)
> cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,relatime,perf_event)
> cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,relatime,hugetlb)
> rpc_pipefs on /run/rpc_pipefs type rpc_pipefs (rw)
> nfsd on /proc/fs/nfsd type nfsd (rw)
> gvfs-fuse-daemon on /home/cloudstack/.gvfs type fuse.gvfs-fuse-daemon
> (rw,nosuid,nodev,user=cloudstack)
> 10.4.6.17:/export/secondary on /mnt/secondary type nfs
> (rw,tcp,intr,vers=4,addr=10.4.6.17,clientaddr=10.4.6.17)
> 10.4.6.17:/export/primary on /mnt/primary type nfs
> (rw,tcp,intr,vers=4,addr=10.4.6.17,clientaddr=10.4.6.17)
> 10.4.6.17:/export/primary on /mnt/25838d34-9a6f-3266-912e-db84d3f365d6 type
> nfs (rw,vers=4,addr=10.4.6.17,clientaddr=10.4.6.17)
> 
> The last line looks unusual, It got created automatically -
> cloudstack-management-server.
> 
> I revoked the mount which I have done it manually previously.
> with the below command
> sudo mount -t nfs 10.4.6.17:/export/secondary/template/tmpl/1/3/
> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0/
> 
> Any guidance, how to solve?.
> 
> 
> On Mon, Apr 21, 2014 at 4:25 PM, Jayapal Reddy Uradi <
> jayapalreddy.uradi@citrix.com> wrote:
> 
>> Hi Snadeep,
>> 
>> In the log message it is showing secondary in the path.
>> 
>> secondary:/export/secondary/template/tmpl/1/3
>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0
>> 
>> From the management server, Is secondary is resolved ?
>> In secondary storage configuration, did you mention secondary or 10.4.6.17
>> ?
>> 
>> -Jayapal
>> 
>> On 21-Apr-2014, at 4:04 PM, sandeep khandekar <
>> cloudstack.sandeep@gmail.com>
>> wrote:
>> 
>>> Dear All,
>>> 
>>> I am unable to mount my secondary storage, I am trying really hard to
>>> install cloudstack.
>>> 
>>> Need help to finish these work friends.
>>> 
>>> Please see the error which has appeared in my agent log
>>> tail -f agent.log
>>> 2014-04-21 15:04:27,405 INFO  [cloud.agent.Agent]
>>> (agentRequest-Handler-1:null) Set agent id 1
>>> 2014-04-21 15:04:27,405 INFO  [cloud.agent.Agent]
>>> (agentRequest-Handler-1:null) Ready command is processed: agent id = 1
>>> 2014-04-21 15:11:29,554 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-4:null) org.libvirt.LibvirtException: internal
>> error
>>> Child process (/bin/mount secondary:/export/secondary/template/tmpl/1/3
>>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0) status unexpected: exit
>> status 32
>>> 2014-04-21 15:11:29,554 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-4:null) Internal error occurred when attempting to
>>> mount: specified path may be invalid
>>> 2014-04-21 15:11:29,554 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-4:null) Failed to create mount
>>> 2014-04-21 15:11:29,555 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-4:null) [Ljava.lang.StackTraceElement;@28d51032
>>> 2014-04-21 15:17:53,938 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) org.libvirt.LibvirtException: internal
>> error
>>> Child process (/bin/mount secondary:/export/secondary/template/tmpl/1/3
>>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0) status unexpected: exit
>> status 32
>>> 2014-04-21 15:17:53,938 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) Internal error occurred when attempting to
>>> mount: specified path may be invalid
>>> 2014-04-21 15:17:53,938 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) Failed to create mount
>>> 2014-04-21 15:17:53,938 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) [Ljava.lang.StackTraceElement;@12afa082
>>> 2014-04-21 15:24:19,346 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-2:null) org.libvirt.LibvirtException: internal
>> error
>>> Child process (/bin/mount secondary:/export/secondary/template/tmpl/1/3
>>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0) status unexpected: exit
>> status 32
>>> 2014-04-21 15:24:19,346 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-2:null) Internal error occurred when attempting to
>>> mount: specified path may be invalid
>>> 2014-04-21 15:24:19,346 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-2:null) Failed to create mount
>>> 2014-04-21 15:24:19,346 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-2:null) [Ljava.lang.StackTraceElement;@65a714ff
>>> 2014-04-21 15:30:48,594 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) org.libvirt.LibvirtException: internal
>> error
>>> Child process (/bin/mount secondary:/export/secondary/template/tmpl/1/3
>>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0) status unexpected: exit
>> status 32
>>> 2014-04-21 15:30:48,594 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) Internal error occurred when attempting to
>>> mount: specified path may be invalid
>>> 2014-04-21 15:30:48,594 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) Failed to create mount
>>> 2014-04-21 15:30:48,594 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) [Ljava.lang.StackTraceElement;@5dd06de
>>> 2014-04-21 15:37:14,513 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) org.libvirt.LibvirtException: internal
>> error
>>> Child process (/bin/mount secondary:/export/secondary/template/tmpl/1/3
>>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0) status unexpected: exit
>> status 32
>>> 2014-04-21 15:37:14,514 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) Internal error occurred when attempting to
>>> mount: specified path may be invalid
>>> 2014-04-21 15:37:14,514 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) Failed to create mount
>>> 2014-04-21 15:37:14,514 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) [Ljava.lang.StackTraceElement;@4e30cbae
>>> 
>>> 
>>> as cloudstack was unable to mount, I mounted it in the secondary storage
>> in
>>> specified path Manually
>>> 
>>> $sudo mount -t nfs 10.4.6.17:/export/secondary/template/tmpl/1/3/
>>> /mnt/53d355b8-a8c7-33a2-b9fd-e6d68ff7eec0/
>>> 
>>> Then I got the message cloudstack installed successfully.
>>> 
>>> When I see my centos template it is not downloaded - The same error
>> which I
>>> got in my previous installations.
>>> 
>>> Any guesses are hints to solve these friends,
>>> the setup is done on a single node(ubntu 12.04)
>>> (hypervisor,managementserver,nfs server all running on one single node)
>>> 
>>> Installation steps which followed
>>> step wise installation of cloudstack on ubuntu
>>> 
>>> I thought first five steps as pre-requsites so I executed, I know they
>> are
>>> not necessary but I executed to be on safe side
>>> sudo apt-get install vim
>>> 
>>> 1. sudo apt-get update
>>> 2. sudo apt-get install python-software-properties
>>> 3. sudo add-apt-repository ppa:natecarlson/maven3
>>> 4. sudo apt-get update
>>> 5. sudo apt-get install ant debhelper openjdk-6-jdk tomcat6
>>> libws-commons-util-java genisoimage python-mysqldb libcommons-codec-java
>>> libcommons-httpclient-java liblog4j1.2-java maven3
>>> 
>>> ## not used the below step
>>> 6.  mvn3 -P deps
>>> 7.
>>> chapter 4
>>> 8. vi  /etc/apt/sources.list.d/cloudstack.list
>>> deb http://cloudstack.apt-get.eu/ubuntu precise 4.2
>>> 
>>> 9.  run this command as root
>>> wget -O - http://cloudstack.apt-get.eu/release.asc|apt-key add -
>>> 
>>> 10.  apt-get update
>>> 
>>> 11. hostname --fqdn
>>> edit these two files
>>> /etc/host
>>> /etc/hosts
>>> Ip-address hostname
>>> 
>>> 11. apt-get install openntpd
>>> 
>>> //Do not run these step It will take you to K20Cloudstack-management
>> error
>>> 12. sudo apt-get install cloudstack-cli
>>> 
>>> 13. sudo vi /etc/sudoers
>>> 
>>> root ALL=(ALL:ALL) NOPASSWD:ALL
>>> 
>>> #If you don’t want to be prompted for any password while running sudo
>> then
>>> we can use the NOPASSWD parameter on a particular entry:
>>> 
>>> 14. apt-get install cloudstack-agent
>>> 
>>> 15. vi /etc/cloudstack/agent/agent.properties
>>> guest.cpu.mode=host-model
>>> 
>>> 16. vi /etc/libvirt/libvirtd.conf
>>> listen_tls = 0
>>> listen_tcp = 1
>>> tcp_port = "16509"
>>> auth_tcp = "none"
>>> mdns_adv = 0
>>> 
>>> # in-order to have live migration working libvirt has to listen ot
>>> unsecured TCP CONNECTION
>>> # need to turn off libvirts attempt to use Multicast DNS
>>> 
>>> 17. vi /etc/default/libvirt-bin
>>> libvirtd_opts="-d -l"
>>> 
>>> 18. vi /etc/libvirt/qemu.conf
>>> vnc_listen = "0.0.0.0"
>>> 
>>> 19. service libvirt-bin restart
>>> 
>>> 20. Configuring security policies
>>> 
>>> i) dpkg --list 'apparmor'
>>> 
>>> Disabling apparmor profiles
>>> 
>>> ii) ln -s /etc/apparmor.d/usr.sbin.libvirtd /etc/apparmor.d/disable/
>>> 
>>> iii) ln -s /etc/apparmor.d/usr.lib.libvirt.virt-aa-helper
>>> /etc/apparmor.d/disable/
>>> 
>>> iv)  apparmor_parser -R /etc/apparmor.d/usr.sbin.libvirtd
>>> 
>>> v)  apparmor_parser -R /etc/apparmor.d/usr.lib.libvirt.virt-aa-helper
>>> 
>>> 21. Configuring the network
>>> 
>>> i) apt-get install bridge-utils
>>> 
>>> ii)
>>> vi /etc/network/interfaces
>>> 
>>> auto lo
>>> iface lo inet loopback
>>> 
>>> # The primary network interface
>>> auto eth0
>>> iface eth0 inet manual
>>> # Public network
>>> 
>>> auto cloudbr0
>>> iface cloudbr0 inet static
>>>   address 10.4.6.17
>>>   netmask 255.255.255.128
>>>   gateway 10.4.6.1
>>>   bridge_ports eth0
>>>   bridge_fd 5
>>>   bridge_stp off
>>>   bridge_maxwait 1
>>>   dns-nameservers 10.4.21.4 103.15.60.4
>>> # Private network
>>> auto cloudbr1
>>> iface cloudbr1 inet manual
>>>   bridge_ports eth0
>>>   bridge_fd 5
>>>   bridge_stp off
>>>   bridge_maxwait 1
>>> 
>>> 22. Configuring Firewall
>>> $ ufw allow proto tcp from any to any port 22
>>> 
>>> $ ufw allow proto tcp from any to any port 1798
>>> 
>>> $ ufw allow proto tcp from any to any port 16509
>>> 
>>> $ ufw allow proto tcp from any to any port 5900:6100
>>> 
>>> $ ufw allow proto tcp from any to any port 49152:49216
>>> 
>>> //server installation
>>> 
>>> 23. apt-get install cloudstack-mangagement
>>> 
>>> 24. apt-get install mysql-server
>>> 
>>> 25. vi /etc/mysql/conf.d/cloudstack.cnf
>>> [mysqld]
>>> innodb_rollback_on_timeout=1
>>> innodb_lock_wait_timeout=600
>>> max_connections=350
>>> log-bin=mysql-bin
>>> binlog-format = 'ROW'
>>> 
>>> 25.1 sudo ufw status verbose
>>> 25.2 sudo ufw enable
>>> 25.3 sudo ufw allow mysql
>>> 
>>> 26. service mysql restart
>>> 
>>> 27. cloudstack-setup-databases
>>> cloud:cloudstack@localhost--deploy-as=root:cloudstack -i 10.4.6.17
>>> 
>>> TRY THESE (working successfully)
>>> cloudstack-setup-databases
>>> cloud:cloudstack@localhost--deploy-as=root:cloudstack -e file -m
>>> cloudstack -k cloudstack -i 10.4.6.17
>>> 
>>> cloudstack-setup-databases cloud:<dbpassword>@localhost \
>>> --deploy-as=root:<password> \
>>> -e <encryption_type> \
>>> -m <management_server_key> \
>>> -k <database_key> \
>>> -i <management_server_ip>
>>> 
>>> 28. vi /etc/sudoers
>>> Defaults:cloud !requiretty
>>> 
>>> 29.  cloudstack-setup-management
>>> 
>>> 
>>> //preparing NFS Share
>>> 30. sudo apt-get install nfs-common nfs-kernel-server
>>> 
>>> i) vi /etc/default/nfs-kernel-server
>>> RPCMOUNTDOPTS="-p 892 --manage-gids"
>>> 
>>> ii) vi /etc/default/nfs-common
>>> NEED_STATD=yes
>>> STATDOPTS="--port 662 --outgoing port 2020"
>>> 
>>> iii) cat >> /etc/modprobe.d/lockd.conf
>>> options lockd nlm_udpport=32769 nlm_tcpport=32803
>>> 
>>> iv) apt-get install quota
>>> 
>>> v) vi /etc/default/quota
>>> RPCRQUOTADOPTS="-p 875"
>>> 
>>> 
>>> 31.
>>> $ sudo mkdir -p /export/primary
>>> $ sudo mkdir -p /export/secondary
>>> 
>>> 32.
>>> sudo vi /etc/exports
>>> 
>>> /export *(rw,async,no_root_squash,no_subtree_check)
>>> 
>>> 33. sudo exportfs -a
>>> 
>>> 34.
>>>   $ sudo mkdir /mnt/primary
>>>   $ sudo mount -t nfs 10.4.6.17:/export/primary /mnt/primary
>>>   $ sudo mkdir /mnt/secondary
>>>   $ sudo mount -t nfs 10.4.6.17:/export/secondary /mnt/secondary
>>> 
>>> 35. df -h
>>> 
>>> 36.
>>> vi /etc/fstab
>>> 
>>> 10.4.6.17:/export/primary /mnt/primary nfs rw,tcp,intr 0  1
>>> 10.4.6.17:/export/secondary /mnt/secondary nfs rw,tcp,intr 0  1
>>> 
>>> 36.1 --- configuring IP Table
>>> $NETWORK=10.4.6.0/24
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p udp --dport
>> 111
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p tcp --dport
>> 111
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p tcp --dport
>> 2049
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p tcp --dport
>>> 32803 -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p udp --dport
>>> 32769 -j ACCEPT
>>> sudo iptables  -A INPUT -s $NETWORK -m state --state NEW -p tcp --dport
>> 892
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p udp --dport
>> 892
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p tcp --dport
>> 875
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p udp --dport
>> 875
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p tcp --dport
>> 662
>>> -j ACCEPT
>>> sudo iptables -A INPUT -s $NETWORK -m state --state NEW -p udp --dport
>> 662
>>> -j ACCEPT
>>> 
>>> 36.2 sudo apt-get install iptables-persistent
>>> //iptables -help https://help.ubuntu.com/community/IptablesHowTo
>>> 
>>> //install system vm -template
>>> 37.
>>> 
>>> sudo
>>> 
>> /usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt
>>> -m /mnt/secondary -u
>>> 
>> http://d21ifhcun6b1t2.cloudfront.net/templates/4.2/systemvmtemplate-2013-06-12-master-kvm.qcow2.bz2-h
>>> kvm -s cloudstack -F
>>> 
>>> 38.
>>> 
>>> Connect to server
>>> 
>>> Tests before connecting to server
>>> -------------------
>>> /etc/init.d/cloudstack-management stop
>>> /etc/init.d/tomcat6 stop
>>> /etc/init.d/cloudstack-agent stop
>>> ps -efl | grep java
>>> /etc/init.d/cloudstack-management start
>>> /etc/init.d/cloudstack-management status
>>> /etc/init.d/cloudstack-agent start
>>> /etc/init.d/cloudstack-agent status
>>> 
>>> 38.1 sudo apt-get install ssh
>>> 
>>> http://10.4.6.17:8080/client
>>> 
>>> I was getting host Add Problem . so I installed ssh and the error got
>>> solved.
>>> 
>>> Anything else I need to follow
>>> 
>>> Your help is needed friends now.
>>> 
>>> Thankyou
>>> 
>>> 
>>> --
>>> SANDEEP KHANDEKAR
>>> Assistant Professor
>>> Department of Computer science and engineering
>>> Sreenidhi Institute of science and Technology
>>> Hyderabad
>> 
>> 
> 
> 
> -- 
> SANDEEP KHANDEKAR
> Assistant Professor
> Department of Computer science and engineering
> Sreenidhi Institute of science and Technology
> Hyderabad


Mime
View raw message