Return-Path: X-Original-To: apmail-cloudstack-users-archive@www.apache.org Delivered-To: apmail-cloudstack-users-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 72BCE18F0C for ; Wed, 10 Jun 2015 11:06:03 +0000 (UTC) Received: (qmail 13664 invoked by uid 500); 10 Jun 2015 11:06:02 -0000 Delivered-To: apmail-cloudstack-users-archive@cloudstack.apache.org Received: (qmail 13610 invoked by uid 500); 10 Jun 2015 11:06:02 -0000 Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@cloudstack.apache.org Delivered-To: mailing list users@cloudstack.apache.org Received: (qmail 13544 invoked by uid 99); 10 Jun 2015 11:06:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jun 2015 11:06:02 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=FREEMAIL_REPLY,HTML_MESSAGE,NORMAL_HTTP_TO_IP,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of andrija.panic@gmail.com designates 209.85.212.176 as permitted sender) Received: from [209.85.212.176] (HELO mail-wi0-f176.google.com) (209.85.212.176) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jun 2015 11:03:47 +0000 Received: by wiwd19 with SMTP id d19so44530657wiw.0; Wed, 10 Jun 2015 04:04:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ToZF5QiEi4PtzCpTlznjspeo0waGumlC5JN49erDQw4=; b=fGdlf0whNRjWCSz7T6iC66U3/tCKjfvcNQo/9F0a/yFp+9L4mCcoUuuiNlde9u6bq9 c0zIPNTc1cAQkFz4wJW4Hsnm2lg625Bx3eB0nnEZ8JCqwQKSYt0QYjgTxE5kBCsfqrJM gvcdD2jKSxtYd3zK3JoVXbF6g4ChqROCA0hzpB1KCUQyedwN/mihMNXp9MAr4EemkMD1 xcoVREcTEkMJwP6mNVnUl9zl7xAFotRRTjVTfNebqScz1NeahP8rLtNkRMdc1+xIHZdL Wk9W1j+rnzmEg3ThhFfGbZTkm1SJdI0ybyzcMnfFg8mQNioqZ275lZoiJZgK+MV3H4/Y m0aQ== MIME-Version: 1.0 X-Received: by 10.194.95.41 with SMTP id dh9mr5248721wjb.55.1433934290989; Wed, 10 Jun 2015 04:04:50 -0700 (PDT) Received: by 10.28.172.199 with HTTP; Wed, 10 Jun 2015 04:04:50 -0700 (PDT) In-Reply-To: <4453A64AA18C714C96963CC43A5FDA120A654AD2@bit-mail-01.bit.group> References: <4453A64AA18C714C96963CC43A5FDA120A65393A@bit-mail-01.bit.group> <4453A64AA18C714C96963CC43A5FDA120A6547B0@bit-mail-01.bit.group> <4453A64AA18C714C96963CC43A5FDA120A654AD2@bit-mail-01.bit.group> Date: Wed, 10 Jun 2015 13:04:50 +0200 Message-ID: Subject: Re: Problem Upload Windows volume to ACS 4.5.1 From: Andrija Panic To: "users@cloudstack.apache.org" Cc: "dev@cloudstack.apache.org" Content-Type: multipart/alternative; boundary=047d7bea453c0bc345051827d831 X-Virus-Checked: Checked by ClamAV on apache.org --047d7bea453c0bc345051827d831 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable How do I do that :) it's auto generated hash/filename inside SSVM - sumlink to reall file... I can try to edit this link name maybe...and try ? On 10 June 2015 at 12:51, Jochim, Ingo wrote: > What if you remove the file extension? > > -----Urspr=C3=BCngliche Nachricht----- > Von: Andrija Panic [mailto:andrija.panic@gmail.com] > Gesendet: Mittwoch, 10. Juni 2015 10:06 > An: users@cloudstack.apache.org > Cc: dev@cloudstack.apache.org > Betreff: Re: Problem Upload Windows volume to ACS 4.5.1 > > Marcus, > > Since file on the old ACS is really RAW (template, created from snapshot, > and snapshot created from CEPH volume) - why didn't ACS convert it to > qcow2? It has named it xxxxx. qcow2 on secondary NFS. > ... > > I get folowing error in the new ACS, when I select RAW as the source > format to Upload volume: > > "Please specify a valid URL. > URL:/userdata/7a27330d-0080-444d-9807-3fa9bd3997c5.qcow2 is an invalid fo= r > the format raw" > > So source image has QCOW2 extension, RAW format, and destination ACS > doesnt allow RAW format download if the extension is QCOW2... :( > > So basically I'm unable to extract CEPH volumes at all and move them to > another ACS installation :( > > On 10 June 2015 at 07:51, Jochim, Ingo wrote: > > > "qemu-img info " will also give you the information what > > type the file is. > > > > -----Urspr=C3=BCngliche Nachricht----- > > Von: Marcus [mailto:shadowsor@gmail.com] > > Gesendet: Mittwoch, 10. Juni 2015 01:54 > > An: dev@cloudstack.apache.org > > Cc: users@cloudstack.apache.org > > Betreff: Re: Problem Upload Windows volume to ACS 4.5.1 > > > > Looks like it is seeing a raw disk, when you specified it was QCOW2. > > That's what the 'file' command is doing. We used to just trust the > > name of the file, but this was enhanced to inspect the first 1MB of > > the download and validate that you are supplying the image format that > CS expects. > > > > Because the first 1MB shows that this image has a boot sector, I'm > > assuming it is a raw disk image, instead of a qcow2. Note that > > CloudStack > > 4.5 should support raw format for KVM images, but you have to specify > > it on the API. > > > > [root@devcloud-kvm7 tmp]# qemu-img create -f qcow2 img.qcow2 1G > > > > Formatting 'img.qcow2', fmt=3Dqcow2 size=3D1073741824 encryption=3Doff > > cluster_size=3D65536 lazy_refcounts=3Doff > > > > > > [root@devcloud-kvm7 tmp]# qemu-img create -f raw img.raw 1G > > > > Formatting 'img.raw', fmt=3Draw size=3D1073741824 > > > > > > [root@devcloud-kvm7 tmp]# file img.qcow2 > > > > img.qcow2: QEMU QCOW Image (v3), 1073741824 bytes > > > > > > [root@devcloud-kvm7 tmp]# parted img.raw mklabel > > > > New disk label type? msdos > > > > > > [root@devcloud-kvm7 tmp]# file img.raw > > > > img.raw: x86 boot sector, code offset 0xb8 > > > > On Tue, Jun 9, 2015 at 3:01 AM, Jochim, Ingo > > > > wrote: > > > > > Hi Andrija, > > > > > > have you tried to convert (qemu-img convert) it to RAW and upload the= n? > > > Ceph is using RAW devices. The conversion takes place on storage > > > migration but on upload? > > > > > > Regards, > > > Ingo > > > > > > -----Urspr=C3=BCngliche Nachricht----- > > > Von: Andrija Panic [mailto:andrija.panic@gmail.com] > > > Gesendet: Dienstag, 9. Juni 2015 10:24 > > > An: dev@cloudstack.apache.org; users@cloudstack.apache.org > > > Betreff: Problem Upload Windows volume to ACS 4.5.1 > > > > > > HI guys, > > > > > > we try to move some volumes from one ACS installation to another > > > (from > > > 4.3.2 to 4.5.1). > > > > > > Since we are using CEPH, and volume extract/download doesn't work at > > > the moment, we do workarround, we snapshots Windows DATA volume, > > > convert to template, and then we extract URL / download. > > > > > > Then we use this URL to "Upload Volume" to ACS 4.5.1 - but it fails > > > almoust imiddiately with error inside SSVM (nothing usefull in > > > management > > > log) - and the volume is deleted from ACS: > > > > > > I see there is inspecting disk with "file" commands...any thought > > > why is this failing ? > > > > > > These are source Windows DATA disk btw: > > > > > > 2015-06-09 07:58:47,811 DEBUG [cloud.agent.Agent] > > > (agentRequest-Handler-10:null) Request:Seq 81-4133460032995983410: > > > { Cmd , > > > MgmtId: 90520741174948, via: 81, Ver: v1, Flags: 100011, > > > [{"org.apache.cloudstack.storage.command.DownloadCommand":{"hvm":fal > > > se > > > ,"maxDownloadSizeInBytes":5497558138880,"id":468,"resourceType":"VOL > > > UM > > > E","installPath":"volumes/2/468","_store":{"com.cloud.agent.api.to.N > > > fs > > > TO":{"_url":"nfs:// > > > 10.13.2.1/data/tank/secondary","_role":"Image"}},"url":" > > > http://46.232.180.244/userdata/6f2280e7-86d6-4fc7-abe8-e2bbfdeed442. > > > qc > > > ow2 ","format":"QCOW2","accountId":2,"name":"andrija2","wait":0}}] > > > } > > > 2015-06-09 07:58:47,814 DEBUG [cloud.agent.Agent] > > > (agentRequest-Handler-10:null) Processing command: > > > org.apache.cloudstack.storage.command.DownloadCommand > > > 2015-06-09 07:58:47,815 INFO > > > [storage.resource.NfsSecondaryStorageResource] > > > (agentRequest-Handler-10:null) Determined host 10.13.2.1 corresponds > > > to IP > > > 10.13.2.1 > > > 2015-06-09 07:58:47,873 INFO > > > [storage.template.HttpTemplateDownloader] > > > (agentRequest-Handler-10:null) No credentials configured for host=3D > > > 46.232.180.244:80 > > > 2015-06-09 07:58:47,895 INFO > > > [storage.template.HttpTemplateDownloader] > > > (pool-1-thread-3:null) Starting download from > > > http://46.232.180.244/userdata/6f2280e7-86d6-4fc7-abe8-e2bbfdeed442. > > > qc > > > ow2 > > > to > > > > > > /mnt/SecStorage/dd40674b-575d-3bd2-87b3-7f1e1db4c02e/volumes/2/468/d > > > nl d8533335093017660470tmp_ remoteSize=3D21474836480 , max > > > size=3D5497558138880 > > > 2015-06-09 07:58:47,909 DEBUG [utils.script.Script] > > > (pool-1-thread-3:null) > > > Executing: /bin/bash -c file > > > > > > /mnt/SecStorage/dd40674b-575d-3bd2-87b3-7f1e1db4c02e/volumes/2/468/d > > > nl > > > d8533335093017660470tmp_ > > > | cut -d: -f2 > > > 2015-06-09 07:58:47,936 DEBUG [utils.script.Script] > > > (pool-1-thread-3:null) Execution is successful. > > > 2015-06-09 07:58:47,941 INFO [storage.template.DownloadManagerImpl] > > > (pool-1-thread-3:null) Download Completion for jobId: > > > c95b3d60-f904-4ecc-ab9f-7ed1c36eba20, status=3DUNRECOVERABLE_ERROR > > > 2015-06-09 07:58:47,942 INFO [storage.template.DownloadManagerImpl] > > > (pool-1-thread-3:null) local: > > > > > > /mnt/SecStorage/dd40674b-575d-3bd2-87b3-7f1e1db4c02e/volumes/2/468/d > > > nl d8533335093017660470tmp_, bytes=3D1053854, error=3DTemplate conten= t > > > is unsupported, or mismatch between selected format and template > > > content. > > > Found : x86 boot sector; partition 1, pct=3D0 > > > 2015-06-09 07:58:50,876 DEBUG [cloud.agent.Agent] > > > (agentRequest-Handler-10:null) Seq 81-4133460032995983410: { Ans: , > > > MgmtId: 90520741174948, via: 81, Ver: v1, Flags: 10, > > > [{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"c95b3d60-f9 > > > 04 -4ecc-ab9f-7ed1c36eba20","downloadPct":0,"errorString":"Template > > > content is unsupported, or mismatch between selected format and > > > template content. Found : x86 boot sector; partition > > > 1","downloadStatus":"DOWNLOAD_ERROR","downloadPath":"/mnt/SecStorage > > > /d > > > d40674b-575d-3bd2-87b3-7f1e1db4c02e/volumes/2/468/dnld85333350930176 > > > 60 > > > 470tmp_","installPath":"volumes/2/468","templateSize":0,"templatePhy > > > Si calSize":0,"result":true,"details":"Template > > > content is unsupported, or mismatch between selected format and > > > template content. Found : x86 boot sector; partition 1","wait":0}}] > > > } > > > > > > -- > > > > > > Andrija Pani=C4=87 > > > > > > -- > > > This email was Virus checked by UTM 9. http://www.sophos.com > > > > > > -- > > > This email was Virus checked by UTM 9. http://www.sophos.com > > > > > > > -- > > This email was Virus checked by UTM 9. http://www.sophos.com > > > > > > -- > > Andrija Pani=C4=87 > > -- > This email was Virus checked by UTM 9. http://www.sophos.com > --=20 Andrija Pani=C4=87 --047d7bea453c0bc345051827d831--