cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dag Sonstebo <Dag.Sonst...@shapeblue.com>
Subject Re: Deletion of expunged volumes
Date Tue, 22 Nov 2016 12:16:14 GMT
I suspect not – but Koushik / someone else may have more information.

To manually clean up you will probably have to:
- back up database / snapshot storage (just in case..)
- update cloud.volumes set state=’Expunged’ and removed=now() where id=XX.
- manually delete from disk.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue


Dag.Sonstebo@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue
  
 

On 22/11/2016, 11:59, "Natalia Costas Lago" <natalia@cesga.es> wrote:

    
    It seems that is the issue we are suffering. We expunged VMs prior to 
    secondary storage cleanup.
    
    Is there a way to delete those volumes manually or to force cleaning 
    them up?
    
    
    El 22/11/2016 a las 11:55, Koushik Das escribió:
    > There is an open PR which fixes a similar issue https://github.com/apache/cloudstack/pull/1726.
Check it out.
    >
    > -Koushik
    >
    > On 22/11/16, 4:05 PM, "Natalia Costas Lago" <natalia@cesga.es> wrote:
    >
    >      Hi Dag,
    >      
    >      
    >      It is expunged..., but "removed" it is not set to a date..
    >      
    >      
    >      ** In the database:
    >      
    >      MariaDB [cloud]> select * from volumes where name="ROOT-1241"\G;
    >      *************************** 1. row ***************************
    >                               id: 1283
    >                       account_id: 2
    >                        domain_id: 1
    >                          pool_id: 9
    >                     last_pool_id: NULL
    >                      instance_id: 1241
    >                        device_id: 0
    >                             name: ROOT-1241
    >                             uuid: 88f8e37d-8d84-48d5-9671-912e5749a288
    >                             size: 10737418240
    >                           folder: NULL
    >                             path: 88f8e37d-8d84-48d5-9671-912e5749a288
    >                           pod_id: NULL
    >                   data_center_id: 1
    >                       iscsi_name: NULL
    >                          host_ip: NULL
    >                      volume_type: ROOT
    >                        pool_type: NULL
    >                 disk_offering_id: 23
    >                      template_id: 245
    >      first_snapshot_backup_uuid: NULL
    >                      recreatable: 0
    >                          created: 2016-11-09 13:16:48
    >                         attached: NULL
    >                          updated: 2016-11-09 15:44:53
    >                          removed: NULL
    >                            state: Expunged
    >                       chain_info: NULL
    >                     update_count: 8
    >                        disk_type: NULL
    >           vm_snapshot_chain_size: NULL
    >                           iso_id: NULL
    >                   display_volume: 1
    >                           format: QCOW2
    >                         min_iops: NULL
    >                         max_iops: NULL
    >                    hv_ss_reserve: NULL
    >                provisioning_type: sparse
    >      1 row in set (0.00 sec)
    >      
    >      MariaDB [cloud]> select * from volume_view where name="ROOT-1241"\G;
    >      *************************** 1. row ***************************
    >                               id: 1283
    >                             uuid: 88f8e37d-8d84-48d5-9671-912e5749a288
    >                             name: ROOT-1241
    >                        device_id: 0
    >                      volume_type: ROOT
    >                provisioning_type: sparse
    >                             size: 10737418240
    >                         min_iops: NULL
    >                         max_iops: NULL
    >                          created: 2016-11-09 13:16:48
    >                            state: Expunged
    >                         attached: NULL
    >                          removed: NULL
    >                           pod_id: NULL
    >                   display_volume: 1
    >                           format: QCOW2
    >                             path: 88f8e37d-8d84-48d5-9671-912e5749a288
    >                       chain_info: NULL
    >                       account_id: 2
    >                     account_uuid: f1252dbd-7d0f-11e6-a07c-02000a700064
    >                     account_name: admin
    >                     account_type: 1
    >                        domain_id: 1
    >                      domain_uuid: c8665aea-7c12-11e6-a07c-02000a700064
    >                      domain_name: ROOT
    >                      domain_path: /
    >                       project_id: NULL
    >                     project_uuid: NULL
    >                     project_name: NULL
    >                   data_center_id: 1
    >                 data_center_uuid: 07c2912e-fbd4-43fc-8279-083ed6342817
    >                 data_center_name: zona1
    >                 data_center_type: Advanced
    >                            vm_id: 1241
    >                          vm_uuid: d4215497-d009-4349-8fb4-c4a739d50d6d
    >                          vm_name: test-qcow2-kk
    >                         vm_state: Expunging
    >                          vm_type: User
    >                  vm_display_name: test-qcow2-kk
    >                volume_store_size: 0
    >                     download_pct: 0
    >                   download_state: NULL
    >                        error_str: NULL
    >                 created_on_store: 2016-11-09 13:19:13
    >                 disk_offering_id: 23
    >               disk_offering_uuid: 5cc82a5d-2755-42a0-880f-4b0c6c86936a
    >               disk_offering_name: Standard IO, shared storage, sparse volume
    >      disk_offering_display_text: Standard IO, shared storage, sparse volume
    >                use_local_storage: 0
    >                       system_use: 0
    >                  bytes_read_rate: NULL
    >                 bytes_write_rate: NULL
    >                   iops_read_rate: NULL
    >                  iops_write_rate: NULL
    >                       cache_mode: NULL
    >                          pool_id: 9
    >                        pool_uuid: c69fb76e-f2f9-359e-bda0-1259786717af
    >                        pool_name: almacenamiento-primario-gluster
    >                  hypervisor_type: NULL
    >                      template_id: 245
    >                    template_uuid: 730001de-bdd9-464e-ba7b-f38668953e6d
    >                      extractable: 1
    >                    template_type: USER
    >                    template_name: centos7-comiteado-raw
    >            template_display_text: centos7-comiteado-raw
    >                           iso_id: NULL
    >                         iso_uuid: NULL
    >                         iso_name: NULL
    >                 iso_display_text: NULL
    >                           tag_id: NULL
    >                         tag_uuid: NULL
    >                          tag_key: NULL
    >                        tag_value: NULL
    >                    tag_domain_id: NULL
    >                  tag_domain_uuid: c8665aea-7c12-11e6-a07c-02000a700064
    >                  tag_domain_name: ROOT
    >                   tag_account_id: NULL
    >                 tag_account_name: admin
    >                  tag_resource_id: NULL
    >                tag_resource_uuid: NULL
    >                tag_resource_type: NULL
    >                     tag_customer: NULL
    >                           job_id: NULL
    >                         job_uuid: NULL
    >                       job_status: NULL
    >                   job_account_id: NULL
    >      1 row in set (0.00 sec)
    >      
    >      ERROR: No query specified
    >      
    >      ** In the user interface:
    >      
    >      Name 	ROOT-1241
    >      
    >      ID 	88f8e37d-8d84-48d5-9671-912e5749a288
    >      Zone 	zona1
    >      State 	Expunged
    >      Status 	
    >      Disk Offering 	
    >      Type 	ROOT
    >      Storage Type 	shared
    >      Provisioning Type 	sparse
    >      Hypervisor 	KVM
    >      Size 	10.00 GB
    >      Min IOPS 	
    >      Max IOPS 	
    >      VM ID 	d4215497-d009-4349-8fb4-c4a739d50d6d
    >      VM display name 	test-qcow2-kk
    >      VM state 	Expunging
    >      Device ID 	0
    >      Storage 	almacenamiento-primario-gluster
    >      Created 	09 Nov 2016 14:16:48
    >      Domain 	ROOT
    >      Account 	admin
    >      
    >      
    >      ** In the primary gluster storage:
    >      
    >      [root@c11-37 ~]# ls -lah
    >      /mnt/c69fb76e-f2f9-359e-bda0-1259786717af/730001de-bdd9-464e-ba7b-f38668953e6d
    >      -rwxr--r-- 1 root root 3.8G Nov  9 12:41
    >      /mnt/c69fb76e-f2f9-359e-bda0-1259786717af/730001de-bdd9-464e-ba7b-f38668953e6d
    >      
    >      
    >      El 22/11/2016 a las 10:14, Dag Sonstebo escribió:
    >      > Hi Natalia,
    >      >
    >      > So in other words the database shows the volumes as “expunged” and
removed set to a date, but you can still find the volumes on your primary storage?
    >      >
    >      > Regards,
    >      > Dag Sonstebo
    >      > Cloud Architect
    >      > ShapeBlue
    >      >
    >      >
    >      > Dag.Sonstebo@shapeblue.com
    >      > www.shapeblue.com
    >      > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    >      > @shapeblue
    >      >
    >      >
    >      >
    >      > On 21/11/2016, 20:33, "Natalia Costas Lago" <natalia@cesga.es> wrote:
    >      >
    >      >
    >      >      Dear Dag,
    >      >
    >      >      Those parameters are set to 86400, but before I also tried setting
them
    >      >      to 60 seconds and restarting the management server. I have also been
out
    >      >      of the office for a week so the volumes have been there long enough
to
    >      >      be actually deleted.
    >      >
    >      >      Regards,
    >      >
    >      >
    >      >
    >      >      El 21/11/2016 a las 19:30, Dag Sonstebo escribió:
    >      >      > Natalia,
    >      >      >
    >      >      > What are your expunge.delay and expunge.interval global settings
set to?
    >      >      >
    >      >      > Regards,
    >      >      > Dag Sonstebo
    >      >      > Cloud Architect
    >      >      > ShapeBlue
    >      >      >
    >      >      >
    >      >      > Dag.Sonstebo@shapeblue.com
    >      >      > www.shapeblue.com
    >      >      > 53 Chandos Place, Covent Garden, London  WC2N 4HSUK
    >      >      > @shapeblue
    >      >      >
    >      >      >
    >      >      >
    >      >      > On 21/11/2016, 18:13, "Natalia Costas Lago" <natalia@cesga.es>
wrote:
    >      >      >
    >      >      >
    >      >      >      Hi,
    >      >      >
    >      >      >
    >      >      >      At our cloudstack deployment we have volumes that have been
expunged but
    >      >      >      not deleted. I think the problem is related with the next
documented issue:
    >      >      >
    >      >      >      https://issues.apache.org/jira/browse/CLOUDSTACK-9119
    >      >      >
    >      >      >      Is there a way to force the deletion of expunged volumes
in this situation?
    >      >      >
    >      >      >      Thanx in advance
    >      >      >
    >      >      >      --
    >      >      >      ====================================================
    >      >      >      Natalia Costas Lago
    >      >      >      Senior Communications Technician
    >      >      >      Galicia Supercomputing Centre (CESGA)
    >      >      >      (CESGA on Twitter  |  CESGA on Facebook)
    >      >      >
    >      >      >      Avenida de Vigo, s/n (Campus Vida)
    >      >      >      15705 Santiago de Compostela - SPAIN
    >      >      >
    >      >      >      E-mail: natalia@cesga.es
    >      >      >      Cell: +34 981 56 98 10 (ext. 237)
    >      >      >      Fax: +34 981 59 46 16
    >      >      >      Web: https://www.cesga.es/
    >      >      >      ====================================================
    >      >      >      [IMPORTANTE] La información contenida en este mensaje y
    >      >      >      sus posibles documentos adjuntos es privada y confidencial
    >      >      >      y está dirigida únicamente a su destinatario/a. Si usted
no
    >      >      >      es el/la destinatario/a original de este mensaje, por favor
    >      >      >      elimínelo. La distribución o copia de este mensaje no
está
    >      >      >      autorizada.
    >      >      >
    >      >      >
    >      >      >
    >      >
    >      >      --
    >      >      ====================================================
    >      >      Natalia Costas Lago
    >      >      Senior Communications Technician
    >      >      Galicia Supercomputing Centre (CESGA)
    >      >      (CESGA on Twitter  |  CESGA on Facebook)
    >      >
    >      >      Avenida de Vigo, s/n (Campus Vida)
    >      >      15705 Santiago de Compostela - SPAIN
    >      >
    >      >      E-mail: natalia@cesga.es
    >      >      Cell: +34 981 56 98 10 (ext. 237)
    >      >      Fax: +34 981 59 46 16
    >      >      Web: https://www.cesga.es/
    >      >      ====================================================
    >      >      [IMPORTANTE] La información contenida en este mensaje y
    >      >      sus posibles documentos adjuntos es privada y confidencial
    >      >      y está dirigida únicamente a su destinatario/a. Si usted no
    >      >      es el/la destinatario/a original de este mensaje, por favor
    >      >      elimínelo. La distribución o copia de este mensaje no está
    >      >      autorizada.
    >      >
    >      >
    >      >
    >      
    >      --
    >      ====================================================
    >      Natalia Costas Lago
    >      Senior Communications Technician
    >      Galicia Supercomputing Centre (CESGA)
    >      (CESGA on Twitter  |  CESGA on Facebook)
    >      
    >      Avenida de Vigo, s/n (Campus Vida)
    >      15705 Santiago de Compostela - SPAIN
    >      
    >      E-mail: natalia@cesga.es
    >      Cell: +34 981 56 98 10 (ext. 237)
    >      Fax: +34 981 59 46 16
    >      Web: https://www.cesga.es/
    >      ====================================================
    >      [IMPORTANTE] La información contenida en este mensaje y
    >      sus posibles documentos adjuntos es privada y confidencial
    >      y está dirigida únicamente a su destinatario/a. Si usted no
    >      es el/la destinatario/a original de este mensaje, por favor
    >      elimínelo. La distribución o copia de este mensaje no está
    >      autorizada.
    >      
    >      
    >
    >
    >
    >
    > DISCLAIMER
    > ==========
    > This e-mail may contain privileged and confidential information which is the property
of Accelerite, a Persistent Systems business. It is intended only for the use of the individual
or entity to which it is addressed. If you are not the intended recipient, you are not authorized
to read, retain, copy, print, distribute or use this message. If you have received this communication
in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent
Systems business does not accept any liability for virus infected mails.
    
    -- 
    ====================================================
    Natalia Costas Lago
    Senior Communications Technician
    Galicia Supercomputing Centre (CESGA)
    (CESGA on Twitter  |  CESGA on Facebook)
    
    Avenida de Vigo, s/n (Campus Vida)
    15705 Santiago de Compostela - SPAIN
    
    E-mail: natalia@cesga.es
    Cell: +34 981 56 98 10 (ext. 237)
    Fax: +34 981 59 46 16
    Web: https://www.cesga.es/
    ====================================================
    [IMPORTANTE] La información contenida en este mensaje y
    sus posibles documentos adjuntos es privada y confidencial
    y está dirigida únicamente a su destinatario/a. Si usted no
    es el/la destinatario/a original de este mensaje, por favor
    elimínelo. La distribución o copia de este mensaje no está
    autorizada.
    
    

Mime
View raw message