Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@cloudstack.apache.org
From: Prashant Mishra <prashant.mishra@accelerite.com>
To: "users@cloudstack.apache.org" <users@cloudstack.apache.org>
Subject: Re: Upgrade of Primary storage.
Thread-Topic: Upgrade of Primary storage.
Thread-Index: AQHRrOURXFdErFts6UyDhdcQnsSBbZ+20/WAgAADVQCAESUMgA==
Date: Tue, 24 May 2016 05:27:30 +0000
Message-ID: <D369E3DD.36B54%prashant.mishra@accelerite.com>
References: <CABdC_7nMp5NRYRgm-374gVNnHb0A=7206e-cSs1kV+iwH92cWg@mail.gmail.com>
 <20160513124905.M56958@www.testlabs.com.au>
 <CABdC_7kbKXg93KYHaDfrfebmhDeT1mLEbGc55yEm9hX2+MngJA@mail.gmail.com>
In-Reply-To: <CABdC_7kbKXg93KYHaDfrfebmhDeT1mLEbGc55yEm9hX2+MngJA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [121.240.161.130]
x-ms-office365-filtering-correlation-id: 1ebaf4d2-6028-465c-bbfd-08d383941a5d
x-microsoft-exchange-diagnostics: 1;PN1PR01MB0573;5:Px0Ee6ZDT983x6YkglYKSvvBIEDmJ+sVSt+r56uegnX1ZQ+zszj2+195f60fpPF1Z/RBNR9phgsROkzuTcoyrklPH9VCz3taOij7w3sDklZt2i4PQVY4fxXX3IVyHTD8Vp1lAZSri4geMvRPTbYFig==;24:/drbUAz4+wLSuFusZxt/gjDZYQrAhebGOZ2Io/7YhLfBmXnJx3h78Zy84+qLnKmkeGgB1kTvf4Bxkj8fCMar6tigsbNqpCM/obAdNKLcobQ=;7:MuD/p6dgBrWSjySLlPDq5YRG0F8nXq1PBFdc5gR9AvBd9leOcu0+StJcciMI51iZP1FT/qqGHGugzbE4r0rDjnmkXqXlFhuvBiW8Gka8X+FScjGzJ1QIxTqcreOPmZAftxYKW9kudAlQrxMgWa9jvdLtPZ2gViWHQ2OAAT6mrX/mDnpzSNW8Sx3krTiL8lbN
x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:PN1PR01MB0573;
x-microsoft-antispam-prvs: <PN1PR01MB0573298FD4CBE662C1F03D9D934F0@PN1PR01MB0573.INDPRD01.PROD.OUTLOOK.COM>
x-exchange-antispam-report-test: UriScan:;
x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(2401047)(5005006)(8121501046)(3002001)(10201501046)(6055026);SRVR:PN1PR01MB0573;BCL:0;PCL:0;RULEID:;SRVR:PN1PR01MB0573;
x-forefront-prvs: 09525C61DB
x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(6009001)(13464003)(377454003)(11905935001)(24454002)(77096005)(122556002)(1720100001)(5004730100002)(19580405001)(19580395003)(81166006)(1730700003)(450100001)(2950100001)(2900100001)(8936002)(15975445007)(92566002)(8676002)(54356999)(76176999)(5008740100001)(50986999)(66066001)(3480700004)(2906002)(110136002)(107886002)(10400500002)(87936001)(2351001)(86362001)(106116001)(5002640100001)(189998001)(36756003)(2501003)(1220700001)(3660700001)(586003)(3280700002)(102836003)(6116002)(3846002);DIR:OUT;SFP:1101;SCL:1;SRVR:PN1PR01MB0573;H:PN1PR01MB0574.INDPRD01.PROD.OUTLOOK.COM;FPR:;SPF:None;MLV:sfv;LANG:en;
spamdiagnosticoutput: 1:23
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="us-ascii"
Content-ID: <DBAF073E09406A428E809AF3AF429B5D@INDPRD01.PROD.OUTLOOK.COM>
content-transfer-encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-originalarrivaltime: 24 May 2016 05:27:30.6683
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 1f4beacd-b7aa-49b2-aaa1-b8525cb257e0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PN1PR01MB0573
X-OriginatorOrg: accelerite.com
X-Brightmail-Tracker: H4sIAAAAAAAAA3WSeUgUcRTH+e3MjrNLG78s82ER24SRx1qLR1quZXbYRYmkEUQNsz902nV2
	2dmiEzSLDsraP6LSKA0tuzQsurQor3IjzDCj7ETpoFPDpLJjxtkgiOaPH5/3fb/35f3ePJYK
	vsiEsaLkJR6Jd3KMkTZGD6RaZr1My560uToy8bWvj5mO0q8V7tAtRsvyUTIvSS4v7yVmO5EF
	G5cqCMRJPKIiLCA5vNM8U5QFJy/mEQ9nFu02Lo4zu528QPKI5LVxvNtNJDuXYjT/8yUr10TJ
	TCTBZRelHBs3N3ORJTExPsli5VLGj7PGTjUq58qP+tzmd88Zd934tae+9unzUemYncjAAo6D
	G1ff6DUeCXefVjM7kZENxud1UHXKT2lBA4L6W4+C1IDGJRR0+tp0WuY+gqKmsiAtaEbw+UYn
	pZoxOAG6KjsZlUfgaVD4pIdWeTieAIc/fA/oEdDa+ElhVuEZ8P6CTZVpHA4d5ccGbUx4Kmwr
	bAv01ITgYWPXYMKAM+BAyx2kMlIa7/ef1qlM4VB41H1Epz0IQ3ldK6VxCLzp+qlXjRA+gaCl
	rC9wKRruPOhGGo8D/8ueAC+Ee7V+Wi0A/IuCXTXdtJaYDQXXCwIjc0B1RWWAI2F7Y7FOKziL
	4NzPdkp9GuDRcKl3sqbv00NZ5fYgbRRhUFB3gt6Loor/6lzjaCit7WWKlXIKp0NFeYgmR8Gx
	srdU8eBkhkHLwW66FOlPolG5qyxyntdtEaUYN/HIouxV9iZGcMWIUg1St9PC4kuotGp2PcIs
	4oaYvrSnZQfr+TXyurx6BCzFjTAdf6BIJju/bj3xuFZ4VjuJXI8WKL/DR4WFCC5JtVxhjU1K
	Spo0OSE2NsFq/Y/MhZqWuuOyg3GOsvAOQpSO/tjpWENYPmoeaKgorJjZ6SA9U5ZXpbdbDMZ4
	P3fL93GO9VtJS/Ihsnz+QOrQm4a74qyJRfxbnMilZEZVv4jffWXe86MdoUte4bStwo8IyPJN
	vPzjdi3Tvqkh4vjXxocZa3Jrwh+37h+bkDEv/D3s6S/q7d/qeLeh42hWk+NZ29IzQU55S/Ta
	jRwt5/LWSMoj878BLxsrxMoDAAA=
archived-at: Tue, 24 May 2016 05:27:53 -0000

Here you go https://support.accelerite.com/hc/en-us/articles/208896246 ,
you may need to login to access it .

Thanks
Prashant 

On 5/13/16, 6:38 PM, "Makrand" <makrandsanap@gmail.com> wrote:

>Hi Adrian,
>
>Thanks for reply and hints.Will keep that in mind. But as of now I am more
>keen on upgrading storage BOX OS and absolutely ok with downtime. (aka
>management is not ready to spend anything on additional hardware/infra :D)
>
>Makrand
>
>
>
>--
>Best,
>Makrand
>
>
>On Fri, May 13, 2016 at 6:26 PM, Adrian Sender <asender@testlabs.com.au>
>wrote:
>
>> Hi Makrand,
>>
>> There are many different ways to achieve storage migration; I would
>> probably
>> add the new LUN and within cloudstack perform a storage migration on the
>> instances (there would potentially be no outage).
>>
>> For the NFS you could rsync preserving the directory structure, update
>>the
>> database and rebuild SSVM.
>>
>> There was an article for secondary storage migration but it seems to
>>have
>> vanished from the Citrix website; maybe someone from Accelerite knows
>> where it
>> is now - http://support.citrix.com/article/CTX135229
>>
>> - Adrian Sender
>>
>> ---------- Original Message -----------
>> From: Makrand <makrandsanap@gmail.com>
>> To: users@cloudstack.apache.org
>> Sent: Fri, 13 May 2016 12:28:28 +0530
>> Subject: Upgrade of Primary storage.
>>
>> > Guys,
>> >
>> > Need little help. So in my second week on new job, I am suppose to
>> upgrade
>> > Nexeta (Primary storage and secondary storage for cloud) OS.
>> >
>> > Overview of setup:-
>> >
>> > 1Zone>>1POD>>1 Cluster>>8 Hosts
>> >
>> > Hypervisor:- Citrix Xenserer 6.5 (Free edition)
>> >
>> > Storage Primary (Cluster Level):- On nexenta
>> >
>> > Secondary Storage:- On same nexenta BOX (which caters primary)
>> >
>> > Management Node is VM (Ubuntu 12004 LTS) whos root disk resides
>> > again on primary storage coming from same nexenta BOX. Seems LUN is
>> > different. This VM is running on Management cluster (2 XEN 6.5 hosts).
>> >
>> > Well not sure why and how they kept single storage BOX for all
>> > primary and secondary. Pretty wiered. It was done by a Vendor or
>> > someone long back. Thats whole different story.
>> >
>> > Any-who, coming to point of this email. I've chalked out plan like
>>below.
>> > ------------------------------------------------------
>> > A) Shutdown all VMs in following order:- First user VMs, then VRs &
>>then
>> > System VMs.
>> >
>> > B) Put all XEN hosts in MM (Maintenance mode) from cloudstack.
>> >
>> >  1) Verify that all hosts are down (Shutdown them one by one) from
>> > XEN Center
>> >
>> > C) ssh into Management Server VM.  Backup cloudstack DB save it on
>> JumpBOX
>> > (Use WinSCP)
>> >
>> > D) Shutdown Cloudstack Management Server VM and other VMs on
>>management
>> > cluster. This needs to be done by issuing 'shutdown' command from OS
>> > level.
>> >
>> > E) Shutdown Management cluster XEN hosts.
>> >
>> > F) Upgrade the storage.  (Reboot is needed at end.......hence so many
>> > shutdowns)
>> >
>> > G) Once upgrade is done start the Machines (Physical and Virtual) in
>> > reveres order than that of shutdown. (Step E to A above) Something
>>like
>> > below
>> >
>> >  1) Management clsuter XEN hosts
>> >  2) Cloudstack management server VM and other management cluster VMs
>> >  3) XEN Hypervisor Nodes under cloud.
>> >  4) Take XEN hosts out of MM from cloudstack admin GUI.
>> >  5) Start SSVM and console proxy VM (I guess this time cloudstack
>> > will recreate CPVM and SSVM if we      start first user VM.....not
>> > sure if this step will be needed) 6) Customer VMs and corresponding
>>VRs
>> >
>> > H) Verify from and try to deploy test VM.
>> > ------------------------------------------------------
>> >
>> > All this downtime is ok. Do you think I am missing anything. Any
>>comments
>> > on improvising? Should I expect some more glitches? What was your
>> previous
>> > experience with primary storage upgrade.
>> >
>> > Note:-
>> > Last time same upgrade happened for one of similar zone and there
>> > was issue of mapping primary storage LUNs with XEN hosts. Restart of
>> > hosts did trick that time and hence my manager wants to shutdown all
>> > physical hosts this time (Since all VMs have their disks on this
>> > storage box...which will reboot once or twice during upgrade)
>> >
>> > BTW
>> >
>> > 1) Is it necessary to put XEN hosts in MM from cloudstack? (If I am
>> > shutting down all VMs).
>> >
>> > 2) After I bring UP Management server in step G-1, will it still
>> > have host in MM? or What would it try to do after its up? (Assuming
>> > all hosts in cluster are down at that time.
>> >
>> > Thanks for reading.
>> >
>> > --
>> > Best,
>> > Makrand
>> ------- End of Original Message -------
>>
>>


DISCLAIMER
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
This e-mail may contain privileged and confidential information which is the=
 property of Accelerite, a Persistent Systems business. It is intended only=
 for the use of the individual or entity to which it is addressed. If you ar=
e not the intended recipient, you are not authorized to read, retain, copy,=
 print, distribute or use this message. If you have received this communicat=
ion in error, please notify the sender and delete all copies of this message=
. Accelerite, a Persistent Systems business does not accept any liability fo=
r virus infected mails.