Mailing-List: contact users-help@cloudstack.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@cloudstack.apache.org
From: Simon Weller <sweller@ena.com>
To: "users@cloudstack.apache.org" <users@cloudstack.apache.org>
Subject: Re: Management server + MySQL server requirements
Thread-Topic: Management server + MySQL server requirements
Thread-Index: AQHRcZqayPywxbd3SUWaKp+e115inp9AgURqgAJgwoCAAB46TA==
Date: Mon, 29 Feb 2016 13:16:17 +0000
Message-ID: 
 <BN3PR02MB119240B7E352734AE8A0C7BFA9BA0@BN3PR02MB1192.namprd02.prod.outlook.com>
References: <SNT148-W19C1C8994E7B416B95FBFBD2B80@phx.gbl>
 <BN3PR02MB1192F4310E369DC64319A43FA9B80@BN3PR02MB1192.namprd02.prod.outlook.com>,<5C04D727-8895-40D8-ABF2-360E3940784A@uva.nl>
In-Reply-To: <5C04D727-8895-40D8-ABF2-360E3940784A@uva.nl>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-messagesentrepresentingtype: 1
x-originating-ip: [96.4.0.206]
x-microsoft-exchange-diagnostics: 
 1;BN3PR02MB1191;5:W41XOJBVK4qHQqS4+TwOZWtcV+Th+YpWwH+j3ucEeSv7+vncSOt4ggcTOROfx00by/L3UuaIqeARB/oo/D/W75GxlwTYZGCYxEdwJragA/1W8lmGQQfpDPRChfX8Z/RyHwlCeq44uyolXfCXu6JbRA==;24:GPWI9UN7Q+8k97rNPsGCUDgquigRoAla/ABS1YqNu7TNgornXcIOYClH/xZtBotkkGKadVCJlxXNOjgMuCfXhPcNoR0axo7MIwNprqEV3qU=
x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BN3PR02MB1191;
x-ms-office365-filtering-correlation-id: c7f7c87a-54ed-409b-758c-08d3410a81de
x-microsoft-antispam-prvs: 
 <BN3PR02MB11918C53D928757806BDE70DA9BA0@BN3PR02MB1191.namprd02.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:;
x-exchange-antispam-report-cfa-test: 
 BCL:0;PCL:0;RULEID:(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001);SRVR:BN3PR02MB1191;BCL:0;PCL:0;RULEID:;SRVR:BN3PR02MB1191;
x-forefront-prvs: 0867F4F1AA
x-forefront-antispam-report: 
 SFV:NSPM;SFS:(10009020)(6009001)(57704003)(24454002)(377454003)(71364002)(2900100001)(2950100001)(10400500002)(189998001)(5008740100001)(99286002)(106116001)(6116002)(77096005)(102836003)(5001960100002)(110136002)(107886002)(19580395003)(586003)(3846002)(11100500001)(92566002)(1096002)(1220700001)(76576001)(5002640100001)(2906002)(50986999)(87936001)(5003600100002)(74316001)(3900700001)(3280700002)(3660700001)(5004730100002)(122556002)(40100003)(86362001)(76176999)(561944003)(19580405001)(15975445007)(33656002)(54356999)(2501003)(2351001);DIR:OUT;SFP:1101;SCL:1;SRVR:BN3PR02MB1191;H:BN3PR02MB1192.namprd02.prod.outlook.com;FPR:;SPF:None;MLV:sfv;LANG:en;
spamdiagnosticoutput: 1:23
spamdiagnosticmetadata: NSPM
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: ena.com
X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Feb 2016 13:16:17.2908
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 6dc38cd4-4d4f-4826-9649-17854289d170
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN3PR02MB1191
X-ENA-MailScanner-Information: Please contact support@ena.com for more
 information
X-ENA-MailScanner-ID: 85D1F1480304.ABBD0
X-ENA-MailScanner: No viruses found
X-ENA-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-11.4,
	required 4, ALL_TRUSTED -2.20, BAYES_00 -3.20, BOGOFILTER_GOOD -2.20,
	CRM114_GOOD -2.20, DKIM_SIGNED 0.10, DKIM_VALID -0.10,
	DKIM_VALID_AU -1.20, KAM_ASCII_DIVIDERS 0.80, SPF_HELO_PASS -1.20)
X-ENA-MailScanner-From: sweller@ena.com
X-ENA-MailScanner-Watermark: 1457356580.89611@yA5yjPnPZB20E5ni/omC7A

Stavros,

You need to use a Virtual IP Address (or the built in MySQL HA in Cloudstac=
k) to point all management servers to a single MySQL instance. If the prima=
ry fails, you use the above methods with some health checking to move the V=
IP (or let ACS Mgmt handle it via the MySQL connector) to the redundant MyS=
QL server.=20

This can be achieve with Keepalived, with a MySQL health check.

I will point out that in 4.7.x and probably in 4.8, the ACS MySQL HA functi=
onality (using the MySQL Java Connector)  seems to be broken. We are curren=
tly digging into it.

It's also possible to use a MySQL Active/Active Cluster via Galera. There a=
re a bunch of people doing this, although it can increase the complexity of=
 the install, so make sure you have really high quality health checking in =
case something goes south.

Here is the current list of DB HA possibilities: https://cwiki.apache.org/c=
onfluence/pages/viewpage.action?pageId=3D34838207

If you do deploy multiple active management servers, you'll need to put a l=
oad balancer (such as HAPROXY) in front of the servers.

Here is a port list of what you need to be load balancing for a multiple ma=
nagement servers configuration:
 http://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.=
6/reliability.html

- Si


________________________________________
From: Stavros Konstantaras <S.Konstantaras@uva.nl>
Sent: Monday, February 29, 2016 5:16 AM
To: users@cloudstack.apache.org
Subject: Re: Management server + MySQL server requirements

Hi Simon,

Your proposal is correct,I currently have the recommended setup: 2 machines=
 with nice amount of cores and RAM, with management server and mysql instal=
led. Usage server is not currently used, BUT we do use MySQL replication fo=
r some form of HA.

However, the drawback that I see is that the management server on the secon=
d head node must be down otherwise it causes the replication to fail pretty=
 quickly. So in case of failure of the first head node the admin needs to l=
ogin to the second head node and initiate the management server (or maybe y=
ou can script it and automate this).

Last requirement needed is a script that automates MySQL backups (crontab c=
an be used for that).

Kind Regards
Stavros

> On 28 Feb 2016, at 00:06, Simon Weller <sweller@ena.com> wrote:
>
> Josh,
>
> Unless you plan to create a massive cloud, there is probably no reason to=
 separate MySQL from the management server. It would actually be better to =
deploy two management servers and then replicate MySQL over to the second s=
erver for some form of HA.
>
> You don't really need SSDs. A couple of 10/15K SAS/SATA drives will be fi=
ne.  Most of the space allocate is for the MySQL databases. If you plan to =
use the usage service, the stats collection will require more drive space. =
This is configured as a separate MySQL database.
>
> I'd suggest you deploy a minimum of 16GB of RAM and 8 cores or so.  If yo=
u plan to grow the deployment rapidly, leave some empty memory slots for th=
e future.
>
> - Si
>
> ________________________________________
> From: Josh Davis <cloudstackhelp@outlook.com>
> Sent: Saturday, February 27, 2016 10:37 AM
> To: users@cloudstack.apache.org
> Subject: Management server + MySQL server requirements
>
> Hi all, apologies for the spam.
> This is the hardware suggestion for MySQL on the management server node. =
I'm looking at a separate server for MySQL DB.
> Is the bulk of the 250GB requirement used by the management server or the=
 MySQL DB? Do I need to use SSDs or is SAS or even SATA fine for the manage=
ment server? Can I place the MySQL DB on a VM as well?Is the MySQL server s=
upposed to be public facing?Is it sufficient to only connect to the managem=
ent network? No need to access the storage or guest network?
> "The machines that will run the Management Server and MySQL database must=
 meet the following requirements. The same machines can also be used to pro=
vide primary and secondary storage, such as via localdisk or NFS. The Manag=
ement Server may be placed on a virtual machine.Operating system:Preferred:=
 CentOS/RHEL 6.3+ or Ubuntu 12.04(.1)64-bit x86 CPU (more cores results in =
better performance)4 GB of memory250 GB of local disk (more results in bett=
er capability; 500 GB recommended)At least 1 NICStatically allocated IP add=
ressFully qualified domain name as returned by the hostname command"
> Thanks!Josh