Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of masmertoz@gmail.com
 designates 209.85.214.177 as permitted sender)
MIME-Version: 1.0
Date: Tue, 18 Dec 2012 02:12:58 +0100
Message-ID: 
 <CAENBeZao47WHEk0019ay1j4X27iS5FFXbc9iCMCsO-_im0Hx0A@mail.gmail.com>
Subject: Cluster administration advice needed
From: Merto Mertek <masmertoz@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=e89a8fb1ee7ac929b704d116321a

--e89a8fb1ee7ac929b704d116321a
Content-Type: text/plain; charset=ISO-8859-1

Hi,

I was working with a small Hadoop cluster while I was developing a new
scheduler, however the cluster was used only for development purposes and
never in production so I am wondering what obstacles are you facing in a
typical day-to-day cluster administration?

We have been discussing with an ad-company (which has their own development
team) about building a platform with hbase, hadoop and maybe some in-memory
database for caching. My part would be to establish a small cluster (~
5nodes) that would satisfy their requirements and to monitor its behavior.
Because of my current job probably I will not be available at their site
for full-time, so I am wondering:


a) What things are taking most of your time in cluster administration?
b) How many hours should I plan to administer the cluster when the
infrastructure and data is ready (probably this will be a long process) ...
c) What tasks besides software updates, schema updates, monitoring,
additional provisioning should I plan ?


Thank you...

--e89a8fb1ee7ac929b704d116321a
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div>Hi,<br></div><div><br>I was working with a small=
 Hadoop cluster while I was developing a new scheduler, however the cluster=
 was used only for development purposes and never in production so I am won=
dering what obstacles are you facing in a typical day-to-day cluster admini=
stration?<br>
<br>We have been discussing with an ad-company (which has their own develop=
ment team) about building a platform with hbase, hadoop and maybe some in-m=
emory database for caching. My part would be to establish a small cluster (=
~ 5nodes) that would satisfy their requirements and to monitor its behavior=
. Because of my current job probably I will not be available at their site =
for full-time, so I am wondering:<br>
</div><br></div><div><br>a) What things are taking most of your time in clu=
ster administration? </div><div>b) How many hours should I plan to administ=
er the cluster when the=20
infrastructure and data is ready (probably this will be a long process)=20
... <br>c) What tasks besides software updates, schema updates, monitoring,=
 additional provisioning should I plan ?<br></div><div><br></div><div><br><=
br></div><div>Thank you...<br></div><div><br></div><div><br></div><div>
<br></div><div><br></div><div><br></div><div><br><br><br><br></div></div>

--e89a8fb1ee7ac929b704d116321a--