Return-Path: X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1F191E8C3 for ; Fri, 22 Feb 2013 18:56:44 +0000 (UTC) Received: (qmail 28080 invoked by uid 500); 22 Feb 2013 18:56:39 -0000 Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org Received: (qmail 27983 invoked by uid 500); 22 Feb 2013 18:56:39 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 27976 invoked by uid 99); 22 Feb 2013 18:56:39 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 18:56:39 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=HTML_MESSAGE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of Patai.Sangbutsarakum@turn.com designates 69.12.158.153 as permitted sender) Received: from [69.12.158.153] (HELO webmail.turn.com) (69.12.158.153) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 22 Feb 2013 18:56:32 +0000 Received: from turn-mail02.turn.corp ([::1]) by cas.turn.corp ([172.16.100.19]) with mapi id 14.02.0247.003; Fri, 22 Feb 2013 10:56:10 -0800 From: Patai Sangbutsarakum To: "user@hadoop.apache.org" Subject: Re: adding space on existing datanode ? Thread-Topic: adding space on existing datanode ? Thread-Index: AQHOEQSRFFfN+E4DTUi7TdNa311MrpiGtOoA//+FmAA= Date: Fri, 22 Feb 2013 18:56:09 +0000 Message-ID: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.175.69] Content-Type: multipart/alternative; boundary="_000_C7128CA403432849A4483B030F4489543571275Eturnmail02turnc_" MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org --_000_C7128CA403432849A4483B030F4489543571275Eturnmail02turnc_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Just want to add up from JM. If you already have balancer run in cluster every day, that will help the n= ew drive(s) get balanced. P From: Jean-Marc Spaggiari > Reply-To: > Date: Fri, 22 Feb 2013 13:14:14 -0500 To: > Subject: Re: adding space on existing datanode ? add disk space to you datanode you simply need to add another drive, then = add it to the dfs.data.dir or dfs.datanode.data.dir entry. After a datanode= restart, hadoop will start to use it. It will not balance the existing data between the directories. It will cont= inue to add to the 2. If one goes full, it will only continue with the othe= r one. If required, you can balance the data manually. Or depending on your= use case and the options you have, you can stop the datanode, delete the c= ontent of the 2 data directories and restart it. It will stat to receive da= ta to duplicate and will share it evenly between the 2 directories. This la= st solution is not recommended. But for a test environment it might be easi= er. --_000_C7128CA403432849A4483B030F4489543571275Eturnmail02turnc_ Content-Type: text/html; charset="us-ascii" Content-ID: <3682D12EFC7FFE4AB913D9F2EEC9A4EC@turn.com> Content-Transfer-Encoding: quoted-printable
Just want to add up from JM.

If you already have balancer run in cluster every day, that will help = the new drive(s) get balanced.

P

From: Jean-Marc Spaggiari <jean-marc@spaggiari.org>
Reply-To: <user@hadoop.apache.org>
Date: Fri, 22 Feb 2013 13:14:14 -05= 00
To: <user@hadoop.apache.org>
Subject: Re: adding space on existi= ng datanode ?

 add disk space to you datanode you simply need to add another drive, then add = it to the dfs.data.dir or dfs.datanode.data.dir entry. After a datanode res= tart, hadoop will start to use it.

It will not balance the existing data between the directories. It will contin= ue to add to the 2. If one goes full, it will only continue with the other = one. If required, you can balance the data manually. Or depending on your u= se case and the options you have, you can stop the datanode, delete the content of the 2 data directories an= d restart it. It will stat to receive data to duplicate and will share it e= venly between the 2 directories. This last solution is not recommended. But= for a test environment it might be easier. --_000_C7128CA403432849A4483B030F4489543571275Eturnmail02turnc_--