Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 12233D64C for ; Thu, 1 Nov 2012 08:09:43 +0000 (UTC) Received: (qmail 8262 invoked by uid 500); 1 Nov 2012 08:09:41 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 8212 invoked by uid 500); 1 Nov 2012 08:09:40 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 8176 invoked by uid 99); 1 Nov 2012 08:09:38 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Nov 2012 08:09:38 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of scarcer.cn@gmail.com designates 209.85.220.169 as permitted sender) Received: from [209.85.220.169] (HELO mail-vc0-f169.google.com) (209.85.220.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Nov 2012 08:09:32 +0000 Received: by mail-vc0-f169.google.com with SMTP id fl17so2979680vcb.14 for ; Thu, 01 Nov 2012 01:09:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=Clx8709if/SCf7pyve3XGaedaAehS3JHV5P5jaVntxs=; b=eGepHdZs9AfWV0p4EU/RElzEvtvMD+cw0rhvQc2VPu5NnhQKA3j0NZO3QX6wRrB27J 4uYtm7BrpkLgU4oc5xVKXBAkMX7JSOlqIN7cZm0skOLveJwkx4GRdVlsBL9an+d9fJ2L ur+UcCsGe+bna/6Nrp9k9eHOQPooBEnGRzvMFaV8TgSVQJL03r01ILtQMyFB+wmMblC3 Wwf77yunyNCmWTwqnq4QQM5q57I1P06KhnxAUdvVJaaGvFpFr5er3WVMH5pz+XPN54Ix nrSJXuyJZG7WKQTs0OjsNygu9hWzEARVNHt9wyNAQMgB7DQ4VI8douXLxU7YC229Dw8A TGew== MIME-Version: 1.0 Received: by 10.221.2.76 with SMTP id nt12mr21361361vcb.12.1351757350262; Thu, 01 Nov 2012 01:09:10 -0700 (PDT) Received: by 10.58.248.6 with HTTP; Thu, 1 Nov 2012 01:09:10 -0700 (PDT) In-Reply-To: References: <1351748138.45964.YahooMailNeo@web121702.mail.ne1.yahoo.com> Date: Thu, 1 Nov 2012 16:09:10 +0800 Message-ID: Subject: Re: Does hbase.hregion.max.filesize have a limit? From: Cheng Su To: user@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Thank you for your answer. The max file size the whole cluster can store for one CF is 60G, right? Maybe the only way is to split the large table into small tables... On Thu, Nov 1, 2012 at 3:05 PM, ramkrishna vasudevan wrote: > Can multiple region servers runs on one real machine? > (I guess not though) > No.. Every RS runs in different physical machines. > > max.file.size actually applies for region. Suppose you create a table then > insert data for 20G that will get explicitly splitted into further regions. > Yes all 60G of data can be stored in one physical machine but that means > that you have the data is logically served by 3 regions. > Does this help you? > > Regards > Ram > > On Thu, Nov 1, 2012 at 12:15 PM, Cheng Su wrote: > >> Does that means the max file size of 1 cf is 20G? If I have 3 region >> servers, then 60G total? >> I have a very large table, size of one cf (contains only one column) >> may exceed 60G. >> Is there any chance to store the data without increase machines? >> >> Can multiple region servers runs on one real machine? >> (I guess not though) >> >> On Thu, Nov 1, 2012 at 1:35 PM, lars hofhansl wrote: >> > The tribal knowledge would say about 20G is the max. >> > The fellas from Facebook will have a more definite answer. >> > >> > -- Lars >> > >> > >> > >> > ________________________________ >> > From: Cheng Su >> > To: user@hbase.apache.org >> > Sent: Wednesday, October 31, 2012 10:22 PM >> > Subject: Does hbase.hregion.max.filesize have a limit? >> > >> > Hi, all. >> > >> > I have a simple question: does hbase.hregion.max.filesize have a limit? >> > May I specify a very large value to this? like 40G or more? (don't >> > consider the performance) >> > I didn't find any description about this from official site or google. >> > >> > Thanks. >> > >> > -- >> > >> > Regards, >> > Cheng Su >> >> >> >> -- >> >> Regards, >> Cheng Su >> -- Regards, Cheng Su