Return-Path: X-Original-To: apmail-accumulo-user-archive@www.apache.org Delivered-To: apmail-accumulo-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D362596FA for ; Thu, 23 Aug 2012 20:07:00 +0000 (UTC) Received: (qmail 8060 invoked by uid 500); 23 Aug 2012 20:07:00 -0000 Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org Received: (qmail 8031 invoked by uid 500); 23 Aug 2012 20:07:00 -0000 Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@accumulo.apache.org Delivered-To: mailing list user@accumulo.apache.org Received: (qmail 8018 invoked by uid 99); 23 Aug 2012 20:07:00 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Aug 2012 20:07:00 +0000 X-ASF-Spam-Status: No, hits=2.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_SOFTFAIL X-Spam-Check-By: apache.org Received-SPF: softfail (nike.apache.org: transitioning domain of wilhelm.von.cloud@accumulo.net does not designate 209.85.214.169 as permitted sender) Received: from [209.85.214.169] (HELO mail-ob0-f169.google.com) (209.85.214.169) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Aug 2012 20:06:53 +0000 Received: by obhx4 with SMTP id x4so3145049obh.0 for ; Thu, 23 Aug 2012 13:06:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:content-type:x-gm-message-state; bh=VG/YeZKXMNrFmoLuW94/Xd7ouBMWRHrzZB6P9PCox8M=; b=QOAtj+Zq9yKNB5a/hZR1BOBYvSHwoIN07p2EMzWMxnEDciWHUukmiIwx3OFcXINxTB 5dTgz4lUMeCjndKZNQFqPAJZ+w7hi5aV1kML5IMd3q3tLR6EbZt/sTbD01yb+Td3TaUD w2ceW9gIrFv9xYUMcieEsx3SJIlxDIprBMO+YflXxvjHETg2U+JDmQskr1W6XPKcBAUM y4fOdrfu+b5SiZu8Jwdsg1uLPa4ZkA+/ehsLU7z0RAqKfnrucsTOTL1xNzcDidwK8OA9 +2WiCdBGjSQ8yv8Hu6MjAxfnciBxqXO3YDFMzms+6wzOJSA3CsdjBBiEwocb+UGQADMh 1Owg== MIME-Version: 1.0 Received: by 10.182.75.33 with SMTP id z1mr2156219obv.9.1345752391658; Thu, 23 Aug 2012 13:06:31 -0700 (PDT) Received: by 10.60.9.73 with HTTP; Thu, 23 Aug 2012 13:06:31 -0700 (PDT) X-Originating-IP: [144.51.26.95] In-Reply-To: <57754A39E408FB4994D100B1F4409AD80BE6ABCA@HDXDSP33.us.lmco.com> References: <57754A39E408FB4994D100B1F4409AD80BE6ABCA@HDXDSP33.us.lmco.com> Date: Thu, 23 Aug 2012 13:06:31 -0700 Message-ID: Subject: Re: Large files in Accumulo From: William Slacum To: user@accumulo.apache.org Content-Type: multipart/alternative; boundary=14dae93994e742abb804c7f46537 X-Gm-Message-State: ALoCoQlq3XSZsfyWPXqha93Q9soEjYPRLhkCcERza+oA9wzxX+IzgXzDHpyvOebizwl1/8NPUpfD --14dae93994e742abb804c7f46537 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Are these RFiles as a whole? I know at some point HBase needed to have entire rows fit into memory; Accumulo does not have this restriction. On Thu, Aug 23, 2012 at 12:55 PM, Cardon, Tejay E wrote: > Alright, this one=92s a quick question. I=92ve been told that HBase doe= s > not perform well if large (> 100MB) files are stored in it). Does Accumu= lo > have similar trouble? If so, can it be overcome by storing the large fil= es > in their own locality group?**** > > ** ** > > Thanks,**** > > Tejay**** > --14dae93994e742abb804c7f46537 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Are these RFiles as a whole? I know at some point HBase needed to have enti= re rows fit into memory; Accumulo does not have this restriction.

On Thu, Aug 23, 2012 at 12:55 PM, Cardon, Tejay E = <tejay.e.cardon@lmco.com> wrote:

Alright, this one=92s a quick question.=A0 I=92ve be= en told that HBase does not perform well if large (> 100MB) files are st= ored in it).=A0 Does Accumulo have similar trouble?=A0 If so, can it be ove= rcome by storing the large files in their own locality group?

=A0

Thanks,

Tejay


--14dae93994e742abb804c7f46537--