Return-Path: 
 <user-return-884-apmail-accumulo-user-archive=accumulo.apache.org@accumulo.apache.org>
X-Original-To: apmail-accumulo-user-archive@www.apache.org
Delivered-To: apmail-accumulo-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 15DCA90F3
	for <apmail-accumulo-user-archive@www.apache.org>;
 Sun, 17 Jun 2012 16:26:08 +0000 (UTC)
Received: (qmail 34792 invoked by uid 500); 17 Jun 2012 16:26:07 -0000
Delivered-To: apmail-accumulo-user-archive@accumulo.apache.org
Received: (qmail 34736 invoked by uid 500); 17 Jun 2012 16:26:07 -0000
Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@accumulo.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@accumulo.apache.org>
List-Post: <mailto:user@accumulo.apache.org>
List-Id: <user.accumulo.apache.org>
Reply-To: user@accumulo.apache.org
Delivered-To: mailing list user@accumulo.apache.org
Received: (qmail 34728 invoked by uid 99); 17 Jun 2012 16:26:07 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Jun 2012 16:26:07 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=FSL_RCVD_USER,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: local policy)
Received: from [206.112.75.238] (HELO iron-ugova-out.osis.gov)
 (206.112.75.238)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 17 Jun 2012 16:26:00 +0000
X-IronPort-Anti-Spam-Filtered: true
X-IronPort-Anti-Spam-Result: 
 AhgFALME3k+sEAbx/2dsb2JhbABFtUuBD4IPCQEBBAF+CwsDAQc7IQETBR0Zh30DBq1rDYlOilZigyCDGwOVJIp/h3o
X-IronPort-AV: E=Sophos;i="4.75,788,1330923600";
   d="scan'208";a="41873"
Received: from ghost-a.center.osis.gov (HELO mail-vc0-f169.google.com)
 ([172.16.6.241])
  by iron-ugova-in.osis.gov with ESMTP/TLS/RC4-SHA; 17 Jun 2012 12:23:03 -0400
Received: by vcbfl10 with SMTP id fl10so2915791vcb.0
        for <user@accumulo.apache.org>; Sun, 17 Jun 2012 09:25:11 -0700 (PDT)
Received: by 10.220.214.148 with SMTP id ha20mr6204367vcb.5.1339950311362;
 Sun, 17 Jun 2012 09:25:11 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.220.195.13 with HTTP; Sun, 17 Jun 2012 09:24:51 -0700 (PDT)
In-Reply-To: 
 <1172613302.337523.1339941278673.JavaMail.root@linzimmb04o.imo.intelink.gov>
References: 
 <1172613302.337523.1339941278673.JavaMail.root@linzimmb04o.imo.intelink.gov>
From: John Vines <john.w.vines@ugov.gov>
Date: Sun, 17 Jun 2012 12:24:51 -0400
Message-ID: 
 <CADczPYQT5_zX+nw8pT+7aZVSkKKv3AV_bPqFvncMb-fRgwZ2Fg@mail.gmail.com>
Subject: Re: Can I connect an InputStream to a Mutation value?
To: user@accumulo.apache.org
Content-Type: multipart/alternative; boundary=bcaec54d4d38534ec404c2ad7e5d

--bcaec54d4d38534ec404c2ad7e5d
Content-Type: text/plain; charset=ISO-8859-1

There's no way to do that. But if you're simply running out of memory in
your ingest, you may just have to up your ingestors heap size and decrease
your batchwriter.

John

On Sun, Jun 17, 2012 at 9:54 AM, David Medinets <david.medinets@gmail.com>wrote:

> Some of the XML records that I work with are over 50M. I was hoping to
> store them inside of Accumulo instead of the text-based HDFS XML super
> file currently being used. However, since they are so large I can't
> create a Value object without running out of memory. Storing values
> this large may simply be using the wrong tool, please let me know.
>

--bcaec54d4d38534ec404c2ad7e5d
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

There&#39;s no way to do that. But if you&#39;re simply running out of memo=
ry in your ingest, you may just have to up your ingestors heap size and dec=
rease your batchwriter.<br><br>John<br><br><div class=3D"gmail_quote">On Su=
n, Jun 17, 2012 at 9:54 AM, David Medinets <span dir=3D"ltr">&lt;<a href=3D=
"mailto:david.medinets@gmail.com" target=3D"_blank">david.medinets@gmail.co=
m</a>&gt;</span> wrote:<br>

<blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1p=
x #ccc solid;padding-left:1ex">Some of the XML records that I work with are=
 over 50M. I was hoping to<br>
store them inside of Accumulo instead of the text-based HDFS XML super<br>
file currently being used. However, since they are so large I can&#39;t<br>
create a Value object without running out of memory. Storing values<br>
this large may simply be using the wrong tool, please let me know.<br>
</blockquote></div><br>

--bcaec54d4d38534ec404c2ad7e5d--