Return-Path: 
 <user-return-6610-apmail-hadoop-mapreduce-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Delivered-To: apmail-hadoop-mapreduce-user-archive@minotaur.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 9D9F8F182
	for <apmail-hadoop-mapreduce-user-archive@minotaur.apache.org>;
 Sat, 30 Mar 2013 17:53:05 +0000 (UTC)
Received: (qmail 91750 invoked by uid 500); 30 Mar 2013 17:53:00 -0000
Delivered-To: apmail-hadoop-mapreduce-user-archive@hadoop.apache.org
Received: (qmail 91623 invoked by uid 500); 30 Mar 2013 17:53:00 -0000
Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:user@hadoop.apache.org>
List-Id: <user.hadoop.apache.org>
Reply-To: user@hadoop.apache.org
Delivered-To: mailing list user@hadoop.apache.org
Received: (qmail 91613 invoked by uid 99); 30 Mar 2013 17:52:59 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Mar 2013 17:52:59 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of chilinglam@gmail.com
 designates 209.85.217.174 as permitted sender)
Received: from [209.85.217.174] (HELO mail-lb0-f174.google.com)
 (209.85.217.174)
    by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 30 Mar 2013 17:52:54 +0000
Received: by mail-lb0-f174.google.com with SMTP id s10so1009570lbi.19
        for <user@hadoop.apache.org>; Sat, 30 Mar 2013 10:52:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20120113;
        h=mime-version:x-received:date:message-id:subject:from:to
         :content-type;
        bh=4zoPIiQctRMlZ4U9UlUUP01PlfSQASihtdwsw1ulVyo=;
        b=Y1T8EPcoX61i+gfgxf0H2IJlPhqBPqWJu+p+fByZl49ZQ1+JfKkQbAR3N0wjxeGNKd
         6h9joSOnAKlg98cOw5CziXTA0FmwRR4mm220cViaGm+GNwUCH5TyyCpQNEifbV3+G7mO
         sIQ1MUZ9SPfbW97iHVzxalJoGJQtcFqlniuGkIFzaqFbh3q+5b4RNb3ojFdcE7XDOXom
         4QeJky1PYjc0A0gERiXER7UX9k+OSC/Vb7niG29ZuzistY+F2e1On71EqRnnfY2OYOJ7
         o0fudIbO3DFB1YUUqSc/bQfXCH7d+1gk+Sy+aM4VZcQnJpKk+WJA8+mx/TCspDR6WioQ
         76rw==
MIME-Version: 1.0
X-Received: by 10.112.150.4 with SMTP id ue4mr3195218lbb.28.1364665953372;
 Sat, 30 Mar 2013 10:52:33 -0700 (PDT)
Received: by 10.114.14.161 with HTTP; Sat, 30 Mar 2013 10:52:33 -0700 (PDT)
Date: Sat, 30 Mar 2013 13:52:33 -0400
Message-ID: 
 <CAG+ckK9CS3=6_grp_5VX1RA7WFchAb4yefewv0WWV9--4SoLsg@mail.gmail.com>
Subject: Streaming value of (200MB) from a SequenceFile
From: Jerry Lam <chilinglam@gmail.com>
To: user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=047d7b34382c6350bb04d9280d37
X-Virus-Checked: Checked by ClamAV on apache.org

--047d7b34382c6350bb04d9280d37
Content-Type: text/plain; charset=ISO-8859-1

Hi everyone,

I'm having a problem to stream individual key-value pair of 200MB to 1GB
from a MapFile.
I need to stream the large value to an outputstream instead of reading the
entire value before processing because it potentially uses too much memory.

I read the API for MapFile, the next(WritableComparable key, Writable val)
does not return an input stream.

How can I accomplish this?

Thanks,

Jerry

--047d7b34382c6350bb04d9280d37
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi everyone,<div><br></div><div>I&#39;m having a problem t=
o stream individual key-value pair of 200MB to 1GB from a MapFile.</div><di=
v style>I need to stream the large value to an outputstream instead of read=
ing the entire value before processing because it potentially uses too much=
 memory.</div>
<div><br></div><div style>I read the API for MapFile, the=A0next(WritableCo=
mparable key, Writable val) does not return an input stream.</div><div styl=
e><br></div><div style>How can I accomplish this?=A0</div><div style><br></=
div>
<div style>Thanks,</div><div style><br></div><div style>Jerry</div></div>

--047d7b34382c6350bb04d9280d37--