Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: common-user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of edlinuxguru@gmail.com
 designates 209.85.220.222 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=uZGjqzfgKYi4DJzTEA6m31Qa44nWLEJWa55wZ9G1H/GwDblY05ZlotoN3YK1MaGKWk
         RAcTQm/XJpLDaYRAohZeZDXY98oYxr4MS9xo0CnJxrHk12pne55MG1A2gfIaKw17SPDk
         zMjItxUFCeV2mtyDVhkGbS/v8p3h0qeZm4UfQ=
MIME-Version: 1.0
In-Reply-To: <45f85f70909292020s61849ff3lf41a8f8f21d8d330@mail.gmail.com>
References: <8211a1320909282237s3b309c88ge283412a7766dcec@mail.gmail.com>
	 <45f85f70909291056j1d7e6df2mf8e4ead0860be076@mail.gmail.com>
	 <8211a1320909292011i56e9cb98j4deb5d793e27823e@mail.gmail.com>
	 <45f85f70909292020s61849ff3lf41a8f8f21d8d330@mail.gmail.com>
Date: Tue, 29 Sep 2009 23:30:29 -0400
Message-ID: <cbbf4b570909292030m2458883t763ab9ff4a3d62d4@mail.gmail.com>
Subject: Re: Does hadoop 0.18.3 support thrift ?
From: Edward Capriolo <edlinuxguru@gmail.com>
To: common-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On Tue, Sep 29, 2009 at 11:20 PM, Todd Lipcon <todd@cloudera.com> wrote:
> Ah, right, it was introduced in 0.19.
>
> It shouldn't be too tough to compile against 0.18 - the API changes were
> minimal and it's an external client so internal changes shouldn't have an=
y
> effect.
>
> I'd recommend pulling the source from 0.20, moving it into the contrib
> directory, and hacking away.
>
> If you aren't comfortable in Java and with build.xml, though, you're
> probably out of luck - it's unlikely to work without a bit of coercion.
>
> -Todd
>
>
> On Tue, Sep 29, 2009 at 8:11 PM, Jeff Zhang <zjffdu@gmail.com> wrote:
>
>> But I do not found the thrift in hadoop 0.18.3.
>> Can I use other version of hadoop's thrift for my cluster which is built
>> upon hadoop 0.18.3
>>
>>
>> On Wed, Sep 30, 2009 at 1:56 AM, Todd Lipcon <todd@cloudera.com> wrote:
>>
>> > Hi Jeff,
>> >
>> > The contrib/thriftfs module is probably what you're looking for.
>> >
>> > I don't know of a lot of people using it, but it does provide a
>> proxy-style
>> > thrift access to HDFS.
>> >
>> > Be aware that performance will not be great since it introduces severa=
l
>> > more
>> > copies in the pipeline, and Thrift was never designed for transferring
>> > large
>> > amounts of data.
>> >
>> > -Todd
>> >
>> > On Mon, Sep 28, 2009 at 10:37 PM, Jeff Zhang <zjffdu@gmail.com> wrote:
>> >
>> > > Hi all,
>> > >
>> > >
>> > > My hadoop cluster is using hadoop 0.18.3. And I'd =A0like to using p=
ython
>> > to
>> > > access hdfs. But I did not found thrift in hadoop 0.18.3.
>> > >
>> > > Anybody know does hadoop 0.18.3 support thrift? If not, is there any
>> > other
>> > > method to access hdfs using python ?
>> > >
>> > >
>> > > Thank you in advance.
>> > >
>> > > Jeff zhang
>> > >
>> >
>>
>

I did this at one point. The code reference append and some other
things not in 18.0 but It does work.