Return-Path: 
 <common-user-return-29474-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
X-Original-To: apmail-hadoop-common-user-archive@www.apache.org
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 4ED6D7658
	for <apmail-hadoop-common-user-archive@www.apache.org>;
 Fri,  5 Aug 2011 17:50:04 +0000 (UTC)
Received: (qmail 42389 invoked by uid 500); 5 Aug 2011 17:50:01 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 42343 invoked by uid 500); 5 Aug 2011 17:50:00 -0000
Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-user@hadoop.apache.org>
List-Id: <common-user.hadoop.apache.org>
Reply-To: common-user@hadoop.apache.org
Delivered-To: mailing list common-user@hadoop.apache.org
Received: (qmail 42335 invoked by uid 99); 5 Aug 2011 17:50:00 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Aug 2011 17:50:00 +0000
X-ASF-Spam-Status: No, hits=-0.0 required=5.0
	tests=RCVD_IN_DNSWL_NONE,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: domain of kwiley@keithwiley.com
 designates 67.18.137.86 as permitted sender)
Received: from [67.18.137.86] (HELO gateway14.websitewelcome.com)
 (67.18.137.86)
    by apache.org (qpsmtpd/0.29) with SMTP; Fri, 05 Aug 2011 17:49:53 +0000
Received: (qmail 5413 invoked from network); 5 Aug 2011 17:56:42 -0000
Received: from gator542.hostgator.com (74.54.187.114)
  by gateway14.websitewelcome.com with SMTP; 5 Aug 2011 17:56:42 -0000
Received: from [128.208.190.85] (port=50599 helo=tikal.astro.washington.edu)
	by gator542.hostgator.com with esmtpsa (TLSv1:AES128-SHA:128)
	(Exim 4.69)
	(envelope-from <kwiley@keithwiley.com>)
	id 1QpOWZ-0004bG-Nh
	for common-user@hadoop.apache.org; Fri, 05 Aug 2011 12:49:31 -0500
Content-Type: text/plain; charset=us-ascii
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: streaming cacheArchive shared libraries
From: Keith Wiley <kwiley@keithwiley.com>
In-Reply-To: 
 <CACu_-gfCQrLiB0GzutYxLAAZk4D=JY4eiw+4tGEhZ3Si7c1dWQ@mail.gmail.com>
Date: Fri, 5 Aug 2011 10:49:31 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <BBF192BF-5CBD-4894-8FCC-D62C03F48E6A@keithwiley.com>
References: 
 <CACu_-gfCQrLiB0GzutYxLAAZk4D=JY4eiw+4tGEhZ3Si7c1dWQ@mail.gmail.com>
To: common-user@hadoop.apache.org
X-Mailer: Apple Mail (2.1084)
X-AntiAbuse: This header was added to track abuse,
 please include it with any abuse report
X-AntiAbuse: Primary Hostname - gator542.hostgator.com
X-AntiAbuse: Original Domain - hadoop.apache.org
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - keithwiley.com
X-BWhitelist: no
X-Source: 
X-Source-Args: 
X-Source-Dir: 
X-Source-Sender: tikal.astro.washington.edu [128.208.190.85]:50599
X-Source-Auth: kwiley+keithwiley.com
X-Email-Count: 4
X-Source-Cap: a2J3aWxleTtrYndpbGV5O2dhdG9yNTQyLmhvc3RnYXRvci5jb20=

Right, so it was pushed down a level into the "testlink" directory.  =
That's why my shared libraries were not linking properly to my mapper =
executable.  I can fix that by using "cmddev" to redirect =
LD_LIBRARY_PATH.  I think that'll work.

On Aug 5, 2011, at 10:44 , Ramya Sunil wrote:

> Hi Keith,
>=20
> I have tried the exact use case you have mentioned and it works fine =
for me.
> Below is the command line for the same:
>=20
> [ramya]$ jar vxf samplelib.jar
> created: META-INF/
> inflated: META-INF/MANIFEST.MF
> inflated: libhdfs.so
>=20
> [ramya]$ hadoop dfs -put samplelib.jar samplelib.jar
>=20
> [ramya]$ hadoop jar hadoop-streaming.jar -input InputDir -mapper "ls
> testlink/libhdfs.so" -reducer NONE -output out -cacheArchive
> hdfs://<namenode>:<port>/user/ramya/samplelib.jar#testlink
>=20
> [ramya]$ hadoop dfs -cat out/*
> testlink/libhdfs.so
> testlink/libhdfs.so
> testlink/libhdfs.so
>=20
>=20
> Hope it helps.
>=20
> Thanks
> Ramya


=
__________________________________________________________________________=
______
Keith Wiley     kwiley@keithwiley.com     keithwiley.com    =
music.keithwiley.com

"I used to be with it, but then they changed what it was.  Now, what I'm =
with
isn't it, and what's it seems weird and scary to me."
                                           --  Abe (Grandpa) Simpson
=
__________________________________________________________________________=
______