Return-Path: 
 <common-user-return-19327-apmail-hadoop-common-user-archive=hadoop.apache.org@hadoop.apache.org>
Delivered-To: apmail-hadoop-common-user-archive@www.apache.org
Received: (qmail 67508 invoked from network); 8 Dec 2009 22:52:11 -0000
Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3)
  by minotaur.apache.org with SMTP; 8 Dec 2009 22:52:11 -0000
Received: (qmail 32642 invoked by uid 500); 8 Dec 2009 22:52:09 -0000
Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org
Received: (qmail 32536 invoked by uid 500); 8 Dec 2009 22:52:08 -0000
Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:common-user-help@hadoop.apache.org>
List-Unsubscribe: <mailto:common-user-unsubscribe@hadoop.apache.org>
List-Post: <mailto:common-user@hadoop.apache.org>
List-Id: <common-user.hadoop.apache.org>
Reply-To: common-user@hadoop.apache.org
Delivered-To: mailing list common-user@hadoop.apache.org
Received: (qmail 32526 invoked by uid 99); 8 Dec 2009 22:52:08 -0000
Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Dec 2009 22:52:08 +0000
X-ASF-Spam-Status: No, hits=-2.9 required=5.0
	tests=AWL,BAYES_00,RCVD_IN_DNSWL_LOW,STOX_REPLY_TYPE
X-Spam-Check-By: apache.org
Received-SPF: pass (athena.apache.org: local policy)
Received: from [129.174.0.40] (HELO caduceus1.gmu.edu) (129.174.0.40)
    by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Dec 2009 22:52:06 +0000
Received: from UpendraPC (c-68-33-139-241.hsd1.md.comcast.net [68.33.139.241])
 by caduceus1.gmu.edu
 (Sun Java System Messaging Server 6.2-2.05 (built Apr 28 2005))
 with ESMTPA id <0KUC002PMVI95P00@caduceus1.gmu.edu> for
 common-user@hadoop.apache.org; Tue, 08 Dec 2009 17:51:45 -0500 (EST)
Date: Tue, 08 Dec 2009 17:51:45 -0500
From: Upendra Dadi <udadi@gmu.edu>
Subject: Hadoop Pipes with distributed cache
In-reply-to: <decedd6f0912080714u6a8e461cx930861bc5b20684d@mail.gmail.com>
To: common-user@hadoop.apache.org
Message-id: <33B8A300E8D94A66AE5685AF375492FB@UpendraPC>
MIME-version: 1.0
X-MIMEOLE: Produced By Microsoft MimeOLE V6.0.6002.18005
X-Mailer: Microsoft Windows Mail 6.0.6002.18005
Content-type: text/plain; format=flowed; charset=iso-8859-1;
 reply-type=original
Content-transfer-encoding: 7BIT
X-Priority: 3
X-MSMail-priority: Normal
References: <24095358.post@talk.nabble.com> <26694569.post@talk.nabble.com>
 <decedd6f0912080714u6a8e461cx930861bc5b20684d@mail.gmail.com>

Hi,
  I am facing some problems with using distributed cache archive with Pipes
job. In my configuration file I have the following two properties:

<property>
  <name>mapred.create.symlink</name>
  <value>yes</value>
</property>

<property>
  <name>mapred.cache.archives</name>
  <value>hdfs://localhost:9000/user/upendra/archive/pipeArchive.zip#pipeSym</value>
</property>

The zip archive contains two folders lib and share. lib folder contains some
shared libraries. In my Pipes C++ code, I have added the following
statements to
use the shared libraries:

int main(int argc, char *argv[]) {
  dlopen("pipeSym/lib/libmant.so.1",RTLD_LAZY);
  ...

The shared library is not getting loaded during execution. It spits the
error that the shared library is not found. What is the problem with
 the above steps? Can anyone please shed some light on what might be causing
the problem. Thanks.

Upendra