Mailing-List: contact user-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hive.apache.org
Received-SPF: pass (nike.apache.org: domain of chinnarao@huawei.com designates
 206.16.17.211 as permitted sender)
Date: Wed, 19 Oct 2011 15:56:38 +0500
From: Chinna Rao Lalam 72745 <chinnarao@huawei.com>
Subject: Re: Accessing distributed cache in transform scripts
In-reply-to: 
 <CACgbF2rMm1T6pOkEDREHPGb43mgBG_-TYnCJtiL6ZNkYWzCkOw@mail.gmail.com>
To: user@hive.apache.org
Message-id: <fd31deac2a97.2a97fd31deac@huawei.com>
MIME-version: 1.0
Content-type: text/plain; charset=us-ascii
Content-language: en
Content-transfer-encoding: 7BIT
Content-disposition: inline
Priority: normal
References: 
 <CACgbF2qLX9dPiDO+rA5T+du9REDFuo53-cOcMPKg0T7g+pZmOA@mail.gmail.com>
 <CACgbF2rMm1T6pOkEDREHPGb43mgBG_-TYnCJtiL6ZNkYWzCkOw@mail.gmail.com>

Hi,

  Can u post some more details like for the  "list file"  what command u have used.


----- Original Message -----
From: Mohit Gupta <success.mohit.gupta@gmail.com>
Date: Wednesday, October 19, 2011 3:16 pm
Subject: Re: Accessing distributed cache in transform scripts
To: user@hive.apache.org

> Plz help...Any pointers!!
> 
> On 10/19/11, Mohit Gupta <success.mohit.gupta@gmail.com> wrote:
> > Hi All,
> >
> > I want some read-only data to be available at the reducers / 
> transform> scripts. I am trying to use distributed cache to 
> achieve this using
> > the following steps:
> > 1.  add file s3://bucket_name/prefix/testfile
> > then
> > 2.  "list file" to find out the location of local copy of testfile.
> > it shows the locally file is stored at
> > "/mnt/var/lib/hive_05/downloaded_resources/testfile"
> >
> > 3. reduce script code ( in php)
> > #!/usr/bin/php
> > <?php
> > 
> $fin=fopen("/mnt/var/lib/hive_05/downloaded_resources/testfile","r");> $line=fgets($fin);
> > ?>
> >
> > 4. the reduce script throws an error "no such file or directory
> > /mnt/var/lib/hive_05/downloaded_resources/testfile ".
> >
> > 5. On ssh, I found that the file was indeed present at
> > "/mnt/var/lib/hive_05/downloaded_resources/testfile".
> >
> > Plz help. Is this the right way to pass some info to the reduce
> > scripts. If yes, what I could be missing here? Else, any other
> > possible way(s)!!
> >
> > Thanks
> >
> > Mohit
> >
> 
> 
> -- 
> Best Regards,
> 
> Mohit Gupta
> Software Engineer at Vdopia Inc.
>