hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Reading Sequence File from Hadoop Distributed Cache ..
Date Thu, 11 Oct 2012 02:33:13 GMT
Hi Mark,

DistributedCache files, when accessed from a Task, exist on the local
file system. You should make sure the SequenceFile.Reader tries to
read it with a LocalFS than a HDFS instance.

On Thu, Oct 11, 2012 at 5:15 AM, Mark Olimpiati <markq2011@gmail.com> wrote:
> Hi,
>   I'm storing sequence files in the distributed cache which seems to be
> stored somewher under each node's /tmp .../local/archive/ ... path.
> In mapper code, I tried using SequenceFile.Reader with all possible
> configurations (locally, distribtued) however, it can't find it. Are
> sequence files supported in the distribued cache??
> Thank you,
> Mark

Harsh J

View raw message