Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@mahout.apache.org
Received-SPF: pass (nike.apache.org: domain of dangeorge.filimon@gmail.com
 designates 74.125.82.51 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEccTyz1Kg7C26Qa=D59-BLBTBugFh1qKkY0KzLGttXOe_9AVw@mail.gmail.com>
References: 
 <CAOwb3gPS0hrk4cAvGdnXYoYPoWDv-Rjh5u9yASXk+wdPi8F8fQ@mail.gmail.com>
 <CAEccTyz1Kg7C26Qa=D59-BLBTBugFh1qKkY0KzLGttXOe_9AVw@mail.gmail.com>
From: Dan Filimon <dangeorge.filimon@gmail.com>
Date: Wed, 13 Feb 2013 13:12:34 +0200
Message-ID: 
 <CAOwb3gMK4TrwkVc_A52NZ71itjT0RNi-A-Ab5WwhPN--2BnfTw@mail.gmail.com>
Subject: Re: Accessing the local filesystem from AbstractJob
To: dev@mahout.apache.org
Content-Type: text/plain; charset=UTF-8

I see. Well, my use case was wanting to run the job on one machine,
being lazy and not wanting to put the files on HDFS. :)

On Tue, Feb 12, 2013 at 8:27 PM, Sean Owen <srowen@gmail.com> wrote:
> Yes because the input path is something processed by the jobtracker and
> later the tasktrackers themselves, which won't be on your machine
> (necessarily).
>
> Mappers can read the local file system but it's not clear what may or may
> not be there. Consider the distributed cache for smallish data.
>
>
> On Tue, Feb 12, 2013 at 7:05 PM, Dan Filimon <dangeorge.filimon@gmail.com>wrote:
>
>> When creating my own job driver, I'm unable to give it any inputs from
>> the local file system. An exception gets thrown when starting the job
>> (and trying to get the splits).
>> Apparently the files have to be on HDFS.
>>
>> Is there any way around this (ideally, I'd like it to first look for
>> the file on the local file system and if no file is found, look at
>> HDFS)?
>>