On Apr 15, 2009, at 3:16 PM, Grant Ingersoll wrote:
>
> On Apr 15, 2009, at 2:54 PM, Stephen Green wrote:
>
>>
>> On Apr 15, 2009, at 2:19 PM, Jeff Eastman wrote:
>>
>>> None of the clustering implementations hard code the filesystem.
>>> The file names are constructed from the input and output filepath
>>> arguments.
>>
>> This is what I saw as well.
>>
>>> Grant Ingersoll wrote:
>>>> I seem to recall this being something you have to set in your
>>>> Hadoop configuration. Or, let me double check that we aren't
>>>> hard-coding the FS in our Job.
>>
>> I'm pretty sure that the configuration on EMR allows this, as the
>> job has no problem reading from the s3n input data.
>>
>
> Can you share your Hadoop configuration? i.e. the contents of the
> conf directory? You might actually have some luck asking this
> question on core-users over at Hadoop.
Well, Amazon controls the configuration, but I could probably log into
the master while it's running and pull it out.
Steve
--
Stephen Green // Stephen.Green@sun.com
Principal Investigator \\ http://blogs.sun.com/searchguy
Aura Project // Voice: +1 781-442-0926
Sun Microsystems Labs \\ Fax: +1 781-442-1692
|