hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Doug Cutting (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HADOOP-71) The SequenceFileRecordReader uses the default FileSystem rather than the supplied one
Date Thu, 14 Jun 2007 22:01:35 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-71?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12504940
] 

Doug Cutting commented on HADOOP-71:
------------------------------------

Owen, this will break InputFormats and OutputFormats that use the FileSystem passed to getRecordReader()
and getRecordWriter(), since null is now passed.  Is that intended?  Is it now an error to
touch that parameter?  If so, we should at least provide some warning in the release notes,
no?  It'd be nicer to have a new API and then deprecate this one...

> The SequenceFileRecordReader uses the default FileSystem rather than the supplied one
> -------------------------------------------------------------------------------------
>
>                 Key: HADOOP-71
>                 URL: https://issues.apache.org/jira/browse/HADOOP-71
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.1.0
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>             Fix For: 0.14.0
>
>         Attachments: non-default-fs-input.patch
>
>
> The mapred.TestSequenceFileInputFormat test was failing when run with a conf directory
that pointed to a dfs cluster. The reason was that SequenceFileRecordReader was using the
default FileSystem from the config, while the test program was assuming the "local" file system
was being used.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message