Lance Amundsen wrote:
> OK, that is encouraging. I'll take another pass at it. I succeeded
> yesterday with an in-memory only InputFormat, but only after I commented
> out some of the split referencing code, like the following in MapTask.java
>
> if (instantiatedSplit instanceof FileSplit) {
> FileSplit fileSplit = (FileSplit) instantiatedSplit;
> job.set("map.input.file", fileSplit.getPath().toString());
> job.setLong("map.input.start", fileSplit.getStart());
> job.setLong("map.input.length", fileSplit.getLength());
> }
Yes, that code should not exist, but it shouldn't affect you either.
You should be subclassing InputSplit, not FileSplit, so this code
shouldn't operate on your splits.
Doug
|