hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harsh J" <ha...@cloudera.com>
Subject Re: Review Request: MAPREDUCE-2584. Check for serializers early, and give out more information regarding missing serializers.
Date Thu, 16 Jun 2011 12:24:09 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/885/
-----------------------------------------------------------

(Updated 2011-06-16 12:24:09.519284)


Review request for hadoop-mapreduce.


Changes
-------

IOException catching ('stead of null).


Summary
-------

As discussed on HADOOP-7328, MapReduce can handle serializers in a much better way in case
of bad configuration, improper imports (Some odd Text class instead of the Writable Text set
as key), etc..

This issue covers the MapReduce parts of the improvements (made to MapOutputBuffer and possible
early-check of serializer availability pre-submit) that provide more information than just
an NPE as is the current case.


This addresses bug MAPREDUCE-2584.
    http://issues.apache.org/jira/browse/MAPREDUCE-2584


Diffs (updated)
-----

  src/java/org/apache/hadoop/mapreduce/JobSubmitter.java 751d528 
  src/test/mapred/org/apache/hadoop/mapreduce/TestMRJobClient.java 5fa329a 

Diff: https://reviews.apache.org/r/885/diff


Testing
-------

Added a test case that expects a failure if no io.serializers are present.


Thanks,

Harsh


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message