hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun A K (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-4974) optimising the LineRecordReader initialize method
Date Mon, 04 Feb 2013 12:26:13 GMT
Arun A K created MAPREDUCE-4974:
-----------------------------------

             Summary: optimising the LineRecordReader initialize method
                 Key: MAPREDUCE-4974
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4974
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mrv1, mrv2, performance
    Affects Versions: 0.23.5, 2.0.2-alpha
         Environment: Hadoop Linux
            Reporter: Arun A K
            Assignee: Arun A K
             Fix For: 0.20.204.0, 0.24.0


I found there is a a scope of optimizing the code, over initialize() if we have compressionCodecs
& codec instantiated only if its a compressed input.
Mean while Gelesh George Omathil, added if we could avoid the null check of key & value.
This would time save, since for every next key value generation, null check is done. The intention
being to instantiate only once and avoid NPE as well. Hope both could be met if initialize
key & value over  initialize() method. We both have worked on it.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message