chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bill Graham (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-473) Make default processor configurable
Date Tue, 06 Apr 2010 22:01:33 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854215#action_12854215
] 

Bill Graham commented on CHUKWA-473:
------------------------------------

This seems like a different use case to me. The existing Demux MapClass and ReduceClass work
fine for me, but I just want to use a different processor in the mapper. I don't need to swap
out the entire mapper/reducer class. In particular I want to swap out the following section
in Demux.MapClass.map(..):


{noformat}
String processorClass = jobConf.get(chunk.getDataType(),
      "org.apache.hadoop.chukwa.extraction.demux.processor.mapper.DefaultProcessor");
{noformat}

with something like this:
{noformat}
String defaultProcessor = jobConf.get("chukwa.demux.default.map.processor",
    "org.apache.hadoop.chukwa.extraction.demux.processor.mapper.DefaultProcessor");

String processorClass = jobConf.get(chunk.getDataType(), defaultProcessor);
{noformat}



> Make default processor configurable
> -----------------------------------
>
>                 Key: CHUKWA-473
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-473
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>            Reporter: Bill Graham
>            Assignee: Bill Graham
>
> The default processor is hard coded to {{DefaultProcessor}} in the {{Demux}} class. This
should be configurable.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message