chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-460) Demux depends on conf/chukwa-collector-conf.xml
Date Fri, 05 Mar 2010 21:05:27 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12842020#action_12842020
] 

Eric Yang commented on CHUKWA-460:
----------------------------------

Demux process should not be using writer.hdfs.filesystem.  The original implementation made
a mistake to use "writer.hdfs.filesystem" as reference to hdfs.  Instead, demux should pick
up the proper hdfs url from HADOOP_CONF_DIR.  I don't have any objection on the suggested
workaround, but less configuration that we need to maintain, the better.


> Demux depends on conf/chukwa-collector-conf.xml
> -----------------------------------------------
>
>                 Key: CHUKWA-460
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-460
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: Data Processors
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>
> We've packaged our own chukwa rpms to be able to deploy the collector, the agent and
the data processor each separately. In doing so I realized that the data processor (i.e.,
Demux) has a dependency on conf/chukwa-collector-conf.xml as packaged in the distro, since
that's the only place where where 'writer.hdfs.filesystem' is set.
> The workaround is straight forward enough (just add writer.hdfs.filesystem to chukwa-demux.xml),
but I thought I'd point out the cross-dependency. Although it feels redundant, it seems the
proper thing to do would be to include writer.hdfs.filesystem in both configs, since both
processes have that dep. Thoughts?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message