hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Created: (HADOOP-4711) Chukwa - Add a config parameter to allow agent to talk to the same collector until connection fails.
Date Fri, 21 Nov 2008 22:37:44 GMT
Chukwa - Add a config parameter to allow agent to talk to the same collector until connection
fails.
----------------------------------------------------------------------------------------------------

                 Key: HADOOP-4711
                 URL: https://issues.apache.org/jira/browse/HADOOP-4711
             Project: Hadoop Core
          Issue Type: New Feature
         Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
            Reporter: Eric Yang


In chukwa agent, we added ability to rotate collector on each HTTP post.  RAD Lab is using
Chukwa Agent differently, and would like to have the option to keep agent on the same collector.
 On the smaller scale of the Chukwa, it makes sense to process data without the map reduce
job.  A new interface needs to be created as a T pipe line to stream data from collector directly
into a Database or external storage.  In this configuration, it is better to channel similar
data to the same collector to reduce the cost of reassembling chunks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message