chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-102) Provide streaming adapter
Date Tue, 04 Aug 2009 20:17:14 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739131#action_12739131
] 

Ari Rabkin commented on CHUKWA-102:
-----------------------------------

Yes. The price of this approach is that you can't handle failures well, you can't share connections
between different appenders, and you can't gracefully support anything where you don't control
the logging.  So I think for most purposes the Agent design is an improvement.  Obviously,
there are cases where you can change the log4j adaptor, and can't add a deamon, however.

I'm sort of skeptical that a DAG of collectors really helps you that much.  The thing is accomplishes
is bounding the number of incoming connections per collector; but it's not clear that that's
a serious scaling limit. 

> Provide streaming adapter
> -------------------------
>
>                 Key: CHUKWA-102
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-102
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: input tools
>            Reporter: Mac Yang
>
> Enable applications to send data directly to the agent without writing to disk first.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message