chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-102) Provide streaming adapter
Date Wed, 08 Apr 2009 16:48:12 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12697089#action_12697089
] 

Jerome Boulon commented on CHUKWA-102:
--------------------------------------

I effectively wrote a prototype long time ago, in fact prior to the FileAdaptor. 
I understand your concern about buffering, network issue and so on however, there's some persistent
requests to get something that does not write to disk but the contract will be clear: StreamingAdaptor
could not guarantee any data delevery so if agent is not there the data will be dropped. Later
on we may have some kind of buffering but that will not be the case for the first iteration.
If loosing data is not acceptable then a file based adaptopr shold be used.
 
It's on my plan to work on this withing the next 3 weeks and I was planning to use Avro.

> Provide streaming adapter
> -------------------------
>
>                 Key: CHUKWA-102
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-102
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: input tools
>            Reporter: Mac Yang
>
> Enable applications to send data directly to the agent without writing to disk first.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message