chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-540) Problem while testing the new user defined adaptor
Date Mon, 25 Oct 2010 16:53:18 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12924632#action_12924632
] 

Eric Yang commented on CHUKWA-540:
----------------------------------

 XML file is not good for streaming through Chukwa because the data are ordered by line, sending
small bits of xml over Chukwa collectors in parallel do not guarantee the original ordering.
 FileAdaptor can send whole xml file as one post, hence it will keep the original data consistent,
but the file needs to be less than 300k or agent buffer might overflow.


> Problem while testing the new user defined adaptor
> --------------------------------------------------
>
>                 Key: CHUKWA-540
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-540
>             Project: Chukwa
>          Issue Type: Test
>          Components: build and test code
>    Affects Versions: 0.4.0
>         Environment: linux
>            Reporter: Prachi Bedekar
>             Fix For: 0.4.0
>
>   Original Estimate: 120h
>  Remaining Estimate: 120h
>
> I have created the adaptor class in chukwa for log files which are in xml format. When
I am testing, the data is going to the demux processing n then stops.
> No data is present in repos after 5 mins.
> I have set the interval as 5 min for data flow in this operation.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message