chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <j...@apache.org>
Subject [jira] Assigned: (CHUKWA-284) division of responsibility between agent and adaptor
Date Mon, 29 Jun 2009 22:40:47 GMT

     [ https://issues.apache.org/jira/browse/CHUKWA-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ari Rabkin reassigned CHUKWA-284:
---------------------------------

    Assignee: Ari Rabkin

> division of responsibility between agent and adaptor
> ----------------------------------------------------
>
>                 Key: CHUKWA-284
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-284
>             Project: Hadoop Chukwa
>          Issue Type: Bug
>          Components: data collection
>    Affects Versions: 0.1.2, 0.2.0
>            Reporter: Ari Rabkin
>            Assignee: Ari Rabkin
>             Fix For: 0.3.0
>
>
> The division of responsibility between adaptor and agent for managing offsets, datatypes,
and such has gotten quite squirrely. And the comments don't match the code.
> For instance, the adaptors track last offset.  This means that checkpoint files include
the last byte enqueued to be SENT, rather than the last byte ACKNOWLEDGED. This violates both
the spec and the comments.
> I propose that we make the agent responsible for recording offsets and possibly also
datatypes.  Are there cases where an Adaptor decides on its own what the Datatype is for the
chunks it outputs?  Or outputs chunks of different Types?

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message