chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jerome Boulon (JIRA)" <j...@apache.org>
Subject [jira] Updated: (CHUKWA-194) Backfilling tools
Date Fri, 05 Jun 2009 18:09:07 GMT

     [ https://issues.apache.org/jira/browse/CHUKWA-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jerome Boulon updated CHUKWA-194:
---------------------------------

    Attachment: CHUKWA-194.patch

Backfilling tool: 

Class:
- BackfillingLoader
Input: 
-    String cluster = args[0];
-    String machine = args[1];
-    String adaptorName = args[2];
-    String recordType = args[3];
-    String logFile = args[4];

Major change API change: for backfilling I need to know when an adaptor has finished posting
data to the queue. So instead of create yet another shutdown method I have deprecated the
hardStop and the shutdown method to add a new one: public long shutdown(AdaptorShutdownPolicy
shutdownPolicy) throws AdaptorException;

AdaptorShutdownPolicy are: HARD_STOP, GRACEFULLY, WAIT_TILL_FINISHED

Minor change for the socket controller :
s.setReuseAddress(true); for the socket controller


> Backfilling tools
> -----------------
>
>                 Key: CHUKWA-194
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-194
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: data collection
>            Reporter: Jerome Boulon
>            Assignee: Jerome Boulon
>             Fix For: 0.2.0
>
>         Attachments: CHUKWA-194.patch
>
>
> Chukwa should have a command line tools todo some backfilling process.
> Parameters should be:
> - cluster
> - machine
> - adaptor 
> - recordType
> - file
> The idea is to call all component within the same process and the output should be a
dataSink file ready to be processed by Demux.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message