chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <j...@apache.org>
Subject [jira] Created: (CHUKWA-338) duplicate suppression in archiver
Date Tue, 30 Jun 2009 08:30:47 GMT
duplicate suppression in archiver
---------------------------------

                 Key: CHUKWA-338
                 URL: https://issues.apache.org/jira/browse/CHUKWA-338
             Project: Hadoop Chukwa
          Issue Type: New Feature
          Components: Data Processors
            Reporter: Ari Rabkin


Right now, Archiver uses an identity reducer.

It should be straightforward to write a custom reducer that does duplicate detection and suppression
if we get multiple chunks with the same key.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message