chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <>
Subject [jira] Created: (CHUKWA-338) duplicate suppression in archiver
Date Tue, 30 Jun 2009 08:30:47 GMT
duplicate suppression in archiver

                 Key: CHUKWA-338
             Project: Hadoop Chukwa
          Issue Type: New Feature
          Components: Data Processors
            Reporter: Ari Rabkin

Right now, Archiver uses an identity reducer.

It should be straightforward to write a custom reducer that does duplicate detection and suppression
if we get multiple chunks with the same key.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message