incubator-chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From IvyTang <>
Subject More about the removing of duplicate chunks
Date Wed, 28 Mar 2012 07:56:03 GMT
Thanks to the simple archiver , we do remove almost all the duplicate

But we found that there are still few ,very few duplicate chunks left .

And strangely , these chunks's key are't the same. The DataType,StreamName
and SeqId are the same , but the TimePartition are different. The log in
these chunks are the same.

Could we just distinguish the duplicate chunks using
the DataType,StreamName and SeqId ? What's the TimePartition meaning for?


Best regards,

Ivy Tang

View raw message