chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ari Rabkin (JIRA)" <j...@apache.org>
Subject [jira] Commented: (CHUKWA-368) proposed stress test
Date Tue, 04 Aug 2009 18:52:14 GMT

    [ https://issues.apache.org/jira/browse/CHUKWA-368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12739091#action_12739091
] 

Ari Rabkin commented on CHUKWA-368:
-----------------------------------

My proposal is as follows: modify ConstRateSender to emit, instead of random bytes, a byte
pattern that depends on the sequence number of the Chunk being produced.  (This is a small
and painless change).

Second, a MapReduce job that looks for that pattern and verifies that each chunk shows up
at least once, that counts the number of duplicates, and that verifies that Chunks aren't
corrupted.

Really, I'm worried about lost or duplicate chunks; the data pattern thing is just easy to
do at the same time.

> proposed stress test
> --------------------
>
>                 Key: CHUKWA-368
>                 URL: https://issues.apache.org/jira/browse/CHUKWA-368
>             Project: Hadoop Chukwa
>          Issue Type: New Feature
>          Components: build and test code
>            Reporter: Ari Rabkin
>
> I'd like to build a stress-test for Chukwa, to verify that collectors don't lose or corrupt
data under high load.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message