incubator-s4-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Quoc Nguyen (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (S4-30) DefaultHasher hashes keys to negative number
Date Thu, 01 Dec 2011 21:38:40 GMT
DefaultHasher hashes keys to negative number
--------------------------------------------

                 Key: S4-30
                 URL: https://issues.apache.org/jira/browse/S4-30
             Project: Apache S4
          Issue Type: Bug
    Affects Versions: 0.4
         Environment: All - Windows and Linux
            Reporter: Quoc Nguyen
            Priority: Blocker


DefaultHasher uses HashAlgorithm hashAlgorithm = HashAlgorithm.FNV1_64_HASH; which hashes
key strings such as 118+18233, 118+17360, 118+17258, 118+18147 and 118+18121 and many more
to negative values which the DefaultPartitioner (int partitionId = (int) (hasher.hash(stringValue)
% partitionCount);) tries to partition the key to incorrect partition.

Workaround:
None - stream has those keys, they will get dropped because the partitioner cannot correctly
partition.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message