jackrabbit-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shashank Gupta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (JCR-3730) Use object keys to create partitions in S3 automatically
Date Fri, 21 Feb 2014 06:54:19 GMT

    [ https://issues.apache.org/jira/browse/JCR-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13908042#comment-13908042

Shashank Gupta commented on JCR-3730:

>A hashed prefix of three or four characters should be sufficient.
hashed prefix guarantees to distribute load and hence implemented that way. 
No sure if SHA1 hash can distribute the load. 

> Use object keys to create partitions in S3 automatically
> --------------------------------------------------------
>                 Key: JCR-3730
>                 URL: https://issues.apache.org/jira/browse/JCR-3730
>             Project: Jackrabbit Content Repository
>          Issue Type: Sub-task
>          Components: jackrabbit-core
>    Affects Versions: 2.7.4
>            Reporter: Shashank Gupta
>             Fix For: 2.7.5
> To improve performance of S3, it is recommended to use object keys which enables to save
data in multiple partitions. [1]
> The current key format dataStore_SHA1_HASH put all data in single partition. It is recommended
to remove dataStore_ prefix and split SHA1_HASH to enable randomness in prefix. 
> for e.g. if older key format is dataStore_004cb70c8f87d78f04da41e7547cb434094089ea. change
this key format to 004c-b70c8f87d78f04da41e7547cb434094089ea
> *Also consider upgrade scenario to migrate older key format data
> http://docs.aws.amazon.com/AmazonS3/latest/dev/request-rate-perf-considerations.html

This message was sent by Atlassian JIRA

View raw message