jackrabbit-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dominique Pfister (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (JCR-3731) Multi-threaded migration of binary files from FileSystem to S3 datastore
Date Tue, 11 Mar 2014 19:52:45 GMT

    [ https://issues.apache.org/jira/browse/JCR-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13930844#comment-13930844
] 

Dominique Pfister commented on JCR-3731:
----------------------------------------

[~shgupta], the patch provided doesn't work against CachingDataStore.java (7 out of 7 hunks
fail) - can you rebase your changes on the latest svn version and post another patch?

> Multi-threaded migration of binary files from FileSystem to S3 datastore 
> -------------------------------------------------------------------------
>
>                 Key: JCR-3731
>                 URL: https://issues.apache.org/jira/browse/JCR-3731
>             Project: Jackrabbit Content Repository
>          Issue Type: Sub-task
>          Components: jackrabbit-core
>    Affects Versions: 2.7.4
>            Reporter: Shashank Gupta
>             Fix For: 2.7.5
>
>         Attachments: JCR-3651.patch
>
>
> As per today, when we switch repository from FileDataStore to S3DataStore all binary
files are migrated from local file system to S3Datastore. As per today this process is single
threaded and takes lot of time. For e.g. for 1G intial content, it takes around 5 min to migrated
from ec2 instance to S3.
> It can be made faster by migrating content in multi-threaded environment.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message