Return-Path: X-Original-To: apmail-jackrabbit-dev-archive@www.apache.org Delivered-To: apmail-jackrabbit-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A898010563 for ; Tue, 11 Mar 2014 19:53:00 +0000 (UTC) Received: (qmail 2951 invoked by uid 500); 11 Mar 2014 19:52:57 -0000 Delivered-To: apmail-jackrabbit-dev-archive@jackrabbit.apache.org Received: (qmail 2843 invoked by uid 500); 11 Mar 2014 19:52:49 -0000 Mailing-List: contact dev-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@jackrabbit.apache.org Delivered-To: mailing list dev@jackrabbit.apache.org Received: (qmail 1843 invoked by uid 99); 11 Mar 2014 19:52:45 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 11 Mar 2014 19:52:45 +0000 Date: Tue, 11 Mar 2014 19:52:45 +0000 (UTC) From: "Dominique Pfister (JIRA)" To: dev@jackrabbit.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (JCR-3731) Multi-threaded migration of binary files from FileSystem to S3 datastore MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/JCR-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13930844#comment-13930844 ] Dominique Pfister commented on JCR-3731: ---------------------------------------- [~shgupta], the patch provided doesn't work against CachingDataStore.java (7 out of 7 hunks fail) - can you rebase your changes on the latest svn version and post another patch? > Multi-threaded migration of binary files from FileSystem to S3 datastore > ------------------------------------------------------------------------- > > Key: JCR-3731 > URL: https://issues.apache.org/jira/browse/JCR-3731 > Project: Jackrabbit Content Repository > Issue Type: Sub-task > Components: jackrabbit-core > Affects Versions: 2.7.4 > Reporter: Shashank Gupta > Fix For: 2.7.5 > > Attachments: JCR-3651.patch > > > As per today, when we switch repository from FileDataStore to S3DataStore all binary files are migrated from local file system to S3Datastore. As per today this process is single threaded and takes lot of time. For e.g. for 1G intial content, it takes around 5 min to migrated from ec2 instance to S3. > It can be made faster by migrating content in multi-threaded environment. -- This message was sent by Atlassian JIRA (v6.2#6252)