Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1F2FC9332 for ; Fri, 12 Dec 2014 06:35:36 +0000 (UTC) Received: (qmail 47396 invoked by uid 500); 12 Dec 2014 06:35:35 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 47350 invoked by uid 500); 12 Dec 2014 06:35:35 -0000 Mailing-List: contact dev-help@falcon.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.incubator.apache.org Delivered-To: mailing list dev@falcon.incubator.apache.org Received: (qmail 47339 invoked by uid 99); 12 Dec 2014 06:35:35 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Dec 2014 06:35:35 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.3] (HELO mail.apache.org) (140.211.11.3) by apache.org (qpsmtpd/0.29) with SMTP; Fri, 12 Dec 2014 06:35:34 +0000 Received: (qmail 47293 invoked by uid 99); 12 Dec 2014 06:35:14 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Dec 2014 06:35:14 +0000 Date: Fri, 12 Dec 2014 06:35:13 +0000 (UTC) From: "Shwetha G S (JIRA)" To: dev@falcon.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (FALCON-943) process update copying user lib is very slow MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Shwetha G S created FALCON-943: ---------------------------------- Summary: process update copying user lib is very slow Key: FALCON-943 URL: https://issues.apache.org/jira/browse/FALCON-943 Project: Falcon Issue Type: Bug Reporter: Shwetha G S Assignee: Shwetha G S Currently, process update copies the user workflow and lib directories to staging directory to provide workflow versions. If the library contains many jars, hdfs copy takes longer and the update API becomes very slow. Worse if the feed update in turn calls process update, feed update takes ~30 mins! -- This message was sent by Atlassian JIRA (v6.3.4#6332)