Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 33D9B200B69 for ; Fri, 5 Aug 2016 14:48:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 32AC1160A8E; Fri, 5 Aug 2016 12:48:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 7AFF3160A6D for ; Fri, 5 Aug 2016 14:48:21 +0200 (CEST) Received: (qmail 52665 invoked by uid 500); 5 Aug 2016 12:48:20 -0000 Mailing-List: contact issues-help@ambari.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ambari.apache.org Delivered-To: mailing list issues@ambari.apache.org Received: (qmail 52643 invoked by uid 99); 5 Aug 2016 12:48:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 05 Aug 2016 12:48:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 84C392C0059 for ; Fri, 5 Aug 2016 12:48:20 +0000 (UTC) Date: Fri, 5 Aug 2016 12:48:20 +0000 (UTC) From: =?utf-8?Q?Oliv=C3=A9r_Szab=C3=B3_=28JIRA=29?= To: issues@ambari.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (AMBARI-17788) Refactor spooler code in OutputHDFSFile to be reusable for OutputS3File MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 05 Aug 2016 12:48:22 -0000 [ https://issues.apache.org/jira/browse/AMBARI-17788?page=3Dcom.atlassi= an.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=3D15= 409404#comment-15409404 ]=20 Oliv=C3=A9r Szab=C3=B3 commented on AMBARI-17788: --------------------------------------- committed to trunk: {code:java} commit c63b34cc2d02d58e4b76ac29c50e812a10eb3e6c Author: oleewere Date: Fri Aug 5 14:15:48 2016 +0200 AMBARI-17788. Refactor spooler code in OutputHDFSFile to be reusable fo= r OutputS3File (Hemanth Yamijala via oleewere) {code} I keep this open until its not merged into branch-2.5 (now its does not exi= st, so merge into 2.5 after the merging happened) > Refactor spooler code in OutputHDFSFile to be reusable for OutputS3File > ----------------------------------------------------------------------- > > Key: AMBARI-17788 > URL: https://issues.apache.org/jira/browse/AMBARI-17788 > Project: Ambari > Issue Type: Technical task > Components: ambari-logsearch > Affects Versions: 2.4.0 > Reporter: Hemanth Yamijala > Assignee: Hemanth Yamijala > Fix For: 2.5.0 > > Attachments: AMBARI-17788-3.patch, AMBARI-17788.patch > > > AMBARI-17785 proposed to enhance logsearch capabilities to periodically u= pload logs to S3, by using a spooling mechanism. [~mdharmesh] pointed out t= hat such a facility already exists in the HDFS file copy handling. Looking = at the code, there is a lot of similarity that can be reused in both cases.= This task is to extract the common mechanisms and parameterize them so tha= t it will make it easier to reuse and also help have similar improvements t= o spooling logic if any. -- This message was sent by Atlassian JIRA (v6.3.4#6332)