Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A868618D46 for ; Mon, 29 Feb 2016 08:00:51 +0000 (UTC) Received: (qmail 14485 invoked by uid 500); 29 Feb 2016 08:00:44 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 14440 invoked by uid 500); 29 Feb 2016 08:00:44 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 14430 invoked by uid 99); 29 Feb 2016 08:00:44 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 29 Feb 2016 08:00:44 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 44A6FC0287 for ; Mon, 29 Feb 2016 08:00:44 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id ipc0UScA9yuT for ; Mon, 29 Feb 2016 08:00:43 +0000 (UTC) Received: from mail-wm0-f42.google.com (mail-wm0-f42.google.com [74.125.82.42]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id 0230A5FADB for ; Mon, 29 Feb 2016 08:00:42 +0000 (UTC) Received: by mail-wm0-f42.google.com with SMTP id p65so56665945wmp.1 for ; Mon, 29 Feb 2016 00:00:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to; bh=OPYtGwtN7yV/zffdq8+I0L4M3UIFrZ7NuKEeD5skwWw=; b=Zk5vMZfz0fCupQLpuIPOlnu596tnwJEv2dy+6Dc2da0AAc5IcQyn/Ur+VF8TPgyiVr 3mmb1pD5LgbBwsguk0RhqkxTZ8eiHhsV5PAzDwzqAIidqFWspgraTeznoPlmG0pFyMo+ G8iPp5KoJ2wIu2sfNjqk4DnOJz8mQBQrjtVDeHN4x4Oiay7PwuQ+biao/hfdCBMxP/HG IXQs/TIBdvBACv5WPkVqc2Cfe2LpJ+R4LVnEX2pDhEFtL+WXHSn72BUP4husAxNjofLn hoBvAS9pcZ/+SksaVK8sAZNo49dlxvtBbDM4DsDSjX7ml6kDvBBx26hRlBeGsRi/OKCI U/AA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=OPYtGwtN7yV/zffdq8+I0L4M3UIFrZ7NuKEeD5skwWw=; b=fohzK7IOYdopDJTYYphK6hxA6Z3QzntVktroKgk8gTK2bYL9SIY0ySGg94Dd8C+aqL 0YhWMxLo63sMmdF2TAoc/qFchP/NN4JazafV/GQFQrmomJpL5cdI1jLM9Jk8t9TOvZys EMDry0okUNAsL55mtZVOkDAuAkxOHnjw4IlxGCK8SFbSqW1NgczIiwEnXqF+CUaIRV2s /ygv1phKArWIzkGEVd7vluovYBmZyzooXOFQAqArp5g0bRBYmFZNd1yYrophKeTTywi6 oBQDatUJYjO57uPlNCVDI5AXc/qobWen+u20vEY+p8Of/xN/5WvAaIcL+sqWWEGACYEF NJqA== X-Gm-Message-State: AD7BkJLwdG2jgTcOIDk0IkR5jTbWTBF+p2T+UzkkHFnExNKspAx8tAKWFyltmKTLOcdeLFjtOhOWi1A45XLZBA== MIME-Version: 1.0 X-Received: by 10.28.109.141 with SMTP id b13mr9363166wmi.25.1456732842464; Mon, 29 Feb 2016 00:00:42 -0800 (PST) Received: by 10.27.131.77 with HTTP; Mon, 29 Feb 2016 00:00:42 -0800 (PST) Date: Mon, 29 Feb 2016 10:00:42 +0200 Message-ID: Subject: .tmp files are left forever if flume is crushing From: Rani Yaroshinski To: user@flume.apache.org Content-Type: multipart/alternative; boundary=001a114656589b9e72052ce40b74 --001a114656589b9e72052ce40b74 Content-Type: text/plain; charset=UTF-8 Hi, we face issues with "orphan" .tmp files, which are leftovers from HDFS-Sink, in the case that flume crushes before the roll conditions are met. I am trying to find some way to deal with those files, since it seems that the mechanism is not complete. Regards, Rani --001a114656589b9e72052ce40b74 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi,

we face issues with &quo= t;orphan" .tmp files, which are leftovers from HDFS-Sink, in the case = that flume crushes before the roll conditions are met.

=
I am trying to find some way to deal with those files, since it seems = that the mechanism is not complete.

Regards,
=
Rani
--001a114656589b9e72052ce40b74--