Return-Path: X-Original-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C85CC11A7A for ; Wed, 9 Jul 2014 01:50:05 +0000 (UTC) Received: (qmail 88547 invoked by uid 500); 9 Jul 2014 01:50:05 -0000 Delivered-To: apmail-hadoop-hdfs-issues-archive@hadoop.apache.org Received: (qmail 88495 invoked by uid 500); 9 Jul 2014 01:50:05 -0000 Mailing-List: contact hdfs-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-issues@hadoop.apache.org Delivered-To: mailing list hdfs-issues@hadoop.apache.org Received: (qmail 88480 invoked by uid 99); 9 Jul 2014 01:50:05 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 09 Jul 2014 01:50:05 +0000 Date: Wed, 9 Jul 2014 01:50:05 +0000 (UTC) From: "Zhanwei Wang (JIRA)" To: hdfs-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HDFS-6633) Support reading new data in a being written file until the file is closed MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HDFS-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055746#comment-14055746 ] Zhanwei Wang commented on HDFS-6633: ------------------------------------ Hi Nicholas Would you please point out the use case for this feature? In my opinion, the file which is open for read can read the last appended data is good enough. But letting the reader wait for the file close seems overkill. If this feature is needed in some use case, is it better to enable this feature for a specific file instead of a filesystem level configure parameter? > Support reading new data in a being written file until the file is closed > ------------------------------------------------------------------------- > > Key: HDFS-6633 > URL: https://issues.apache.org/jira/browse/HDFS-6633 > Project: Hadoop HDFS > Issue Type: New Feature > Components: hdfs-client > Reporter: Tsz Wo Nicholas Sze > Assignee: Tsz Wo Nicholas Sze > Attachments: h6633_20140707.patch, h6633_20140708.patch > > > When a file is being written, the file length keeps increasing. If the file is opened for read, the reader first gets the file length and then read only up to that length. The reader will not be able to read the new data written afterward. > We propose adding a new feature so that readers will be able to read all the data until the writer closes the file. -- This message was sent by Atlassian JIRA (v6.2#6252)