Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id E283963D4 for ; Sat, 6 Aug 2011 04:32:37 +0000 (UTC) Received: (qmail 75622 invoked by uid 500); 6 Aug 2011 04:32:35 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 74935 invoked by uid 500); 6 Aug 2011 04:32:16 -0000 Mailing-List: contact hdfs-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-user@hadoop.apache.org Delivered-To: mailing list hdfs-user@hadoop.apache.org Received: (qmail 74857 invoked by uid 99); 6 Aug 2011 04:32:11 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 06 Aug 2011 04:32:11 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.213.48 as permitted sender) Received: from [209.85.213.48] (HELO mail-yw0-f48.google.com) (209.85.213.48) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 06 Aug 2011 04:32:03 +0000 Received: by ywm3 with SMTP id 3so2930804ywm.35 for ; Fri, 05 Aug 2011 21:31:43 -0700 (PDT) Received: by 10.236.175.198 with SMTP id z46mr42334yhl.326.1312605103167; Fri, 05 Aug 2011 21:31:43 -0700 (PDT) MIME-Version: 1.0 Received: by 10.236.60.163 with HTTP; Fri, 5 Aug 2011 21:31:23 -0700 (PDT) In-Reply-To: References: From: Harsh J Date: Sat, 6 Aug 2011 10:01:23 +0530 Message-ID: Subject: Re: Multiple threads write to the same file To: hdfs-user@hadoop.apache.org, sudhan65@gmail.com Content-Type: text/plain; charset=ISO-8859-1 If you're merely sharing a writer instance among threads, there shouldn't be a problem (not at the HDFS level anyway, since it is just one writer connection with plenty of write calls). On Fri, Aug 5, 2011 at 6:39 PM, Sudharsan Sampath wrote: > Hi, > Does hdfs support writing in parallel to the same hdfs file using shared > writer among a pool of threads? > Thanks > Sudhan S -- Harsh J