From hcatalog-commits-return-968-apmail-incubator-hcatalog-commits-archive=incubator.apache.org@incubator.apache.org Thu Jul 19 20:31:24 2012 Return-Path: X-Original-To: apmail-incubator-hcatalog-commits-archive@minotaur.apache.org Delivered-To: apmail-incubator-hcatalog-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C7548CE5B for ; Thu, 19 Jul 2012 20:31:24 +0000 (UTC) Received: (qmail 98847 invoked by uid 500); 19 Jul 2012 20:31:24 -0000 Delivered-To: apmail-incubator-hcatalog-commits-archive@incubator.apache.org Received: (qmail 98806 invoked by uid 500); 19 Jul 2012 20:31:24 -0000 Mailing-List: contact hcatalog-commits-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hcatalog-dev@incubator.apache.org Delivered-To: mailing list hcatalog-commits@incubator.apache.org Received: (qmail 98799 invoked by uid 99); 19 Jul 2012 20:31:24 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Jul 2012 20:31:24 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 19 Jul 2012 20:31:22 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id 17B02238897A; Thu, 19 Jul 2012 20:31:02 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1363525 - /incubator/hcatalog/trunk/src/java/org/apache/hcatalog/mapreduce/FileRecordWriterContainer.java Date: Thu, 19 Jul 2012 20:31:02 -0000 To: hcatalog-commits@incubator.apache.org From: khorgath@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20120719203102.17B02238897A@eris.apache.org> Author: khorgath Date: Thu Jul 19 20:31:01 2012 New Revision: 1363525 URL: http://svn.apache.org/viewvc?rev=1363525&view=rev Log: HCATALOG-448 HCatStorer performance is 4x slower in HCat 0.4 than HCat 0.2 (rajesh.balamohan via khorgath) -- additional patch to incorporate rohini's review comments Modified: incubator/hcatalog/trunk/src/java/org/apache/hcatalog/mapreduce/FileRecordWriterContainer.java Modified: incubator/hcatalog/trunk/src/java/org/apache/hcatalog/mapreduce/FileRecordWriterContainer.java URL: http://svn.apache.org/viewvc/incubator/hcatalog/trunk/src/java/org/apache/hcatalog/mapreduce/FileRecordWriterContainer.java?rev=1363525&r1=1363524&r2=1363525&view=diff ============================================================================== --- incubator/hcatalog/trunk/src/java/org/apache/hcatalog/mapreduce/FileRecordWriterContainer.java (original) +++ incubator/hcatalog/trunk/src/java/org/apache/hcatalog/mapreduce/FileRecordWriterContainer.java Thu Jul 19 20:31:01 2012 @@ -124,7 +124,7 @@ class FileRecordWriterContainer extends } /** - * @return the storageDriver + * @return the storagehandler */ public HCatStorageHandler getStorageHandler() { return storageHandler; @@ -156,7 +156,6 @@ class FileRecordWriterContainer extends InterruptedException { org.apache.hadoop.mapred.RecordWriter localWriter; - org.apache.hadoop.mapred.TaskAttemptContext localContext; ObjectInspector localObjectInspector; SerDe localSerDe; OutputJobInfo localJobInfo = null; @@ -231,7 +230,6 @@ class FileRecordWriterContainer extends localJobInfo = dynamicOutputJobInfo.get(dynKey); localWriter = baseDynamicWriters.get(dynKey); localSerDe = baseDynamicSerDe.get(dynKey); - localContext = dynamicContexts.get(dynKey); localObjectInspector = dynamicObjectInspectors.get(dynKey); } else{