Return-Path: Delivered-To: apmail-hadoop-hive-dev-archive@minotaur.apache.org Received: (qmail 87045 invoked from network); 16 Jul 2010 23:16:17 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 16 Jul 2010 23:16:17 -0000 Received: (qmail 33961 invoked by uid 500); 16 Jul 2010 23:16:17 -0000 Delivered-To: apmail-hadoop-hive-dev-archive@hadoop.apache.org Received: (qmail 33556 invoked by uid 500); 16 Jul 2010 23:16:16 -0000 Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hadoop.apache.org Delivered-To: mailing list hive-dev@hadoop.apache.org Received: (qmail 33548 invoked by uid 99); 16 Jul 2010 23:16:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Jul 2010 23:16:16 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 16 Jul 2010 23:16:13 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o6GNFq9Z010276 for ; Fri, 16 Jul 2010 23:15:52 GMT Message-ID: <15309684.431191279322152205.JavaMail.jira@thor> Date: Fri, 16 Jul 2010 19:15:52 -0400 (EDT) From: "He Yongqiang (JIRA)" To: hive-dev@hadoop.apache.org Subject: [jira] Commented: (HIVE-1463) hive output file names are unnecessarily large In-Reply-To: <28538387.362411279061630859.JavaMail.jira@thor> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/HIVE-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889395#action_12889395 ] He Yongqiang commented on HIVE-1463: ------------------------------------ Agreed with Ning. Need to be especially careful about the renaming to make sure the renaming will not change the ordering of filenames. Both bucket map join and bucket sort map join just sort the filenames to match buckets in different tables. > hive output file names are unnecessarily large > ---------------------------------------------- > > Key: HIVE-1463 > URL: https://issues.apache.org/jira/browse/HIVE-1463 > Project: Hadoop Hive > Issue Type: Improvement > Reporter: Joydeep Sen Sarma > Attachments: hive-1463.1.patch > > > Hive's output files are named like this: > attempt_201006221843_431854_r_000000_0 > out of all of this goop - only one character '0' would have sufficed. we should fix this. This would help environments with namenode memory constraints. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.