Return-Path: Delivered-To: apmail-hadoop-hive-dev-archive@minotaur.apache.org Received: (qmail 33206 invoked from network); 23 Jun 2010 01:58:15 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 23 Jun 2010 01:58:15 -0000 Received: (qmail 75979 invoked by uid 500); 23 Jun 2010 01:58:15 -0000 Delivered-To: apmail-hadoop-hive-dev-archive@hadoop.apache.org Received: (qmail 75947 invoked by uid 500); 23 Jun 2010 01:58:14 -0000 Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hive-dev@hadoop.apache.org Delivered-To: mailing list hive-dev@hadoop.apache.org Received: (qmail 75939 invoked by uid 99); 23 Jun 2010 01:58:14 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 01:58:14 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=10.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.22] (HELO thor.apache.org) (140.211.11.22) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 23 Jun 2010 01:58:12 +0000 Received: from thor (localhost [127.0.0.1]) by thor.apache.org (8.13.8+Sun/8.13.8) with ESMTP id o5N1vpGb024947 for ; Wed, 23 Jun 2010 01:57:51 GMT Message-ID: <19270819.6591277258271077.JavaMail.jira@thor> Date: Tue, 22 Jun 2010 21:57:51 -0400 (EDT) From: "Venky Iyer (JIRA)" To: hive-dev@hadoop.apache.org Subject: [jira] Created: (HIVE-1429) Support side-effect file generation from Hive TRANSFORM jobs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Support side-effect file generation from Hive TRANSFORM jobs ------------------------------------------------------------ Key: HIVE-1429 URL: https://issues.apache.org/jira/browse/HIVE-1429 Project: Hadoop Hive Issue Type: New Feature Reporter: Venky Iyer Assignee: Joydeep Sen Sarma Priority: Minor The goal is to allow users to create side-effect output files on the local disk, and then for successful task attempts, promote the files into an HDFS directory specified by the user. This allows for logging and writing files in formats not easily produced from TRANSFORMs. It might also be nice to have the ability to promote these files regardless of attempt success, which would allow easier debugging of why something failed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.