Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BD62D663D for ; Wed, 27 Jul 2011 21:37:35 +0000 (UTC) Received: (qmail 93600 invoked by uid 500); 27 Jul 2011 21:37:35 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 93266 invoked by uid 500); 27 Jul 2011 21:37:34 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 93256 invoked by uid 500); 27 Jul 2011 21:37:34 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 93248 invoked by uid 99); 27 Jul 2011 21:37:34 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Jul 2011 21:37:34 +0000 X-ASF-Spam-Status: No, hits=-2001.2 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 27 Jul 2011 21:37:32 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 5A92A8E91E for ; Wed, 27 Jul 2011 21:37:12 +0000 (UTC) Date: Wed, 27 Jul 2011 21:37:12 +0000 (UTC) From: "jiraposter@reviews.apache.org (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: <1677749404.13580.1311802632367.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <86432200.13427.1311801454268.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] [Commented] (HIVE-2318) Support multiple file systems MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072036#comment-13072036 ] jiraposter@reviews.apache.org commented on HIVE-2318: ----------------------------------------------------- ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1210/ ----------------------------------------------------------- Review request for hive. Summary ------- Support multiple file systems This addresses bug HIVE-2318. https://issues.apache.org/jira/browse/HIVE-2318 Diffs ----- ql/src/java/org/apache/hadoop/hive/ql/Context.java 1a1ffc5 ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java c031f40 ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java c9e61a1 ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java c6f6755 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java a57f9cf ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java 092a5cd ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 337a8eb ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java 3001575 ql/src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java 6f311c6 ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java e1febc3 ql/src/java/org/apache/hadoop/hive/ql/plan/ConditionalResolverMergeFiles.java 5c09789 ql/src/java/org/apache/hadoop/hive/ql/plan/DynamicPartitionCtx.java 29cfe9d Diff: https://reviews.apache.org/r/1210/diff Testing ------- Thanks, Vaibhav > Support multiple file systems > ----------------------------- > > Key: HIVE-2318 > URL: https://issues.apache.org/jira/browse/HIVE-2318 > Project: Hive > Issue Type: New Feature > Reporter: Vaibhav Aggarwal > Assignee: Vaibhav Aggarwal > > Currently some of the Hive tasks like MoveTask, ConditionalMergeResolver assume that the data is being copied or moved on the same file system. > These operators file if the source table is in one filesystem (like HDFS) and destination table is in another file system (like s3). > This patch aims at: > 1. Support moving data between different file systems. > 2. Add support for file systems which do not support 'move' operation like s3. > 3. Remove redundant operations like moving data from and to the same location. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira