Mailing-List: contact hive-dev-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hive-dev@hadoop.apache.org
Message-ID: <1339236258.445631269384869072.JavaMail.jira@brutus.apache.org>
Date: Tue, 23 Mar 2010 22:54:29 +0000 (UTC)
From: "Zheng Shao (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Subject: [jira] Created: (HIVE-1272) Add SymlinkTextInputFormat to Hive
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit

Add SymlinkTextInputFormat to Hive
----------------------------------

                 Key: HIVE-1272
                 URL: https://issues.apache.org/jira/browse/HIVE-1272
             Project: Hadoop Hive
          Issue Type: New Feature
    Affects Versions: 0.5.0
            Reporter: Zheng Shao


We'd like to add a symlink text input format so that we can specify the list of files for a table/partition based on the content of a text file.

For example, the location of the table is "/user/hive/mytable".
There is a file called "/user/hive/mytable/myfile.txt".
Inside the file, there are 2 lines, "/user/myname/textfile1.txt" and "/user/myname/textfile2.txt"

We can do:
{code}
CREATE TABLE mytable (...) STORED AS INPUTFORMAT 'org.apache.hadoop.hive.io.SymlinkTextInputFormat' LOCATION '/user/hive/mytable';
SELECT * FROM mytable;
{code}

which will return the content of the 2 files: "/user/myname/textfile1.txt" and "/user/myname/textfile2.txt"


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.