hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joydeep Sen Sarma (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1355) Hive should use NullOutputFormat for hadoop jobs
Date Tue, 01 Jun 2010 23:57:40 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Joydeep Sen Sarma updated HIVE-1355:

    Status: Patch Available  (was: Open)

> Hive should use NullOutputFormat for hadoop jobs
> ------------------------------------------------
>                 Key: HIVE-1355
>                 URL: https://issues.apache.org/jira/browse/HIVE-1355
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Joydeep Sen Sarma
>            Assignee: Joydeep Sen Sarma
>         Attachments: 1355.1.patch
> see https://issues.apache.org/jira/browse/MAPREDUCE-1802
> hive doesn't depend on hadoop job output folder. it produces output exclusively via side
effect folders. we should use an outputformat that can request hadoop skip cleanup/setup.
this could be nulloutputformat (unless there are any objections in hadoop to changing nulloutputformat
> as a small side effect, it also avoids some totally unnecessary hdfs file creates and
deletes in hdfs.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message