hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-6232) allow user to control out-of-range values in HCatStorer
Date Mon, 20 Jan 2014 20:05:21 GMT
Eugene Koifman created HIVE-6232:
------------------------------------

             Summary: allow user to control out-of-range values in HCatStorer
                 Key: HIVE-6232
                 URL: https://issues.apache.org/jira/browse/HIVE-6232
             Project: Hive
          Issue Type: Sub-task
          Components: HCatalog
    Affects Versions: 0.13.0
            Reporter: Eugene Koifman
            Assignee: Eugene Koifman


Pig values support wider range than Hive.  e.g. Pig BIGDECIMAL vs Hive DECIMAL.  When storing
Pig data into Hive table, if the value is out of range there are 2 options:
1. throw an exception.
2. write NULL instead of the value

The 1st has the drawback that it may kill the process that loads 100M rows after 90M rows
have been loaded.  But the 2nd may not be appropriate for all use cases.

Should add support for additional parameters in HCatStorer where the user can specify an option
to controll this.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message