hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raviv M-G (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-1637) String partitions that are equal to "" or start with spaces or contains periods or asterisks cause errors
Date Thu, 16 Sep 2010 15:35:33 GMT

     [ https://issues.apache.org/jira/browse/HIVE-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Raviv M-G updated HIVE-1637:
----------------------------

        Summary: String partitions that are equal to "" or start with spaces or contains periods
or asterisks cause errors  (was: String partitions that are equal to "" or start with spaces
or numbers cause errors)
    Description: 
When a string partition is equal to "" (the empty string) or starts with a space or contains
periods or asterisks joins on that table or selecting one field from that table will cause
errors.  You can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max
(= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a
Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0
DENMARK)



  was:
When a string partition is equal to "" (the empty string) or starts with a space or with a
number joins on that table or selecting one field from that table will cause errors.  You
can, however, still perform partition specific queries without a problem.


    > select UT from researchaddress limit 10;
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max
(= 134217728)
java.lang.IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create a
Path from an empty string)'


And attempting to rename a table with such a partition causes:

hive> alter table researchaddress rename to researchaddress2;
Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0
DENMARK)




> String partitions that are equal to "" or start with spaces or contains periods or asterisks
cause errors
> ---------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-1637
>                 URL: https://issues.apache.org/jira/browse/HIVE-1637
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.7.0
>         Environment: java 1.6
>            Reporter: Raviv M-G
>            Priority: Minor
>
> When a string partition is equal to "" (the empty string) or starts with a space or contains
periods or asterisks joins on that table or selecting one field from that table will cause
errors.  You can, however, still perform partition specific queries without a problem.
>     > select UT from researchaddress limit 10;
> Total MapReduce jobs = 1
> Launching Job 1 out of 1
> Number of reduce tasks is set to 0 since there's no reduce operator
> Cannot run job locally: Input Size (= 134217728) is larger than hive.exec.mode.local.auto.inputbytes.max
(= 134217728)
> java.lang.IllegalArgumentException: Can not create a Path from an empty string
> 	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:90)
> 	at org.apache.hadoop.mapred.FileInputFormat.addInputPaths(FileInputFormat.java:296)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.addInputPaths(ExecDriver.java:1182)
> 	at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:569)
> 	at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:120)
> 	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:108)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:55)
> 	at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
> Job Submission failed with exception 'java.lang.IllegalArgumentException(Can not create
a Path from an empty string)'
> And attempting to rename a table with such a partition causes:
> hive> alter table researchaddress rename to researchaddress2;
> Invalid alter operation: Old partition location  is invalid. (hdfs://ourwebsite.org:54310/user/hive/warehouse/researchaddress/nu=0
DENMARK)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message