hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rupinder Singh <rsi...@care.com>
Subject Wrong values returned for nullable columns in hbase tables when accessed via hive
Date Thu, 13 Jun 2013 17:01:12 GMT
Hi all,

I am facing an issue when selecting a nullable column twice in a hive select statement against
an hbase table. For rows where that column is null, 2 different values are returned: one null
(correct) and the second is the last non-null value.
Has anyone seen this issue?

The query:
hive> select visitorId, memberId, dateCreated, memberId from hbase_page_view;

The results:
003320da-01bf-4ddc-80e9-5d070389a53d    NULL    2013-05-21 15:19:31.781
007be1d9-a93a-4ca5-a5d3-e6047aa5cfd0    NULL    2013-05-21 14:18:14.623
00fe4cc7-e7a9-4351-8f9a-8165547dc4f5    NULL    2013-05-21 15:27:03.628
00fe4cc7-e7a9-4351-8f9a-8165547dc4f5    NULL    2013-05-21 15:27:34.174
00fe4cc7-e7a9-4351-8f9a-8165547dc4f5    78913   2013-05-21 15:28:58.714 78913
00fe4cc7-e7a9-4351-8f9a-8165547dc4f5    78913   2013-05-21 15:29:25.765 78913
01004f8b-8817-4866-84c7-b40e634a41d9    NULL    2013-05-21 14:36:29.405 78913
01619700-11f2-4b88-a9ef-55dc609379ca    NULL    2013-05-21 15:56:11.157 78913
01a5036a-7ebc-4f35-9be7-461ef318b4c9    NULL    2013-05-21 14:06:18.014 78913
01d91d8a-bd17-44aa-9604-cf6c8ca3d4f3    NULL    2013-05-21 14:05:02.095 78913
01d91d8a-bd17-44aa-9604-cf6c8ca3d4f3    89464   2013-05-21 14:05:51.820 89464
01d91d8a-bd17-44aa-9604-cf6c8ca3d4f3    89464   2013-05-21 14:06:53.558 89464
01d91d8a-bd17-44aa-9604-cf6c8ca3d4f3    89464   2013-05-21 14:07:23.479 89464
01d91d8a-bd17-44aa-9604-cf6c8ca3d4f3    89464   2013-05-21 14:13:59.841 89464
0207b0bd-f3ca-4b9a-acf1-afc401146195    NULL    2013-05-21 14:16:36.733 89464
0207b0bd-f3ca-4b9a-acf1-afc401146195    NULL    2013-05-21 14:28:12.305 89464
0526fae9-310a-4fbc-b2e9-4ecb5a4d21e2    NULL    2013-05-21 14:20:08.159 89464
0526fae9-310a-4fbc-b2e9-4ecb5a4d21e2    NULL    2013-05-21 14:21:08.006 89464
0526fae9-310a-4fbc-b2e9-4ecb5a4d21e2    NULL    2013-05-21 14:21:21.178 89464
0526fae9-310a-4fbc-b2e9-4ecb5a4d21e2    89472   2013-05-21 14:22:05.391 89472
0526fae9-310a-4fbc-b2e9-4ecb5a4d21e2    89472   2013-05-21 14:24:38.619 89472
0526fae9-310a-4fbc-b2e9-4ecb5a4d21e2    89472   2013-05-21 14:31:32.279 89472
0559118e-559a-469e-aeff-90254b128fa6    NULL    2013-05-21 14:02:17.084 89472
0559118e-559a-469e-aeff-90254b128fa6    NULL    2013-05-21 14:02:31.437 89472
0559118e-559a-469e-aeff-90254b128fa6    NULL    2013-05-21 14:03:43.456 89472
05bc7517-ceac-40f7-81c9-6da6d1c9713b    NULL    2013-05-21 15:57:49.375 89472
0625208e-015a-46be-85b5-ed5102af3d7c    NULL    2013-05-21 15:29:29.004 89472

The hbase table has a single column family. It is mapped to an external hive table using the
standard hive idiom like so:
CREATE EXTERNAL TABLE hbase_page_view(key string, visitorId string, dateCreated string, memberId
string, blah blah)
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES ("hbase.columns.mapping" = ":key,eve:visid,eve:datec,eve:mid,.....")
TBLPROPERTIES ("hbase.table.name" = "page_view");

thanks
Rupinder




This email is intended for the person(s) to whom it is addressed and may contain information
that is PRIVILEGED or CONFIDENTIAL. Any unauthorized use, distribution, copying, or disclosure
by any person other than the addressee(s) is strictly prohibited. If you have received this
email in error, please notify the sender immediately by return email and delete the message
and any attachments from your system.
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message