Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
MIME-Version: 1.0
In-Reply-To: <CAOr_Eshd63uqFTVxZiUYsujej0xwik-WTzhwh-UghqFv3i3C-A@mail.gmail.com>
References: <CAOr_Eshd63uqFTVxZiUYsujej0xwik-WTzhwh-UghqFv3i3C-A@mail.gmail.com>
Date: Thu, 5 May 2016 13:00:45 +0100
Message-ID: <CAJ3fcbAeB2v=n4Y0YTO++Zt3uHk2JMt=DsrxK2AWPmxk4-Y-KQ@mail.gmail.com>
Subject: Re: Predicates for 'like' and 'between' operators to custom storage handler.
From: Mich Talebzadeh <mich.talebzadeh@gmail.com>
To: user <user@hive.apache.org>
Cc: dev@hive.apache.org
Content-Type: multipart/alternative; boundary=94eb2c115e72a2f2c90532171714
archived-at: Thu, 05 May 2016 18:52:50 -0000

--94eb2c115e72a2f2c90532171714
Content-Type: text/plain; charset=UTF-8

On a normal query using sql in* Hive 2* LIKE predicate works fine. Case in
point in a 1 billion rows table with the column random_string of
varchar(50) I have one row that satisfies the followinh@

+-----------+------------------+------------------+-------------------+-----------------------------------------------------+-----------------+----------------+--+
| dummy.id  | dummy.clustered  | dummy.scattered  | dummy.randomised
|                 dummy.random_string                 | dummy.small_vc  |
dummy.padding  |
+-----------+------------------+------------------+-------------------+-----------------------------------------------------+-----------------+----------------+--+
| 1         | 0                | 0                | 63                |
rMLTDXxxqXOZnqYRJwInlGfGBTxNkAszBGEUGELqTSRnFjRGbi  |          1      |
xxxxxxxxxx     |
| 2         | 0                | 1                | 926               |
UEDJsfIgoYqwreSuuvjIcPZarpxMdCthpDCsgPlJfvIiylLiBS  |          2      |
xxxxxxxxxx     |

Now let us try to select that row with LIKE predicate:

0: jdbc:hive2://rhes564:10010/default> select count(1) from dummy where
random_string like 'rMLTDXxxqXOZnqYRJ%';

INFO  :
Query Hive on Spark job[0] stages:
INFO  : 0
INFO  : 1
INFO  :
Status: Running (Hive on Spark job[0])

INFO  : Completed executing
command(queryId=hduser_20160505125700_cbc415b6-91bb-4ed6-95e4-d177e12988f6);
Time taken: 153.544 seconds
INFO  : OK
+-----+--+
| c0  |
+-----+--+
| 1   |
+-----+--+
1 row selected (153.959 seconds)

So it does work

HTH


Dr Mich Talebzadeh


LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*


http://talebzadehmich.wordpress.com


On 5 May 2016 at 11:53, Amey Barve <ameybarve15@gmail.com> wrote:

> Hi All,
>
> I have implemented custom storage-handler and able to get predicates from
> hive for '=', '!=', '<', '<=', '>' and '>=' operators.
> But I cannot get predicates from hive for 'like', 'between' operators.
>
> Here's my code:
>
> *final String expression = conf.get(TableScanDesc.FILTER_EXPR_CONF_STR);*
>
> here expression remains null for like and between operators but not null
> for above operators.
>
> Does hive not give predicates for 'like' and 'between' operators to custom
> storage handler ?
> *Is there some other mechanism to get predicates for 'like' operator*?
>
> I tested with hive version 1.2 and 0.14.
>
> Thanks and Regards,
> Amey
>

--94eb2c115e72a2f2c90532171714--