Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
MIME-Version: 1.0
Date: Mon, 1 Jun 2015 11:10:35 -0700
Message-ID: 
 <CAPAKhHM8RR0W28D8_Gudg8xgjdLbNGf6vCivmoU2NfGx+FOmXQ@mail.gmail.com>
Subject: PhoenixIOException resolved only after compaction, is there a way to
 avoid it?
From: Siva <sbhavanari@gmail.com>
To: dev <dev@phoenix.apache.org>, user@phoenix.apache.org,
	hbase-dev <dev@hbase.apache.org>,
 "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=001a1142cad00f0055051778be93

--001a1142cad00f0055051778be93
Content-Type: text/plain; charset=UTF-8

Hi Everyone,

We load the data to Hbase tables through BulkImports.

If the data set is small, we can query the imported data from phoenix with
no issues.

If data size is huge (with respect to our cluster, we have very small
cluster), I m encountering the following error
(org.apache.phoenix.exception.PhoenixIOException).

0: jdbc:phoenix:172.31.45.176:2181:/hbase> select    count(*)
. . . . . . . . . . . . . . . . . . . . .>    from  "ldll_compression"
 ldll join "ds_compression"  ds on (ds."statusid" = ldll."statusid")
. . . . . . . . . . . . . . . . . . . . .>    where ldll."logdate"  >=
'2015-02-04'
. . . . . . . . . . . . . . . . . . . . .>    and  ldll."logdate"  <=
'2015-02-06'
. . . . . . . . . . . . . . . . . . . . .>    and ldll."dbname" =
'lmguaranteedrate';
+------------------------------------------+
|                 COUNT(1)                 |
+------------------------------------------+
java.lang.RuntimeException:
org.apache.phoenix.exception.PhoenixIOException:
org.apache.phoenix.exception.PhoenixIOException: Failed after attempts=36,
exceptions:
Mon Jun 01 13:50:57 EDT 2015, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=62358: row '' on table 'ldll_compression'
at
region=ldll_compression,,1432851434288.1a8b511def7d0c9e69a5491c6330d715.,
hostname=ip-172-31-32-181.us-west-2.compute.internal,60020,1432768597149,
seqNum=16566

        at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2440)
        at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2074)
        at sqlline.SqlLine.print(SqlLine.java:1735)
        at sqlline.SqlLine$Commands.execute(SqlLine.java:3683)
        at sqlline.SqlLine$Commands.sql(SqlLine.java:3584)
        at sqlline.SqlLine.dispatch(SqlLine.java:821)
        at sqlline.SqlLine.begin(SqlLine.java:699)
        at sqlline.SqlLine.mainWithInputRedirection(SqlLine.java:441)
        at sqlline.SqlLine.main(SqlLine.java:424)

I did the major compaction for "ldll_compression" through Hbase
shell(major_compact 'ldll_compression'). Same query ran successfully after
the compaction.

0: jdbc:phoenix:172.31.45.176:2181:/hbase> select    count(*)
. . . . . . . . . . . . . . . . . . . . .>    from  "ldll_compression"
 ldll join "ds_compression"  ds on (ds."statusid" = ldll."statusid")
. . . . . . . . . . . . . . . . . . . . .>    where ldll."logdate"  >=
'2015-02-04'
. . . . . . . . . . . . . . . . . . . . .>    and  ldll."logdate"  <=
'2015-02-06'
. . . . . . . . . . . . . . . . . . . . .>    and ldll."dbname" =
'lmguaranteedrate'
. . . . . . . . . . . . . . . . . . . . .> ;
+------------------------------------------+
|                 COUNT(1)                 |
+------------------------------------------+
| 13480                                    |
+------------------------------------------+
1 row selected (72.36 seconds)

Did anyone face the similar issue? Is IO exception is because of Phoenix
not able to read from multiple regions since error was resolved after the
compaction? or Any other thoughts?

Thanks,
Siva.

--001a1142cad00f0055051778be93--