hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jeff saremi <jeffsar...@hotmail.com>
Subject Re: How to get useful info from Client exceptions
Date Tue, 23 May 2017 23:07:56 GMT
Thansk Ted
We might have a stale hbase-site.xml deployed along the code which runs on Spark.

however what we set is the Zookeeper quorum for the right cluster.

I was told that the third Batch starts to throw errors like these and the first two are fine.
But then again I'm not running this myself

We're going to increase the log level to DEBUG to see if we see anything.

________________________________
From: Ted Yu <yuzhihong@gmail.com>
Sent: Tuesday, May 23, 2017 3:49:27 PM
To: user@hbase.apache.org
Subject: Re: How to get useful info from Client exceptions

The exception is composed this way (see AsyncProcess):

      return new RetriesExhaustedWithDetailsException(new
ArrayList<Throwable>(throwables),
          new ArrayList<Row>(actions), new ArrayList<String>(addresses));

In your case there were 10456 UnknownHostException's.

Was there any other clue in client side log ?
I think one improvement we can do is selectively logging which host(s) was
involved in the UnknownHostException's.

BTW was hbase-site.xml on the classpath of your client ?

On Tue, May 23, 2017 at 3:28 PM, jeff saremi <jeffsaremi@hotmail.com> wrote:

> We get errors like below which are not helping at all.
>
> For instance in this case we have no clue what server/region it is talking
> about
>
> Is there a setting we missed or somehow we could augment this information
> to help us? We're using hbase 1.2.5
>
>
> Failed 10456 actions: UnknownHostException: 10456 times,
> Stack Trace: org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException:
> Failed 10456 actions: UnknownHostException: 10456 times,
>         at org.apache.hadoop.hbase.client.AsyncProcess$
> BatchErrors.makeException(AsyncProcess.java:258)
>         at org.apache.hadoop.hbase.client.AsyncProcess$
> BatchErrors.access$2000(AsyncProcess.java:238)
>         at org.apache.hadoop.hbase.client.AsyncProcess.
> waitForAllPreviousOpsAndReset(AsyncProcess.java:1817)
>         at org.apache.hadoop.hbase.client.BufferedMutatorImpl.
> backgroundFlushCommits(BufferedMutatorImpl.java:240)
>         at org.apache.hadoop.hbase.client.BufferedMutatorImpl.
> mutate(BufferedMutatorImpl.java:146)
>         at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1028)
>
> thanks
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message