predictionio-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bala vivek <>
Subject Re: Hbase issue
Date Fri, 13 Apr 2018 09:50:26 GMT
Hi Donald,

Yes, I'm running on the single machine. PIO, hbase , elasticsearch, spark
everything works on the same server. Let me know which file I need to
remove because I have client data present in PIO.

I have tried adding the entries in hbase-site.xml using the following link,
after which I can see the Hmaster seems active but still, the error remains
the same.

Hbase Error logs :- ( I have commented the server name)

2018-04-13 04:31:28,246 INFO
[RS:0;VD500042:49584-SendThread(localhost:2182)] zookeeper.ClientCnxn:
Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2182. Will
not attempt to authenticate using SASL (unknown error)
2018-04-13 04:31:28,247 WARN
[RS:0;XXXXXX:49584-SendThread(localhost:2182)] zookeeper.ClientCnxn:
Session 0x162be5554b90003 for server null, unexpected error, closing socket
connection and attempting reconnect Connection refused
        at Method)
2018-04-13 04:31:28,553 ERROR [main] master.HMasterCommandLine: Master
java.lang.RuntimeException: Master not initialized after 200000ms seconds
        at org.apache.hadoop.hbase.master.HMaster.main(

I have tried multiple time pio-stop-all and pio-start-all but no luck the
service is not up.
If I install the hbase alone in the existing setup let me know what things
I should consider. If anyone faced this issue please provide me the
solution steps.

On Thu, Apr 12, 2018 at 9:13 PM, Donald Szeto <> wrote:

> Hi Bala,
> Are you running a single-machine HBase setup? The ZooKeeper embedded in
> such a setup is pretty fragile to disk space issue and your ZNode might
> have corrupted.
> If that’s indeed your setup, please take a look at HBase log files,
> specifically on messages from ZooKeeper. In this situation, one way to
> recover is to remove ZooKeeper files and let HBase recreate them, assuming
> from your log output that you don’t have other services depend on the same
> ZK.
> Regards,
> Donald
> On Thu, Apr 12, 2018 at 5:34 AM bala vivek <>
> wrote:
>> Hi,
>> I use PIO 0.10.0 version and hbase 1.2.4. The setup was working fine till
>> today morning. I saw PIO was down as the mount space issue was present on
>> the server and cleared the unwanted files.
>> After doing a pio-stop-all and pio-start-all the HMaster service is not
>> working. I tried multiple times the pio restart.
>> I can see whenever I do a pio-stop-all and check the service using jps,
>> the Hmaster seems running. Similarly I tried to run the ./
>> script but still pio status is not showing as success.
>> pio error log :
>> [INFO] [Console$] Inspecting PredictionIO...
>> [INFO] [Console$] PredictionIO 0.10.0-incubating is installed at
>> /opt/tools/PredictionIO-0.10.0-incubating
>> [INFO] [Console$] Inspecting Apache Spark...
>> [INFO] [Console$] Apache Spark is installed at
>> /opt/tools/PredictionIO-0.10.0-incubating/vendors/spark-1.
>> 6.3-bin-hadoop2.6
>> [INFO] [Console$] Apache Spark 1.6.3 detected (meets minimum requirement
>> of 1.3.0)
>> [INFO] [Console$] Inspecting storage backend connections...
>> [INFO] [Storage$] Verifying Meta Data Backend (Source: ELASTICSEARCH)...
>> [INFO] [Storage$] Verifying Model Data Backend (Source: LOCALFS)...
>> [INFO] [Storage$] Verifying Event Data Backend (Source: HBASE)...
>> [ERROR] [RecoverableZooKeeper] ZooKeeper exists failed after 1 attempts
>> [ERROR] [ZooKeeperWatcher] hconnection-0x7c891ba7, quorum=localhost:2181,
>> baseZNode=/hbase Received unexpected KeeperException, re-throwing exception
>> [WARN] [ZooKeeperRegistry] Can't retrieve clusterId from Zookeeper
>> [ERROR] [StorageClient] Cannot connect to ZooKeeper (ZooKeeper ensemble:
>> localhost). Please make sure that the configuration is pointing at the
>> correct ZooKeeper ensemble. By default, HBase manages its own ZooKeeper, so
>> if you have not configured HBase to use an external ZooKeeper, that means
>> your HBase is not started or configured properly.
>> [ERROR] [Storage$] Error initializing storage client for source HBASE
>> [ERROR] [Console$] Unable to connect to all storage backends
>> successfully. The following shows the error message from the storage
>> backend.
>> [ERROR] [Console$] Data source HBASE was not properly initialized.
>> (
>> [ERROR] [Console$] Dumping configuration of initialized storage backend
>> sources. Please make sure they are correct.
>> [ERROR] [Console$] Source Name: ELASTICSEARCH; Type: elasticsearch;
>> Configuration: TYPE -> elasticsearch, HOME -> /opt/tools/PredictionIO-0.10.
>> 0-incubating/vendors/elasticsearch-1.7.3
>> [ERROR] [Console$] Source Name: LOCALFS; Type: localfs; Configuration:
>> PATH -> /root/.pio_store/models, TYPE -> localfs
>> [ERROR] [Console$] Source Name: HBASE; Type: (error); Configuration:
>> (error)
>> Regards,
>> Bala

View raw message