bigtop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steven Núñez <steven.nu...@illation.com>
Subject Re: Getting Started Guide? (and some installation issues)
Date Wed, 20 Nov 2013 23:44:29 GMT
Hi Ivo,

I’m also working, to start with, on a pseudo distributed node. I’ve got a CentOS 6.x Amazon
EC2 instance and using FreeNX for the remote desktop. So far there seems to be several services
that aren’t started after the BigTop install. Here’s the output of ‘service —status-all'

Flume NG agent is running                                  [  OK  ]
Hadoop datanode is running                                 [  OK  ]
Hadoop journalnode is running                              [  OK  ]
Hadoop namenode is running                                 [  OK  ]
Hadoop secondarynamenode is running                        [  OK  ]
Hadoop zkfc is dead and pid file exists                    [FAILED]
Hadoop httpfs is running                                   [  OK  ]
Hadoop historyserver is dead and pid file exists           [FAILED]
Hadoop nodemanager is dead and pid file exists             [FAILED]
Hadoop proxyserver is dead and pid file exists             [FAILED]
Hadoop resourcemanager is running                          [  OK  ]
hald (pid  1031) is running...
HBase master daemon is dead and pid file exists            [FAILED]
hbase-regionserver is not running.
HBase rest daemon is running                               [  OK  ]
HBase thrift daemon is running                             [  OK  ]
HCatalog server is running                                 [  OK  ]
Hive Metastore is dead and pid file exists                 [FAILED]
Hive Server is running                                     [  OK  ]
Hive Server2 is dead and pid file exists                   [FAILED]
WEBHCat server is running                                  [  OK  ]
…
Spark master is not running                                [FAILED]
Spark worker is not running                                [FAILED]
spice-vdagentd is stopped
Sqoop Server is running                                    [  OK  ]

Am I correct in assuming that all of these services should be working properly after a BigTop
install? As far as the individual components go, I’ve been working through the Running various
Bigtop components<https://cwiki.apache.org/confluence/display/BIGTOP/Running+various+Bigtop+components>
wiki page. Pig and HBase are working so far, but Hive fails:

hive> create table doh(id int);
FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask

This is after changing permissions to be world writable on:

  *   /tmp
  *   /user/hive/warehouse (actually, BigTop set that permission correctly)
  *   /var/lib/hive/metastore/metastore_db/ (CentOS filesystem)

Any ideas? I notice that Hive Server 2 'is dead and pid file exists’; looks like a good
place to start.


Regards,
- Steve


--
Illation Pty Ltd
8/350 Collins Street
Melbourne 3000

T:   +61 3 8399 9442 x100
M: +61 4 0096 4240


From: ivaylo frankov <i.frankov@googlemail.com<mailto:i.frankov@googlemail.com>>
Reply-To: "user@bigtop.apache.org<mailto:user@bigtop.apache.org>" <user@bigtop.apache.org<mailto:user@bigtop.apache.org>>
Date: Thursday, 21 November 2013 3:04
To: "user@bigtop.apache.org<mailto:user@bigtop.apache.org>" <user@bigtop.apache.org<mailto:user@bigtop.apache.org>>
Subject: Re: Getting Started Guide? (and some installation issues)

Hi Steve,

Can you send me your private email and I will be able to send you my configuration up to now.

HBase , partly Hive , partly Pig (not much but still something ;))
I think that experienced specialist needs some hours to configure bigtop (at max) Newbee like
me needs some days at least ;).
I want to start pseudo distributed node with hbase pig giraph solr mahout and hue. Flume is
also interesting.
What is your desire ?

Best regards,
Ivo
P.S: if you want spark be very carefully by installing it : You have to give repository or
you may be receive some Spark language at least that was the case in ubuntu.

Am Mittwoch, 20. November 2013 schrieb i.frankov :
Hi Stive,
I am not at home
I will send you my status tonight

Cheers,
Ivo


Von Samsung Mobile gesendet

Mime
View raw message