kylin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ShaoFeng Shi <shaofeng...@apache.org>
Subject Re: Problem starting Kylin Web interface
Date Tue, 06 Feb 2018 00:44:43 GMT
Hi Jean-Luc,

Kylin's metadata is persisted in HBase, the metadata table is
"kylin_metadata" by default, which is also configurable in
conf/kylin.properties with key kylin.metadata.url;
The HDFS path '/kylin/kylin_metadata' is for the cube and other files;
Before you build the first cube, the folder is empty I think.

If sample.sh couldn't create the /tmp/kylin folder on HDFS; If the folder
wasn't create, Kylin might not find the Hadoop config properly. You can run:

./bin/find-hadoop-conf-dir.sh -v


to see what it prints.





2018-02-05 23:24 GMT+08:00 BELLIER Jean-luc <jean-luc.bellier@rte-france.com
>:

> Hello,
>
>
>
> I am sorry to come back again to you, but I am really stuck. I restarted
> all the services and agents on my Cloudera cluster, so it is OK now.
>
> I noticed that some HDFS directories were empty, especially /tmp/kylin.
> When I have a look on the code of sample.sh, I can see that this script
> should create sthe subfolder /tmp/kylin/sample_cube/data. These data are
> used to create the Hive tables and are removed after the creation of these
> tables.  Let call the node N1
>
>
>
> I have another machine on which Kylin is installed and I succeeded in
> launching sample.sh. On this machine, I can see a HDFS folder called
> /kylin/kylin_metadata with, I presume, the metadata of the cube stored in
> it.
>
>
>
> I cannot succeed in creating this folder on N1. I removed the /tmp/kylin
> folder, the hbase table and the Hive tables.
>
> I really do not know what to do to restart the creation of the project
> from scratch.
>
> I also checked the HDFS space using the command ‘hdfs dfs –df’ and it
> tells me a usage of 2%.
>
>
>
> Could you please guide me in how to achieve it. There may be something I
> did wrong, but I really do not what. Is my way of doing correct ? Are
> there  other files to remove (temporary files, for example), and in this
> case, where are they located ?
>
>
>
> Any help would be greatly appreciated.
>
>
>
> Thank you in advance for your help. Have a good day.
>
>
>
> Best regards,
>
> Jean-Luc.
>
>
>
> *De :* BELLIER Jean-luc
> *Envoyé :* vendredi 2 février 2018 18:54
> *À :* user <user@kylin.apache.org>
> *Objet :* RE: Problem starting Kylin Web interface
>
>
>
> Hello,
>
>
>
> Thanks for the suggestion. I tried on another machine with Firefox and
> Chrome, but I get the same result as before. I also rebuilt the project
> ‘sample’ from scratch, with no change.
>
> My cluster seems to have problems on its nodes, especially memory which is
> nearly full on most nodes.
>
> I suspect this could be one of the cause of the problem : no available
> memory and swap space also nearly full.
>
>
>
> What do you think of this assumption ?
>
>
>
> I will see that with my Cloudera manager next week, as I am not a
> specialist at all.
>
>
>
> Have a good week-end.
>
>
>
> Best regards,
>
> Jean-Luc.
>
>
>
>
>
> *De :* ShaoFeng Shi [mailto:shaofengshi@apache.org
> <shaofengshi@apache.org>]
> *Envoyé :* vendredi 2 février 2018 14:59
>
> *À :* user <user@kylin.apache.org>
> *Objet :* Re: Problem starting Kylin Web interface
>
>
>
> Please try Chrome; Most developers are using Chrome; And if there is an
> error, you can press F12 to check the HTTP request/response, there should
> be more information.
>
>
>
> 2018-02-02 21:54 GMT+08:00 BELLIER Jean-luc <jean-luc.bellier@rte-france.
> com>:
>
> Hello again,
>
>
>
> I forgot to mention that I use IE or Secured Firefox as Web browsers. I
> have the same issue with both. Could there be the cause of the problem ?
>
>
>
> Best regards
>
> Jean-Luc.
>
>
>
> *De :* BELLIER Jean-luc
> *Envoyé :* vendredi 2 février 2018 14:48
> *À :* user <user@kylin.apache.org>
> *Objet :* RE: Problem starting Kylin Web interface
>
>
>
> Hello
>
>
>
> Thank you for your answer.
>
> I did the following :
>
> ·         rename my current kylin.log and kylin.out files to keep a trace
>
> ·         restarted the commands ‘kylin.sh start’ and ‘sample.sh’
>
> I cannot see anything special in the new .log or .out files. The Hive
> tables exist, and the kylin_metadata also. I can scan it through Hbase
> shell command. It gives me 44  rows.
>
>
>
> However, the problem is still the same with the Kylin Interface : Models
> loading indefinitely, no table displayed, and nothing in the ‘System’
> section. When I try to refresh the server config and the server
> environement, I still have the message ‘Oops ! Failed to take action. I
> also have this message as soon as I click to the ‘System’ button.
>
>
>
> Should I rebuild the project from scratch to be sure that everything is
> correctly created, or should I investigate somewhere else (services, node
> states, …) ?
>
>
>
> I send in attachement the now kylin.log and kylin.out files
>
> Thank you in advance for your help. Have a good day.
>
>
>
> Best regards,
>
> Jean-Luc.
>
>
>
> *De :* ShaoFeng Shi [mailto:shaofengshi@apache.org
> <shaofengshi@apache.org>]
> *Envoyé :* vendredi 2 février 2018 12:06
> *À :* user <user@kylin.apache.org>
> *Objet :* Re: Problem starting Kylin Web interface
>
>
>
> Hi Jean-luc,
>
>
>
> The kylin.log seems okay, the service is started and the job scheduler is
> running up.
>
>
>
> The kylin.out has some error about missing ".keystore", but by default if
> you accessing kylin via http, it shouldn't need to load keystore. Please
> try visit http://host:7070/kylin again to see whether there is any issue
> in the web console.
>
>
>
> 2018-02-01 23:17 GMT+08:00 BELLIER Jean-luc <jean-luc.bellier@rte-france.
> com>:
>
> Hello,
>
>
>
> I am new in Kylin. I would like to test it for a POC for my company. I
> opened a ticket yesterday in the issues mail box through Jira, but I am not
> sure it is the best place.
>
> Here is the reference of the ticket : https://issues.apache.org/
> jira/browse/KYLIN-3218
>
>
>
> I am using  the version apache-kylin-2.2.0-bin-cdh57, with Linux. I
> installed the software on a client node. I successfully started the process
> and created the cube given in the example project.
>
> Apparently, no mistake appears when starting the kylin.sh shell or
> generating the cube using sample.sh.
>
>
>
> When I launch the web interface using <nodename>:7070/kylin, I cannot load
> the models (the cursor is turning indefinitely).
>
> By looking at the kylin.out log, I could see that the process could not
> find the $KYLIN_HOME/tomcat/conf/.keystore file. So I created it
> manually, and relaunched the cube generation and the ‘kylin.sh start’
> command.
>
> Now I face to other mistakes :
>
>
>
> ·         *Exception in thread "Thread-14" java.lang.RuntimeException:
> Error while peeking at
> /kylin/kylin_metadata/job_engine/global_job_engine_lock*
>
> ·         *SEVERE: The web application [/kylin] appears to have started a
> thread named [TGT Renewer for bellierjlu@HADES.RTE-FRANCE.COM
> <bellierjlu@HADES.RTE-FRANCE.COM>] but has failed to stop it. This is very
> likely to create a memory leak.* This one appears several times
>
> ·         *SEVERE: The web application [/kylin] created a ThreadLocal
> with key of type [java.lang.ThreadLocal] (value
> [java.lang.ThreadLocal@10cb8259]) and a value of type
> [org.apache.kylin.rest.msg.Message] (value
> [org.apache.kylin.rest.msg.Message@267ae210]) but failed to remove it when
> the web application was stopped. Threads are going to be renewed over time
> to try and avoid a probable memory leak. *This one appears several times
>
>
>
> Apparently, something else is missing, or I did something wrong, but I do
> not know what. I would also like to know what will be the impact of the two
> ‘SEVERE’ issues above and how I could correct it.
>
>
>
> I attach the last version of kylin.out file. Any help would be kindly
> appreciated.
>
>
>
> Thank you in advance for your help. Have a good day.
>
>
>
> Best regards.
>
> Jean-Luc.
>
>
>
>
>
> "Ce message est destiné exclusivement aux personnes ou entités auxquelles
> il est adressé et peut contenir des informations privilégiées ou
> confidentielles. Si vous avez reçu ce document par erreur, merci de nous
> l'indiquer par retour, de ne pas le transmettre et de procéder à sa
> destruction.
>
> This message is solely intended for the use of the individual or entity to
> which it is addressed and may contain information that is privileged or
> confidential. If you have received this communication by error, please
> notify us immediately by electronic mail, do not disclose it and delete the
> original message."
>
>
>
>
>
> --
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
>
>
>
>
> "Ce message est destiné exclusivement aux personnes ou entités auxquelles
> il est adressé et peut contenir des informations privilégiées ou
> confidentielles. Si vous avez reçu ce document par erreur, merci de nous
> l'indiquer par retour, de ne pas le transmettre et de procéder à sa
> destruction.
>
> This message is solely intended for the use of the individual or entity to
> which it is addressed and may contain information that is privileged or
> confidential. If you have received this communication by error, please
> notify us immediately by electronic mail, do not disclose it and delete the
> original message."
>
>
>
>
>
> --
>
> Best regards,
>
>
>
> Shaofeng Shi 史少锋
>
>
>
>
> "Ce message est destiné exclusivement aux personnes ou entités auxquelles
> il est adressé et peut contenir des informations privilégiées ou
> confidentielles. Si vous avez reçu ce document par erreur, merci de nous
> l'indiquer par retour, de ne pas le transmettre et de procéder à sa
> destruction.
>
> This message is solely intended for the use of the individual or entity to
> which it is addressed and may contain information that is privileged or
> confidential. If you have received this communication by error, please
> notify us immediately by electronic mail, do not disclose it and delete the
> original message."
>



-- 
Best regards,

Shaofeng Shi 史少锋

Mime
View raw message