Mailing-List: contact users-help@asterixdb.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@asterixdb.incubator.apache.org
Subject: Re: AsterixDB - query status / system status
To: users@asterixdb.incubator.apache.org
References: 
 <CAM9x2uTBW1NyJE1nLMdV6bh8EpLzNhscPA2w_OiVUoLXN9nsVg@mail.gmail.com>
 <CAN_YF5zde1Y6ovq-7TFLOv1DjYn5TvQxte_S3Za-1LOX=w1UVA@mail.gmail.com>
 <CAM9x2uQSoJrcBb9BwaO0g4=zEtfVeE=6k8SDn=5+g_ahv+Z09A@mail.gmail.com>
 <37992.141.20.24.156.1445344846.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5zj6FPhDhEVaVc1+rJaxsPvY+1w37xyBLiEj8V+np8uyQ@mail.gmail.com>
 <55638.91.55.67.181.1445380319.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5z+hd=x7urFuODUZm7E2MTA_7PvTtfdSy4U_v1iOcaTXg@mail.gmail.com>
 <49153.84.159.203.170.1445860210.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5yZ3LXY1P3PEQRko4ckmD+Cfx=uUOfoO2DeOqMbDQi4zg@mail.gmail.com>
 <50647.84.159.203.170.1445876099.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5z7W4_eugzHjUw=LzucA3HzQ6roph3kzvZSOMjRAR-crQ@mail.gmail.com>
 <39838.79.245.167.242.1446049362.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5xumW2ebJQLQgRJ0iG8K7=Hzjv8mxdf8eGi=8+LfvNTiw@mail.gmail.com>
Cc: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>,
 Yingyi Bu <buyingyi@gmail.com>
From: Michael Carey <mjcarey@ics.uci.edu>
Message-ID: <5630FD6C.9010800@ics.uci.edu>
Date: Wed, 28 Oct 2015 09:53:00 -0700
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0)
 Gecko/20100101 Thunderbird/38.3.0
MIME-Version: 1.0
In-Reply-To: 
 <CAN_YF5xumW2ebJQLQgRJ0iG8K7=Hzjv8mxdf8eGi=8+LfvNTiw@mail.gmail.com>
Content-Type: multipart/alternative;
 boundary="------------050006000802030201060604"

This is a multi-part message in MIME format.
--------------050006000802030201060604
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Pouria indeed has a full set of TPC-H queries in AQL....
(Yingyi does too, I believe.)

On 10/28/15 9:49 AM, Ian Maxon wrote:
> Hi Max,
>
> Let me respond inline...
>> I am currently trying to rewrite some of the TPCH Queries to run them as
>> examples on AsterixDB. So far I was able to run some of the queries using
>> the web client, but others do not work yet. Unfortunatly sometimes I do
>> not get any error messages or results.
> I agree, the WebUI leaves something to be desired, especially for
> queries that take a long time.
> There is one minor amelioration to this however, that I find useful,
> the Hyracks admin console.
> It's on port 8888 on the CC at /adminconsole . It will show what jobs
> are running and which
> NCs are still registered with the CC.
>
> As for rewriting the TPC-H queries, I'm pretty sure we have these (but
> the ones in the tests folder aren't, they're toned-down versions). So
> maybe you don't have to rewrite anything, hopefully?
> @ Pouria, do you happen to have them handy?
>
> In general though, for more serious use, the HTTP api may be a better
> option, as it is more amenable to scripting.
>
>> As I cannot tell if the queries are still
>> running, or if an error occured that is just not displayed, is there a
>> possibility to monitor the state of the system/query execution?
> The adminconsole will show if there's a job still running, but not
> exceptional states that cause the job to hang.
> The exceptions should be in the CC log always. Where that is depends
> on your managix configuration (but it's always called cc.log).
>
> >From time to time the system even crashes and I cannot even shut it down
>> using managix stop.
> Yes, unfortunately 'managix stop' just goes through the list of NC's
> and requests 'kill' on the process, not 'kill' and then 'kill -9'. In
> the cases where an NC fails to exit politely, it has to be done by
> hand for managix.
>
> By the way, what environment are you running everything on? Is it a cluster?
>
> Thanks,
> -Ian
>
> On Wed, Oct 28, 2015 at 9:22 AM,  <schultze@informatik.hu-berlin.de> wrote:
>> Hello,
>>
>> by now I was able to successfully install AsterixDB from the latest master
>> branch which also made it possible for me to load external data files into
>> the system. Thanks a lot for the help!
>>
>> I am currently trying to rewrite some of the TPCH Queries to run them as
>> examples on AsterixDB. So far I was able to run some of the queries using
>> the web client, but others do not work yet. Unfortunatly sometimes I do
>> not get any error messages or results. On execution the output area of the
>> webclient turns blank as it usually does, but after some time I should get
>> the results shown (or an error). As I cannot tell if the queries are still
>> running, or if an error occured that is just not displayed, is there a
>> possibility to monitor the state of the system/query execution?
>>
>>  From time to time the system even crashes and I cannot even shut it down
>> using managix stop.
>>
>> Regards, Max
>>
>>
>>> Your assumption is correct, for the latest AsterixDB master we usually
>>> depend on the development version of Hyracks
>>> (https://github.com/apache/incubator-asterixdb-hyracks/). 'mvn install
>>> -DskipTests' with Hyracks should do the trick.
>>>
>>> Thanks,
>>> -Ian
>>>


--------------050006000802030201060604
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit

<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <font size="+1">Pouria indeed has a full set of TPC-H queries in
      AQL....<br>
      (Yingyi does too, I believe.)<br>
    </font><br>
    <div class="moz-cite-prefix">On 10/28/15 9:49 AM, Ian Maxon wrote:<br>
    </div>
    <blockquote
cite="mid:CAN_YF5xumW2ebJQLQgRJ0iG8K7=Hzjv8mxdf8eGi=8+LfvNTiw@mail.gmail.com"
      type="cite">
      <pre wrap="">Hi Max,

Let me respond inline...
</pre>
      <blockquote type="cite">
        <pre wrap="">I am currently trying to rewrite some of the TPCH Queries to run them as
examples on AsterixDB. So far I was able to run some of the queries using
the web client, but others do not work yet. Unfortunatly sometimes I do
not get any error messages or results.
</pre>
      </blockquote>
      <pre wrap="">
I agree, the WebUI leaves something to be desired, especially for
queries that take a long time.
There is one minor amelioration to this however, that I find useful,
the Hyracks admin console.
It's on port 8888 on the CC at /adminconsole . It will show what jobs
are running and which
NCs are still registered with the CC.

As for rewriting the TPC-H queries, I'm pretty sure we have these (but
the ones in the tests folder aren't, they're toned-down versions). So
maybe you don't have to rewrite anything, hopefully?
@ Pouria, do you happen to have them handy?

In general though, for more serious use, the HTTP api may be a better
option, as it is more amenable to scripting.

</pre>
      <blockquote type="cite">
        <pre wrap="">As I cannot tell if the queries are still
running, or if an error occured that is just not displayed, is there a
possibility to monitor the state of the system/query execution?
</pre>
      </blockquote>
      <pre wrap="">
The adminconsole will show if there's a job still running, but not
exceptional states that cause the job to hang.
The exceptions should be in the CC log always. Where that is depends
on your managix configuration (but it's always called cc.log).

&gt;From time to time the system even crashes and I cannot even shut it down
</pre>
      <blockquote type="cite">
        <pre wrap="">using managix stop.
</pre>
      </blockquote>
      <pre wrap="">
Yes, unfortunately 'managix stop' just goes through the list of NC's
and requests 'kill' on the process, not 'kill' and then 'kill -9'. In
the cases where an NC fails to exit politely, it has to be done by
hand for managix.

By the way, what environment are you running everything on? Is it a cluster?

Thanks,
-Ian

On Wed, Oct 28, 2015 at 9:22 AM,  <a class="moz-txt-link-rfc2396E" href="mailto:schultze@informatik.hu-berlin.de">&lt;schultze@informatik.hu-berlin.de&gt;</a> wrote:
</pre>
      <blockquote type="cite">
        <pre wrap="">Hello,

by now I was able to successfully install AsterixDB from the latest master
branch which also made it possible for me to load external data files into
the system. Thanks a lot for the help!

I am currently trying to rewrite some of the TPCH Queries to run them as
examples on AsterixDB. So far I was able to run some of the queries using
the web client, but others do not work yet. Unfortunatly sometimes I do
not get any error messages or results. On execution the output area of the
webclient turns blank as it usually does, but after some time I should get
the results shown (or an error). As I cannot tell if the queries are still
running, or if an error occured that is just not displayed, is there a
possibility to monitor the state of the system/query execution?

>From time to time the system even crashes and I cannot even shut it down
using managix stop.

Regards, Max


</pre>
        <blockquote type="cite">
          <pre wrap="">Your assumption is correct, for the latest AsterixDB master we usually
depend on the development version of Hyracks
(<a class="moz-txt-link-freetext" href="https://github.com/apache/incubator-asterixdb-hyracks/">https://github.com/apache/incubator-asterixdb-hyracks/</a>). 'mvn install
-DskipTests' with Hyracks should do the trick.

Thanks,
-Ian

</pre>
        </blockquote>
        <pre wrap="">
</pre>
      </blockquote>
    </blockquote>
    <br>
  </body>
</html>

--------------050006000802030201060604--