Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 21966200B9E for ; Sat, 24 Sep 2016 08:05:34 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 20240160AD6; Sat, 24 Sep 2016 06:05:34 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id AB6C4160AD0 for ; Sat, 24 Sep 2016 08:05:32 +0200 (CEST) Received: (qmail 81402 invoked by uid 500); 24 Sep 2016 06:05:31 -0000 Mailing-List: contact users-help@asterixdb.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@asterixdb.apache.org Delivered-To: mailing list users@asterixdb.apache.org Received: (qmail 81392 invoked by uid 99); 24 Sep 2016 06:05:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 24 Sep 2016 06:05:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 2AB4B181061 for ; Sat, 24 Sep 2016 06:05:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.431 X-Spam-Level: * X-Spam-Status: No, score=1.431 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, HTML_OBFUSCATE_05_10=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, WEIRD_PORT=0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id 1iIwvRE-baRC for ; Sat, 24 Sep 2016 06:05:28 +0000 (UTC) Received: from mail-it0-f51.google.com (mail-it0-f51.google.com [209.85.214.51]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 7650E5F299 for ; Sat, 24 Sep 2016 06:05:27 +0000 (UTC) Received: by mail-it0-f51.google.com with SMTP id o3so33302298ita.1 for ; Fri, 23 Sep 2016 23:05:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=tVR+BqrKoHZ/XQAU3MNgCH7OqhD0pBsurkgmbu9k+BE=; b=AkP02bCcXeFdGE04igpZX0eBIRq1GJ64MHcQLl6N+/ntVoS1M+dKUtspNNCmI/0WpK UH1RYCGH2PfjIi9TcNKxTwpEHDTJjcEnyANmEgPniVe6OdA7A0Fjh4keJwCenQXYqEsn OFV97GAfb8i5ngIxkiEa/FfbPUvarxutszXHP/xjOM4Cv+61Nr7ip5IhlgSXf/hLlUfz y6DS7MBZCP/prs5345LJ7KNDVnukSa+OovUqK+ngrHLyawe/u4Q37y+2eugeRxpJ0lZr LxHEKoJEMqEZ/5VK0W8anG1kJlL8oLM2Ms4a7yykuBAyJvyMkYTXHVBf0mICFDE59hkk u8aA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=tVR+BqrKoHZ/XQAU3MNgCH7OqhD0pBsurkgmbu9k+BE=; b=IQUmlnINoxHtEoL4AOCmDIjI2nSUKMJJNJzUB5whj5JK3DqgaEGqLwrwpxL9pBwNYr XkLwcPqq+HARgNNF/xyOlM2rhceNJKOGeXM1hKBBREBHLSjuuAoQ3WU5tsRF9Vu1DsbQ yWpKSB3VtoEau8JBlxBDUurrEQU0PC4O9FoqvWtl3j2AWqN64Up3Z0komKdf4IRBF7Ec 9wZQPasL3LQwt2RILxMk6rXTTJWplT31WQ7y5dwEI2IPKNcSnVCvRZr3M6PnFLU/uw4H XGprzdSRTj/sGOrR3rgaJ5xbavkpRbvBFERXCrvsVJ0zDMDRvuIWyLYnAgDgzNjaN0wY WlUA== X-Gm-Message-State: AA6/9RnoxMRpI04B9NflHrqn5LklQsNpgRbdqPxSdwK11S818VTE1O9mHlXaVVbTC37hZ3Qf+cgxU4KwRahjXg== X-Received: by 10.36.92.20 with SMTP id q20mr7534791itb.10.1474697126115; Fri, 23 Sep 2016 23:05:26 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.197.130 with HTTP; Fri, 23 Sep 2016 23:04:45 -0700 (PDT) In-Reply-To: References: <0C66FE33-D980-4D91-9067-3EC4E7715E0D@apache.org> From: mingda li Date: Fri, 23 Sep 2016 23:04:45 -0700 Message-ID: Subject: Re: Using NCService to build AsterixDB on cluster To: users@asterixdb.apache.org, chillery@hillery.land Content-Type: multipart/alternative; boundary=001a114066645aa9ae053d3aaeca archived-at: Sat, 24 Sep 2016 06:05:34 -0000 --001a114066645aa9ae053d3aaeca Content-Type: text/plain; charset=UTF-8 En, I think that is the change for the cc.conf. We can show an example of setting a cc.conf for a cluster with multiple machines and each machine has one NCservice but not only the single machine with multiple NCservices. That's my advice. Mingda On Fri, Sep 23, 2016 at 9:03 PM, Chris Hillery wrote: > Excellent! What was the necessary change? We should update our doc. > > Ceej > aka Chris Hillery > > On Sep 23, 2016 7:44 PM, "mingda li" wrote: > >> Good news!!! >> Thanks Michael, Ian and Till. >> I talked with Ian and find the reason and solve it. >> It can work now with the cc.conf modified according to Michael's >> suggestion. >> When I open the http://cc:19002/admin/cluster, it returns >> {"State":"ACTIVE","Metadata_Node":"red4","partition_ >> 0":"red4","partition_1":"red3","partition_2":"red2","partition_3":"red"}. >> SO it can work for all the nodes! >> >> Thanks again:-) >> >> >> >> On Fri, Sep 23, 2016 at 6:51 PM, Till Westmann wrote: >> >>> Hi Mingda, >>> have you started the NCService processes manually on the cluster nodes? >>> Maybe you only have an NCService running on one node? >>> Cheers, >>> Till >>> On 23 Sep 2016, at 18:18, mingda li wrote: >>> >>> I have tried to modify the cc.conf to another form as following. But >>> when I run all NCs and the CC. It actually started only the nc/red and cc. >>> Has anyone met the problem before while using NCService to configure >>> AsterixDB? >>> >>> [nc4/red4] >>> >>> txnlogdir=/tmp/asterix/red4/txnlog >>> >>> coredumpdir=/tmp/asterix/red4/coredump >>> >>> iodevices=/tmp/asterix/red4 >>> >>> address=131.179.64.23 >>> >>> app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>> >>> storagedir=storage >>> >>> command=asterixnc >>> >>> [nc3/red3] >>> >>> txnlogdir=/tmp/asterix/red3/txnlog >>> >>> coredumpdir=/tmp/asterix/red3/coredump >>> >>> iodevices=/tmp/asterix/red3 >>> >>> address=131.179.64.22 >>> >>> app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>> >>> storagedir=storage >>> >>> command=asterixnc >>> >>> [nc2/red2] >>> >>> txnlogdir=/tmp/asterix/red2/txnlog >>> >>> coredumpdir=/tmp/asterix/red2/coredump >>> >>> iodevices=/tmp/asterix/red2 >>> >>> address=131.179.64.21 >>> >>> app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>> >>> storagedir=storage >>> >>> command=asterixnc >>> >>> [nc/red] >>> >>> txnlogdir=/tmp/asterix/red/txnlog >>> >>> coredumpdir=/tmp/asterix/red/coredump >>> >>> iodevices=/tmp/asterix/red >>> >>> address=131.179.64.20 >>> >>> >>> [nc] >>> >>> app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>> >>> storagedir=storage >>> >>> command=asterixnc >>> >>> >>> [cc] >>> >>> cluster.address = 131.179.64.20 >>> >>> http.port = 12345 >>> >>> On Fri, Sep 23, 2016 at 10:26 AM, mingda li >>> wrote: >>> >>>> Dear Blow, >>>> >>>> Thanks, I have tried to modify the cc.conf file according to your >>>> advice to the following. But when I open the http://masterNode:19002/ad >>>> min/cluster, I found that it returns {"State":"UNUSABLE","M >>>> etadata_Node":"red4","partition_3":"red"}. >>>> And the asterixDB on http://masterNode:19001 cannot work. Could you >>>> tell me if I have make another mistake? >>>> >>>> Thanks, >>>> Mingda >>>> >>>> *cc.conf:* >>>> >>>> *[nc/red4]* >>>> >>>> *txnlogdir=/tmp/asterix/red4/txnlog* >>>> >>>> *coredumpdir=/tmp/asterix/red4/coredump* >>>> >>>> *iodevices=/tmp/asterix/red4* >>>> >>>> *address=131.179.64.23* >>>> >>>> *[nc/red3]* >>>> >>>> *txnlogdir=/tmp/asterix/red3/txnlog* >>>> >>>> *coredumpdir=/tmp/asterix/red3/coredump* >>>> >>>> *iodevices=/tmp/asterix/red3* >>>> >>>> *address=131.179.64.22* >>>> >>>> *[nc/red2]* >>>> >>>> *txnlogdir=/tmp/asterix/red2/txnlog* >>>> >>>> *coredumpdir=/tmp/asterix/red2/coredump* >>>> >>>> *iodevices=/tmp/asterix/red2* >>>> >>>> *address=131.179.64.21* >>>> >>>> *[nc/red]* >>>> >>>> *txnlogdir=/tmp/asterix/red/txnlog* >>>> >>>> *coredumpdir=/tmp/asterix/red/coredump* >>>> >>>> *iodevices=/tmp/asterix/red* >>>> >>>> *address=131.179.64.20* >>>> >>>> >>>> *[nc]* >>>> >>>> *app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint* >>>> >>>> *storagedir=storage* >>>> >>>> *command=asterixnc* >>>> >>>> >>>> *[cc]* >>>> >>>> *cluster.address = 131.179.64.20* >>>> >>>> *http.port = 12345* >>>> >>>> >>>> On Thu, Sep 22, 2016 at 8:17 PM, Michael Blow >>>> wrote: >>>> >>>>> There is just nc and nc/ sections, you should not have nc1, nc2, >>>>> etc. also, each no must be unique name, you can not name them all 'red' >>>>> >>>>> Hope it helps, >>>>> >>>>> Thanks, >>>>> >>>>> -MDB >>>>> >>>>> On Thu, Sep 22, 2016 at 8:33 PM mingda li >>>>> wrote: >>>>> >>>>>> Dear all, >>>>>> >>>>>> These days, I am building the AsterixDB on cluster following the >>>>>> instruction here: >>>>>> https://ci.apache.org/projects/asterixdb/ncservice.html >>>>>> >>>>>> There are one master node with one nc and three cluster nodes with >>>>>> one nc each machine. The cc.conf is as following. And after I use >>>>>> $BASEDIR/bin/asterixncservice >red-service.log 2>&1 & to start three >>>>>> cluster nodes' AsterixDB and the master node's AsterixDB, I run $BASEDIR/bin/asterixcc >>>>>> -config-file cc.conf > cc.log 2>&1 & to start the CC. There is no >>>>>> error message and I can open the http://master:19001 and run aql. >>>>>> But when I open the http://master:19002/admin/cluster, there is only >>>>>> one nc here ({"State":"ACTIVE","Metadata_N >>>>>> ode":"red","partition_0":"red"}). I couldn't find the ncs on other >>>>>> machines. Does anyone know why? >>>>>> >>>>>> Thanks, >>>>>> Mingda >>>>>> >>>>>> cc.conf file is as following: >>>>>> [nc4/red] txnlogdir=/tmp/asterix/red/txnlog >>>>>> coredumpdir=/tmp/asterix/red/coredump iodevices=/tmp/asterix/red >>>>>> [nc4] app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>>>>> storagedir=storage address=131.179.64.23 command=asterixnc >>>>>> [nc3/red] txnlogdir=/tmp/asterix/red/txnlog >>>>>> coredumpdir=/tmp/asterix/red/coredump iodevices=/tmp/asterix/red >>>>>> [nc3] app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>>>>> storagedir=storage address=131.179.64.22 command=asterixnc >>>>>> [nc2/red] txnlogdir=/tmp/asterix/red/txnlog >>>>>> coredumpdir=/tmp/asterix/red/coredump iodevices=/tmp/asterix/red >>>>>> [nc2] app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>>>>> storagedir=storage address=131.179.64.21 command=asterixnc >>>>>> [nc/red] txnlogdir=/tmp/asterix/red/txnlog >>>>>> coredumpdir=/tmp/asterix/red/coredump iodevices=/tmp/asterix/red >>>>>> [nc] app.class=org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint >>>>>> storagedir=storage address=131.179.64.20 command=asterixnc >>>>>> [cc] cluster.address = 131.179.64.20 http.port = 12345 >>>>>> >>>>>> >>>>>> >>>> >>> >> --001a114066645aa9ae053d3aaeca Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
En, I think that is the change for the cc.conf. We can sho= w an example of setting a cc.conf for a cluster with multiple machines and = each machine has one NCservice but not only the single machine with multipl= e NCservices.=C2=A0
That's my advice.

Ming= da

On = Fri, Sep 23, 2016 at 9:03 PM, Chris Hillery <chillery@hillery.land> wrote:

Excel= lent! What was the necessary change? We should update our doc.

Ceej
aka Chris Hillery


On Sep 23, 2016 7= :44 PM, "mingda li" <limingda1993@gmail.com> wrote:
Good news!!!
=
Thanks Michael, Ian and Till.=C2=A0
I talked with Ian and find th= e reason and solve it.
It can work now with the cc.conf modified accord= ing to Michael's suggestion.
When I open the=C2=A0http://cc:19002/admin/clus= ter, it returns=C2=A0{"State":"ACTIVE","Metadata_Node&quo= t;:"red4","partition_0":"red4","par= tition_1":"red3","partition_2":"red2&quo= t;,"partition_3":"red"}.
SO it can work for all the no= des!

Thanks again:-)


<= /div>

On Fri= , Sep 23, 2016 at 6:51 PM, Till Westmann <tillw@apache.org> w= rote:
<= div dir=3D"auto">Hi Mingda,
have you started the NCService processes manually o= n the cluster nodes?
Maybe you only have an NCService running on one nod= e?
Cheers,
Till
On 23 Sep 2016, at 18:18, mingda li wrote:
I have tried to modify the cc.conf t= o another form as following. But when I run all NCs and the CC. It actually= started only the nc/red and cc.
Has anyone met the problem before whil= e using NCService to configure AsterixDB?

[nc4/red4]

txnlogdir=3D/tmp/asterix/red4/txnlog

coredumpdir=3D/tmp/asterix/red4/coredump

iodevices=3D/tmp/asterix/red4

address=3D131.179.64.23

app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplication<= wbr>EntryPoint

storagedir=3Dstorage

command=3Dasterixnc

[nc3/red3]

txnlogdir=3D/tmp/asterix/red3/txnlog

coredumpdir=3D/tmp/asterix/red3/coredump

iodevices=3D/tmp/asterix/red3

address=3D131.179.64.22

app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplication<= wbr>EntryPoint

storagedir=3Dstorage

command=3Dasterixnc

[nc2/red2]

txnlogdir=3D/tmp/asterix/red2/txnlog

coredumpdir=3D/tmp/asterix/red2/coredump

iodevices=3D/tmp/asterix/red2

address=3D131.179.64.21

app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplication<= wbr>EntryPoint

storagedir=3Dstorage

command=3Dasterixnc

[nc/red]

txnlogdir=3D/tmp/asterix/red/txnlog

coredumpdir=3D/tmp/asterix/red/coredump

iodevices=3D/tmp/asterix/red

address=3D131.179.64.20


[nc]

app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplication<= wbr>EntryPoint

storagedir=3Dstorage

command=3Dasterixnc


[cc]

cluster.address =3D 131.179.64.20

http.port =3D 12345


On Fri, Sep 23, 2016 at 1= 0:26 AM, mingda li <limingda1993@gmail.com> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px= #ccc solid;padding-left:1ex">
Dear Blow,

Thanks, I have tried to modify the cc.conf file according to your advice = to the following. But when I open the=C2=A0http://masterNode:19002/admin/clus= ter, I found that it returns=C2=A0{"State":"UNUSABLE","Metadat= a_Node":"red4","partition_3":"red"}= .
A= nd the asterixDB on =C2=A0http://masterNode:19001 cannot work. Could you tell me if I= have make another mistake?

Thanks,
Ming= da

cc.conf:

[nc/red4<= /span>]

txnlogdir=3D/tmp/asterix/red4/txnlog

coredumpdir=3D/tmp/asterix/red4/coredump

iodevices=3D/tmp/asterix/red4

address=3D131.179.64.23

[nc/red3]

txnlogdir=3D/tmp/asterix/red3/txnlog

coredumpdir=3D/tmp/asterix/red3/coredump

iodevices=3D/tmp/asterix/red3

address=3D131.179.64.22

[nc/red2]

txnlogdir=3D/tmp/asterix/red2/txnlog

coredumpdir=3D/tmp/asterix/red2/coredump

iodevices=3D/tmp/asterix/red2

address=3D131.179.64.21

[nc/red]

txnlogdir=3D/tmp/asterix/red/txnlog

coredumpdir=3D/tmp/asterix/red/coredump

iodevices=3D/tmp/asterix/red

address=3D131.179.64.20


[nc]

app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplicati= onEntryPoint

storagedir=3Dstorage

command=3Dasterixnc


[cc]

cluster.addres= s =3D 131.179.64.20

http.port =3D 12345



On Thu, Sep 22, 2016 at 8:17 PM, Michael Blow <mblow.apache@gmail.com> wrote:
There is just nc and nc/<node&= gt; sections, you should not have nc1, nc2, etc. also, each no must be uni= que name, you can not name them all 'red'

Hope it helps,
=
Thanks,

-MDB

On Thu, Sep 22, 2016 at 8:33 PM mingda li <limingda1993@gmail.com> w= rote:
Dear all,
These days, I am building the AsterixDB on cluster followi= ng the instruction here:

There are one = master node with one nc and three cluster nodes with one nc each machine. T= he cc.conf is as following. And after I use=C2=A0$BAS= EDIR/bin/asterixncservice >red-service.log 2>&1 & to sta= rt three cluster nodes' AsterixDB and the master node's AsterixDB, = =C2=A0 I run=C2=A0$BASEDIR/bin/asterixcc -conf= ig-file cc.conf > cc.log 2>&1 &=C2=A0to start the CC.= =C2=A0 There is no error message and I can open the=C2=A0http://master:19001 and run aql. But wh= en I open the=C2=A0http://master:19002/admin/cluster, there is only one nc he= re ({"Sta= te":"ACTIVE","Metadata_Node":"red",= "partition_0":"red"}). I couldn't find the ncs= on other machines. Does anyone know why?

Thanks,<= /span>
Mingda

cc.conf file is as following:
[nc4/red] txnlogdir=3D/tmp/asterix/red/txnlog coredumpdir=3D/tmp/asterix/red/coredump iodevices=3D/tmp/asterix/red=C2=A0
[nc4] app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplicationEnt= ryPoint storagedir=3Dstorage address=3D131.179.64.23 command=3Dasterixnc=C2=A0
[nc3/red] txnlogdir=3D/tmp/asterix/red/txnlog coredumpdir=3D/tmp/asterix/red/coredump iodevices=3D/tmp/asterix/red=C2=A0
[nc3] app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplicationEnt= ryPoint storagedir=3Dstorage address=3D131.179.64.22 command=3Dasterixnc=C2=A0
[nc2/red] txnlogdir=3D/tmp/asterix/red/txnlog coredumpdir=3D/tmp/asterix/red/coredump iodevices=3D/tmp/asterix/red=C2=A0
[nc2] app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplicationEnt= ryPoint storagedir=3Dstorage address=3D131.179.64.21 command=3Dasterixnc=C2=A0
[nc/red] txnlogdir=3D/tmp/asterix/red/txnlog coredumpdir=3D/tmp/asterix/red/coredump iodevices=3D/tmp/asterix/red=C2=A0
[nc] app.class=3Dorg.apache.asterix.hyracks.bootstrap.NCApplicationEnt= ryPoint storagedir=3Dstorage address=3D131.179.64.20 command=3Dasterixnc=C2=A0
[cc] cluster.address =3D 131.179.64.20 http.port =3D 12345






--001a114066645aa9ae053d3aaeca--