Mailing-List: contact users-help@asterixdb.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@asterixdb.incubator.apache.org
MIME-Version: 1.0
In-Reply-To: 
 <50647.84.159.203.170.1445876099.squirrel@www2.informatik.hu-berlin.de>
References: 
 <CAM9x2uTBW1NyJE1nLMdV6bh8EpLzNhscPA2w_OiVUoLXN9nsVg@mail.gmail.com>
 <CAN_YF5zde1Y6ovq-7TFLOv1DjYn5TvQxte_S3Za-1LOX=w1UVA@mail.gmail.com>
 <CAM9x2uQSoJrcBb9BwaO0g4=zEtfVeE=6k8SDn=5+g_ahv+Z09A@mail.gmail.com>
 <37992.141.20.24.156.1445344846.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5zj6FPhDhEVaVc1+rJaxsPvY+1w37xyBLiEj8V+np8uyQ@mail.gmail.com>
 <55638.91.55.67.181.1445380319.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5z+hd=x7urFuODUZm7E2MTA_7PvTtfdSy4U_v1iOcaTXg@mail.gmail.com>
 <49153.84.159.203.170.1445860210.squirrel@www2.informatik.hu-berlin.de>
 <CAN_YF5yZ3LXY1P3PEQRko4ckmD+Cfx=uUOfoO2DeOqMbDQi4zg@mail.gmail.com>
 <50647.84.159.203.170.1445876099.squirrel@www2.informatik.hu-berlin.de>
From: Ian Maxon <imaxon@uci.edu>
Date: Mon, 26 Oct 2015 09:39:08 -0700
Message-ID: 
 <CAN_YF5z7W4_eugzHjUw=LzucA3HzQ6roph3kzvZSOMjRAR-crQ@mail.gmail.com>
Subject: Re: AsterixDB build error
To: users@asterixdb.incubator.apache.org
Content-Type: text/plain; charset=UTF-8

Your assumption is correct, for the latest AsterixDB master we usually
depend on the development version of Hyracks
(https://github.com/apache/incubator-asterixdb-hyracks/). 'mvn install
-DskipTests' with Hyracks should do the trick.

Thanks,
-Ian

On Mon, Oct 26, 2015 at 9:14 AM,  <schultze@informatik.hu-berlin.de> wrote:
> Hi Ian,
>
> thanks for the help. I cloned from the google code repository, as it was
> mentioned on the download page http://asterixdb.ics.uci.edu/
>
> Unfortunatly even cloning from the repository you mentioned I got another
> error running 'mvn clean install -DskipTests'
>
> [INFO] asterix ............................................ SUCCESS [
> 7.197 s]
> [INFO] asterix-test-framework ............................. SUCCESS [
> 2.280 s]
> [INFO] asterix-common ..................................... FAILURE [
> 5.876 s]
>
> ...
>
> [ERROR] Failed to execute goal on project asterix-common: Could not
> resolve dependencies for project
> org.apache.asterix:asterix-common:jar:0.8.8-SNAPSHOT: The following
> artifacts could not be resolved:
> org.apache.hyracks:algebricks-compiler:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-dataflow-std:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-storage-am-lsm-common:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-storage-am-common:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-api:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-storage-am-lsm-btree:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-storage-am-lsm-invertedindex:jar:0.2.17-SNAPSHOT,
> org.apache.hyracks:hyracks-storage-am-lsm-rtree:jar:0.2.17-SNAPSHOT: Could
> not find artifact
> org.apache.hyracks:algebricks-compiler:jar:0.2.17-SNAPSHOT in
> asterix-public
> (http://obelix.ics.uci.edu/nexus/content/groups/asterix-public/) -> [Help
> 1]
>
> Is my assumption correct, that I have to download and build hyracks first?
> If so, where can I do that from?
>
> Regards, Max
>
>
>> Hi Max,
>> Two things:
>> 1) The google code repository is really old and deprecated, so I
>> wouldn't clone from there. It's read only now and hasn't been updated
>> in months. https://github.com/apache/incubator-asterixdb is a mirror
>> of the official ASF repo now.
>>
>> 2) 'mvn clean install -DskipTests' should work. 'mvn clean compile'
>> won't work because it doesn't install the plugin mentioned in the
>> error even though it was built just before the error happened.
>>
>> Thanks,
>> -Ian
>>
>> On Mon, Oct 26, 2015 at 4:50 AM,  <schultze@informatik.hu-berlin.de>
>> wrote:
>>> Hello,
>>>
>>> as you suggested I tried to install AsterixDB using the latest master
>>> version as I beforehand only used the official download packages from
>>> the
>>> website. I copied the git repository using
>>>
>>> git clone https://code.google.com/p/asterixdb/
>>>
>>> and afterwards tried to compile the code using
>>>
>>> mvn clean compile
>>>
>>> which threw the following error
>>>
>>> [INFO] asterix ............................................ SUCCESS [
>>> 0.170 s]
>>> [INFO] asterix-test-framework ............................. SUCCESS [
>>> 10.347 s]
>>> [INFO] asterix-common ..................................... SUCCESS
>>> [01:47
>>> min]
>>> [INFO] asterix-maven-plugins .............................. SUCCESS [
>>> 0.002 s]
>>> [INFO] record-manager-generator-maven-plugin .............. SUCCESS [
>>> 1.736 s]
>>> [INFO] asterix-transactions ............................... FAILURE [
>>> 0.003 s]
>>>
>>> ...
>>>
>>> [ERROR] Failed to parse plugin descriptor for
>>> edu.uci.ics.asterix:record-manager-generator-maven-plugin:0.8.7-SNAPSHOT
>>> (/home/mcs1408/git/asterixdb/asterix-maven-plugins/record-manager-generator-maven-plugin/target/classes):
>>> No plugin descriptor found at META-INF/maven/plugin.xml -> [Help 1]
>>>
>>> can I fix this somehow?
>>>
>>> Regards, Max
>>>
>>>
>>>> No problem :) I would definitely try the latest master version then.
>>>> Asterix 0.8.6 uses Hadoop 0.20.2, which is really ancient. You will
>>>> probably be best off checking out from source and changing the Hadoop
>>>> dependency in the top-level Asterix pom to 2.6.0. from 2.2.0.
>>>>
>>>> On Tue, Oct 20, 2015 at 3:31 PM,  <schultze@informatik.hu-berlin.de>
>>>> wrote:
>>>>> I am using AsterixDB 0.8.6 and Hadoop 2.6.0.
>>>>>
>>>>> Thanks for the help,
>>>>> Max
>>>>>
>>>>>
>>>>>> Hi Max,
>>>>>> Which version of AsterixDB are you running? The old stable release
>>>>>> uses a really old version of Hadoop dependencies, so that might be
>>>>>> it.
>>>>>> What's the version your HDFS cluster has? The latest master is using
>>>>>> 2.2.0 by default, but 2.4.0 or 2.6.0 should work as well.
>>>>>>
>>>>>> Thanks,
>>>>>> -Ian
>>>>>>
>>>>>> On Tue, Oct 20, 2015 at 5:40 AM,  <schultze@informatik.hu-berlin.de>
>>>>>> wrote:
>>>>>>> Hello,
>>>>>>>
>>>>>>> I have done a cluster setup of AsterixDB on four nodes. Everyhing is
>>>>>>> running fine and I want to load some data into the system to run sum
>>>>>>> bigger examples. However I am unable to do so using the description
>>>>>>> at
>>>>>>>
>>>>>>> https://asterixdb.ics.uci.edu/documentation/aql/externaldata.html
>>>>>>>
>>>>>>> I created a dataverse, a datatype and a dataset as follows:
>>>>>>>
>>>>>>> create dataverse tpch;
>>>>>>>
>>>>>>> use dataverse tpch
>>>>>>> create type LineitemType as closed {
>>>>>>>       orderkey:int32,
>>>>>>>       partkey: int32,
>>>>>>>       suppkey: int32,
>>>>>>>       linenumber: int32,
>>>>>>>       quantity: double,
>>>>>>>       extendedprice: double,
>>>>>>>       discount: double,
>>>>>>>       tax: double,
>>>>>>>       returnflag: string,
>>>>>>>       linestatus: string,
>>>>>>>       shipdate: string,
>>>>>>>       commitdate: string,
>>>>>>>       receiptdate: string,
>>>>>>>       shipinstruct: string,
>>>>>>>       shipmode: string,
>>>>>>>       comment: string}
>>>>>>>
>>>>>>> create dataset lineitem(LineitemType) if not exists primary key
>>>>>>> orderkey,
>>>>>>> linenumber
>>>>>>>
>>>>>>> as described on the homepage linked above there are two ways to load
>>>>>>> data
>>>>>>> from, using either a reachable HDFS or the localFS. I have a running
>>>>>>> HDFS
>>>>>>> within the same network containing the data I want to access and
>>>>>>> tried
>>>>>>> to
>>>>>>> reach it like this:
>>>>>>>
>>>>>>> load dataset lineitem using hdfs
>>>>>>> (("hdfs"="hdfs://192.168.127.11:50040"),
>>>>>>> ("path"="/user/schultzem/lineitem.tbl"),
>>>>>>> ("input-format"="text-input-format"),
>>>>>>> ("format"="delimited-text"),
>>>>>>> ("delimiter"="|"));
>>>>>>>
>>>>>>> However I get an error message
>>>>>>>
>>>>>>> Unable to create adapter org.apache.hadoop.ipc.RemoteException:
>>>>>>> Server
>>>>>>> IPC
>>>>>>> version 9 cannot communicate with client version 3
>>>>>>> [AlgebricksException]
>>>>>>>
>>>>>>> all I found out about this was an old Issue from 2013 that
>>>>>>> recommends
>>>>>>> an
>>>>>>> older version of hadoop, which is not an option for me.
>>>>>>>
>>>>>>> https://code.google.com/p/asterixdb/issues/detail?id=521
>>>>>>>
>>>>>>> Is this somehow fixable?
>>>>>>>
>>>>>>> The other option to load data from the localFS also throws an error.
>>>>>>>
>>>>>>> load dataset lineitem using localfs
>>>>>>> (("path"="192.168.127.21:///home/schultzem/tpch/TPCH_data_10GB/lineitem.tbl"),
>>>>>>>     ("format"="delimited-text"),
>>>>>>>     ("delimiter"="|"));
>>>>>>>
>>>>>>> leads to
>>>>>>>
>>>>>>> No node controllers found at the address: 192.168.127.21
>>>>>>> [AsterixException]
>>>>>>>
>>>>>>> which is the same error as for 127.0.0.1.
>>>>>>>
>>>>>>> On the linked documentation about external datasets it is assumed
>>>>>>> that
>>>>>>> AsterixDB is used in local mode. Is this the problem why I cannot
>>>>>>> reach
>>>>>>> the cluster nodes?
>>>>>>>
>>>>>>> Did I make a mistake accessing the data? How can I load data into
>>>>>>> the
>>>>>>> database?
>>>>>>>
>>>>>>> Regards, Max
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>
>