Mailing-List: contact dev-help@impala.incubator.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@impala.incubator.apache.org
MIME-Version: 1.0
References: <7e055592-093a-45da-86ca-5d7239977e9a@cloudera.org>
 <CAEy_wPET+je5zEnXOFNXmLU7W3RSxpkdr3KyXEO68OKkCAUPOg@mail.gmail.com>
 <CAAXz=9-WCwrupKNS+UkSmaigwMtK74z-JALPqr8zo56eGEb17Q@mail.gmail.com>
 <CAEy_wPH6hvznn=+OiQnY9ZKUZLxkvA0HKK4AFonpkUhoGfzHjg@mail.gmail.com>
 <CAAXz=98aOk83FKn5qx+=DkJaXdyjhPdOAtBdx1spJxKnA=9WpQ@mail.gmail.com>
 <CAEy_wPFu956hUXYGNY8gdASvy19CrjBYP5ahoYpS8pVjRu6Zvw@mail.gmail.com>
 <CAAXz=9_Ujd=oxVee9T67O99m041wmJsq7e_ZuFTHBWx1P7oX4A@mail.gmail.com>
 <CAEy_wPHr4c6cddX0RgYi+34u_KQFMsDZN4QSHd9dhq3p+vRkKQ@mail.gmail.com>
 <CAAXz=99TqCcpET_AtP7WYVzV0svgw2mFKqRyOmLiAqUWZwtoKg@mail.gmail.com>
 <CAEy_wPFbuOLi6EcTnjwYgaMHZ08d9Y8GmgAXbbiF0wsJfdKaQg@mail.gmail.com>
 <CAAXz=9_dAibeHCukfmgsCCfycbbd=dpFGOO08TxkN+pwowjHDw@mail.gmail.com>
 <CAEy_wPGvHorYb3kVJ9hHbMzchps0PNEL_OQv=zyN6MP-qO2O0Q@mail.gmail.com>
 <CAAXz=990mVbHMXZ2oy39bR-Yz5JZ=hcOx2sDgGcvbYX82yE6Gg@mail.gmail.com>
In-Reply-To: 
 <CAAXz=990mVbHMXZ2oy39bR-Yz5JZ=hcOx2sDgGcvbYX82yE6Gg@mail.gmail.com>
From: Pradeep Nayak <pradeep1288@gmail.com>
Date: Tue, 05 Apr 2016 00:55:58 +0000
Message-ID: 
 <CAAXz=99nAztQGQeX8a2BRZ5JNse9D27q=3J7-NzCpN1G2RJ8xw@mail.gmail.com>
Subject: Re: maven error while compiling the front end code
To: Skye Wanderman-Milne <skye@cloudera.com>
Cc: Impala Dev <impala-dev@cloudera.org>, dev@impala.incubator.apache.org
Content-Type: multipart/alternative; boundary=001a113eceba8d8315052fb24f47

--001a113eceba8d8315052fb24f47
Content-Type: text/plain; charset=UTF-8

Also just wanted to understand one more thing.
http://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala_s3.html It
mentions that impala needs to have a default file system which is hdfs, but
not just s3a, or any other filesystem which extends Hadoop FileSystem class
? Is there plans to support non hdfs filesystem as default ?

Meanwhile I got around the problem earlier. I can query tables, do a
count(*), etc.

However join is causing a problem...

*select * from tab1 join tab2;*

*Query: select * from tab1 join tab2*

*ERROR:*

*Failed to connect to FS*

*Error(255): Unknown error 255*


Pradeep

On Mon, Apr 4, 2016 at 3:31 PM Pradeep Nayak <pradeep1288@gmail.com> wrote:

> That's what been puzzling me as well :(. Let me get back to you with that
> information.
>
> Pradeep
>
> On Mon, Apr 4, 2016 at 3:28 PM Skye Wanderman-Milne <skye@cloudera.com>
> wrote:
>
>> Actually, I didn't read your exception carefully and didn't notice that
>> it can't find an Impala class, so it's probably not a dependency issue.
>>
>> Can you restart your cluster, rerun a select * query, and then search
>> your logs for that "NoClassDefFoundError"? That will tell us which process
>> the error is coming from. That class is included in the FE jar, so I'm not
>> sure why it wouldn't be able to find it.
>>
>>
>> On Mon, Apr 4, 2016 at 3:14 PM, Pradeep Nayak <pradeep1288@gmail.com>
>> wrote:
>>
>>> Sure Skye. I didn't notice the to: list as well until you pointed out. I
>>> really appreciate your help here.
>>>
>>> I haven't modified the pom.xml for the front-end here:
>>> https://github.com/cloudera/Impala/blob/cdh5.5.2-release/fe/pom.xml
>>>
>>> I am just building with this at the moment. mvn clean package
>>> -DSkipTests = true from the fe folder.
>>>
>>>
>>> On Mon, Apr 4, 2016 at 3:11 PM Skye Wanderman-Milne <skye@cloudera.com>
>>> wrote:
>>>
>>>> Ah didn't mean to take this off the dev list. Also add our new
>>>> dev@impala.incubator list.
>>>>
>>>> Can you check what dependency versions you're pulling in from maven? My
>>>> guess is that you're somehow building with non-CDH5.5.2 frontend
>>>> dependencies.
>>>>
>>>> On Mon, Apr 4, 2016 at 3:04 PM, Pradeep Nayak <pradeep1288@gmail.com>
>>>> wrote:
>>>>
>>>>> Umm, I am trying to test this on a dev cluster which has cloudera
>>>>> parcels already installed. I just re-placed
>>>>> impala-frontend-0.1-SNAPSHOT.jar with my version. Do I need to change
>>>>> anything on the dev cluster ?
>>>>>
>>>>> On Mon, Apr 4, 2016 at 2:43 PM Skye Wanderman-Milne <skye@cloudera.com>
>>>>> wrote:
>>>>>
>>>>>> Try: source $IMPALA_HOME/bin/set-classpath.sh
>>>>>>
>>>>>> If you recently switched branches, you may want to close your current
>>>>>> terminal, open a new one, and re-source $IMPALA_HOME/bin/impala-config.sh
>>>>>> and set-classpath.sh.
>>>>>>
>>>>>> Then restart your cluster (start-impala-cluster.py)
>>>>>>
>>>>>> On Mon, Apr 4, 2016 at 2:39 PM, Pradeep Nayak <pradeep1288@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks Skye.
>>>>>>>
>>>>>>> I am in my impala shell. I get this following error. I see this is
>>>>>>> already compiled as part of impala-frontend. This happens only when I try
>>>>>>> to do a "select * from <table_name>" I can do "show tables; create table
>>>>>>> <table_name>" etc. Any pointers ?
>>>>>>>
>>>>>>> ERROR: AnalysisException: java.lang.NoClassDefFoundError: Could not
>>>>>>> initialize class com.cloudera.impala.util.HdfsCachingUtil
>>>>>>>
>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: Could
>>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil
>>>>>>>
>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class
>>>>>>> com.cloudera.impala.util.HdfsCachingUtil
>>>>>>>
>>>>>>> CAUSED BY: TableLoadingException: java.lang.NoClassDefFoundError:
>>>>>>> Could not initialize class com.cloudera.impala.util.HdfsCachingUtil
>>>>>>>
>>>>>>> CAUSED BY: ExecutionException: java.lang.NoClassDefFoundError: Could
>>>>>>> not initialize class com.cloudera.impala.util.HdfsCachingUtil
>>>>>>>
>>>>>>> CAUSED BY: NoClassDefFoundError: Could not initialize class
>>>>>>> com.cloudera.impala.util.HdfsCachingUtil
>>>>>>>
>>>>>>> I used this tree:
>>>>>>> https://github.com/cloudera/Impala/tree/cdh5.5.2-release
>>>>>>>
>>>>>>> On Mon, Apr 4, 2016 at 12:01 PM Skye Wanderman-Milne <
>>>>>>> skye@cloudera.com> wrote:
>>>>>>>
>>>>>>>> I think it should be
>>>>>>>> https://github.com/cloudera/Impala/tree/cdh5-2.3.0_5.5.2
>>>>>>>>
>>>>>>>> On Mon, Apr 4, 2016 at 12:00 PM, Pradeep Nayak <
>>>>>>>> pradeep1288@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Also to what release this parcel  *5.5.2-1.cdh5.5.2.p0.4 *map to
>>>>>>>>> on github ? I am unable to find a tag/branch for this parcel type.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Apr 4, 2016 at 11:58 AM Skye Wanderman-Milne <
>>>>>>>>> skye@cloudera.com> wrote:
>>>>>>>>>
>>>>>>>>>> Ah yes, both 1 and 2 are correct. Glad you figured it out!
>>>>>>>>>>
>>>>>>>>>> On Mon, Apr 4, 2016 at 11:56 AM, Pradeep Nayak <
>>>>>>>>>> pradeep1288@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> I just figured.
>>>>>>>>>>> 1. For the first time you need to use the ./buildall.sh and for
>>>>>>>>>>> subsequent fe compilation I can just use maven
>>>>>>>>>>> 2. It doesn't build on Macbook
>>>>>>>>>>> 3. I set up a Ubuntu vm and got this compiled.
>>>>>>>>>>>
>>>>>>>>>>> Pradeep
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Apr 4, 2016 at 11:07 AM Skye Wanderman-Milne <
>>>>>>>>>>> skye@cloudera.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hey Pradeep,
>>>>>>>>>>>>
>>>>>>>>>>>> You should try running the $IMPALA_HOME/buildall.sh script in
>>>>>>>>>>>> order to build Impala. It has a lot of necessary setup to build Impala.
>>>>>>>>>>>> Here are the commands from buildall.sh that should provide the
>>>>>>>>>>>> impala-data-source-api jar for building the FE:
>>>>>>>>>>>>
>>>>>>>>>>>> # build the external data source API
>>>>>>>>>>>> pushd ${IMPALA_HOME}/ext-data-source
>>>>>>>>>>>> ${IMPALA_HOME}/bin/mvn-quiet.sh install -DskipTests
>>>>>>>>>>>> popd
>>>>>>>>>>>>
>>>>>>>>>>>> See
>>>>>>>>>>>> https://github.com/cloudera/Impala/blob/cdh5-trunk/buildall.sh#L283
>>>>>>>>>>>>
>>>>>>>>>>>> Hope that helps!
>>>>>>>>>>>> Skye
>>>>>>>>>>>>
>>>>>>>>>>>> On Sat, Apr 2, 2016 at 12:55 PM, Pradeep Nayak <
>>>>>>>>>>>> pradeep1288@gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> I just cloned the Impala source from github, and I am trying
>>>>>>>>>>>>> to compile the front end per Impala wiki. I get the error below. I am using
>>>>>>>>>>>>> maven 3.
>>>>>>>>>>>>>
>>>>>>>>>>>>> [ERROR] Failed to execute goal on project impala-frontend:
>>>>>>>>>>>>> Could not resolve dependencies for project
>>>>>>>>>>>>> com.cloudera.impala:impala-frontend:jar:0.1-SNAPSHOT: Failure to find
>>>>>>>>>>>>> com.cloudera.impala:impala-data-source-api:jar:1.0-SNAPSHOT in
>>>>>>>>>>>>> https://repository.cloudera.com/content/groups/cdh-releases-rcs
>>>>>>>>>>>>> was cached in the local repository, resolution will not be reattempted
>>>>>>>>>>>>> until the update interval of cdh.rcs.releases.repo has elapsed or updates
>>>>>>>>>>>>> are forced -> [Help 1
>>>>>>>>>>>>>
>>>>>>>>>>>>> This is the command I used:   mvn clean package
>>>>>>>>>>>>> dependency:copy-dependencies -DskipTests=true
>>>>>>>>>>>>>
>>>>>>>>>>>>> Any idea getting around this problem ?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Cheers!
>>>>>>>>>>>>> Pradeep
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> You received this message because you are subscribed to the
>>>>>>>>>>>>> Google Groups "Impala Dev" group.
>>>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from
>>>>>>>>>>>>> it, send an email to impala-dev+unsubscribe@cloudera.org.
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>> You received this message because you are subscribed to the
>>>>>>>>>>> Google Groups "Impala Dev" group.
>>>>>>>>>>> To unsubscribe from this group and stop receiving emails from
>>>>>>>>>>> it, send an email to impala-dev+unsubscribe@cloudera.org.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>
>>

--001a113eceba8d8315052fb24f47--