Mailing-List: contact chukwa-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: chukwa-user@hadoop.apache.org
Received-SPF: neutral (athena.apache.org: local policy)
DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns;
	h=received:user-agent:date:subject:from:to:message-id:
	thread-topic:thread-index:in-reply-to:mime-version:content-type:
	content-transfer-encoding:x-originalarrivaltime;
	b=XaFem4dWNHgETM3+wh+CzMLsDLVzHEJQqa803BdH6BJ9o8GzGskot5+X7Rh9XZrY
User-Agent: Microsoft-Entourage/12.23.0.091001
Date: Thu, 24 Dec 2009 23:46:49 -0800
Subject: Re: Chukwa build issue (should read Chukwa collector issue)[solved]
From: Eric Yang <eyang@yahoo-inc.com>
To: <chukwa-user@hadoop.apache.org>
Message-ID: <C759ADE9.59C2%eyang@yahoo-inc.com>
Thread-Topic: Chukwa build issue (should read Chukwa collector issue)[solved]
Thread-Index: AQHKgtQ0tt7HwzdUMke7tqJ5PXs/FZFwp146gAKtZOCAAhJpvg==
In-Reply-To: <8D40C83B54E3CE43BD7F88EA8FFC137F0CDFCFCD@exchange101>
Mime-version: 1.0
Content-type: text/plain;
	charset="ISO-8859-1"
Content-transfer-encoding: quoted-printable

The problem is fixed, please try again.  Thanks for bring this to my
attention.  Merry Christmas

Regards,
Eric


On 12/23/09 4:14 PM, "Joe Hammerman" <jhammerman@videoegg.com> wrote:

> Eric - thanks again for you responsiveness.
>=20
> I navigated to the trunk and downloaded the latest build two days ago. I
> cannot get the build to compile with ANT version 1.7.1.
>=20
> I have attached the console output - am I doing something wrong?
>=20
> Thanks in advance!
> -----Original Message-----
> From: Eric Yang [mailto:eyang@yahoo-inc.com]
> Sent: Monday, December 21, 2009 11:15 PM
> To: chukwa-user@hadoop.apache.org
> Subject: Re: Chukwa build issue (should read Chukwa collector issue)[solv=
ed]
>=20
> This is a bug in HICC.  When I converted from Tomcat to jetty in Chukwa 0=
.3,
> there is a conflict between tag lib jsp engine and jetty's servlet
> implementation.  I rewrote the view manager for HICC in trunk, which uses
> jersey and HDFS to store HICC views.  Therefore, I recommend to upgrade t=
o
> trunk to get HICC dashboard builder working.
>=20
> Regards,
> Eric
>=20
>=20
> On 12/21/09 10:58 PM, "Joe Hammerman" <jhammerman@videoegg.com> wrote:
>=20
>> Gentlemen; first of all thanks for all of your help.
>>=20
>> The root cuase of the issue described here became evident after I used t=
he
>> jettyCollector.sh script per Ari's recommendation. The user I was launch=
ing
>> the script as did not have write permissions to the hadoop cluster.
>>=20
>> Another issue that is not mentioned in the documentation (and to be fair=
, is
>> not a fault of the Chukwa devlopment team in any way) is that the RPM'd
>> version of ANT (1.6.5-2jpp.2 ) will fail when you issue the build comman=
d.
>>=20
>> I had to go get ANT 1.7.1 :)
>>=20
>> I am now encountering an issue with the HICC. I believe I followed the
>> documentation (famous last words). When I direct my browser to the page,=
 this
>> is the output when I click Dasboard view:
>>=20
>> HTTP ERROR: 500
>>=20
>> INTERNAL_SERVER_ERROR
>>=20
>> RequestURI=3D/hicc/jsp/workspace/manage_view.jsp
>> Caused by:
>>=20
>> java.lang.NullPointerException
>> at org.apache.hadoop.chukwa.hicc.Views.length(Views.java:130)
>> at org.apache.hadoop.chukwa.hicc.ViewsTag.doTag(ViewsTag.java:35)
>> at=20
>>=20
org.apache.jsp.jsp.workspace.manage_005fview_jsp._jspx_meth_my_findViews_0(=
or>>
g
>> .apache.jsp.jsp.workspace.manage_005fview_jsp:141)
>> at=20
>>=20
org.apache.jsp.jsp.workspace.manage_005fview_jsp._jspService(org.apache.jsp=
.j>>
s
>> p.workspace.manage_005fview_jsp:114)
>> at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:93)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>> at=20
>>=20
>=20
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:=
373>
>
> )
>> at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:4=
70)
>> at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:364)
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>> at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487=
)
>> at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:3=
62)
>> at=20
>> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:2=
16)
>> at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:1=
81)
>> at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:7=
29)
>> at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:405)
>> at=20
>>=20
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCol=
le>>
c
>> tion.java:206)
>> at=20
>>=20
org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:1=
14>>
)
>> at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:1=
52)
>> at org.mortbay.jetty.Server.handle(Server.java:324)
>> at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:50=
5)
>> at=20
>>=20
org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java=
:8>>
4
>> 3)
>> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:647)
>> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:205)
>> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:380)
>> at=20
>> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:=
395)
>> at=20
>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java=
:488)
>>=20
>>=20
>> If I click Options -> Add Widget the page hangs on loading indefinitely.
>>=20
>> Is there any guidance anyone could provide here?
>>=20
>> Thanks so much!
>> ________________________________________
>> From: Eric Yang [eyang@yahoo-inc.com]
>> Sent: Thursday, December 17, 2009 7:12 PM
>> To: chukwa-user@hadoop.apache.org
>> Subject: Re: Chukwa build issue (should read Chukwa collector issue)
>>=20
>> You can try to send a kill -3 11135 and capture the output in
>> chukwa-chukwizzle-jettyCollector.sh-hadoopm102.sacpa.videoegg.com.out
>>=20
>> It may provide more information for debug.  Ditto what Ari said, use
>> ./bin/start-collector.sh is better, tools/init.d only works as
>> /etc/init.d/chukwa-collector, if you are building with "ant rpm" and
>> installed the RPM package.  I also notice the bash error that you should
>> create var/tmp in /usr/local/chukwa to avoid the bash errors.
>>=20
>> Regards,
>> Eric
>>=20
>>=20
>> On 12/17/09 6:47 PM, "Joe Hammerman" <jhammerman@videoegg.com> wrote:
>>=20
>>> Eric,
>>>=20
>>> Thank you for the response! No I'm not running on an IPv6 network:
>>>=20
>>> [root@hadoopm102.sacpa ~]# ifconfig -a
>>> eth0      Link encap:Ethernet  HWaddr 00:18:FE:71:E3:50
>>>           inet addr:10.1.75.12  Bcast:10.1.95.255  Mask:255.255.224.0
>>>           inet6 addr: fe80::218:feff:fe71:e350/64 Scope:Link
>>>           UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
>>>           RX packets:2217102 errors:0 dropped:0 overruns:0 frame:0
>>>           TX packets:723565 errors:0 dropped:0 overruns:0 carrier:0
>>>           collisions:0 txqueuelen:1000
>>>           RX bytes:641183690 (611.4 MiB)  TX bytes:142622303 (136.0 MiB=
)
>>>           Interrupt:169 Memory:f8000000-f8012100
>>>=20
>>> eth1      Link encap:Ethernet  HWaddr 00:18:FE:71:E3:4E
>>>           BROADCAST MULTICAST  MTU:1500  Metric:1
>>>           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
>>>           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
>>>           collisions:0 txqueuelen:1000
>>>           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
>>>           Interrupt:177 Memory:fa000000-fa012100
>>>=20
>>> lo        Link encap:Local Loopback
>>>           inet addr:127.0.0.1  Mask:255.0.0.0
>>>           inet6 addr: ::1/128 Scope:Host
>>>           UP LOOPBACK RUNNING  MTU:16436  Metric:1
>>>           RX packets:8737 errors:0 dropped:0 overruns:0 frame:0
>>>           TX packets:8737 errors:0 dropped:0 overruns:0 carrier:0
>>>           collisions:0 txqueuelen:0
>>>           RX bytes:20724963 (19.7 MiB)  TX bytes:20724963 (19.7 MiB)
>>>=20
>>> sit0      Link encap:IPv6-in-IPv4
>>>           NOARP  MTU:1480  Metric:1
>>>           RX packets:0 errors:0 dropped:0 overruns:0 frame:0
>>>           TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
>>>           collisions:0 txqueuelen:0
>>>           RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
>>>=20
>>> I believe the capitalized 'C' was a result of Outlook's auto-capitaliza=
tion.
>>> The filename is not capitalized on the filesystem.
>>>=20
>>> -----Original Message-----
>>> From: Eric Yang [mailto:eyang@yahoo-inc.com]
>>> Sent: Thursday, December 17, 2009 6:42 PM
>>> To: chukwa-user@hadoop.apache.org
>>> Subject: Re: Chukwa build issue
>>>=20
>>> Hi Joe,
>>>=20
>>> Normally, it will say which port it runs on in the .out file.  Like thi=
s:
>>>=20
>>> 2009-12-18 01:36:37.201::INFO:  Logging to STDERR via
>>> org.mortbay.log.StdErrLog
>>> 2009-12-18 01:36:37.232::INFO:  jetty-6.1.11
>>> 2009-12-18 01:36:37.528::INFO:  Started SelectChannelConnector@0.0.0.0:=
8080
>>> started Chukwa http collector on port 8080
>>>=20
>>> Are you running on IPv6 network?  From your message,
>>> chukwa-collector-conf.xml is spelled Chukwa-collector.conf.xml.  Maybe =
it
>>> was a typo.
>>>=20
>>> Regards,
>>> Eric
>>>=20
>>>=20
>>> On 12/17/09 6:11 PM, "Joe Hammerman" <jhammerman@videoegg.com> wrote:
>>>=20
>>>> Hello all,
>>>>                 Trying to get a Chukwa 0.3.0 installation up and runni=
ng
>>>> for
>>>> our Hadoop (Hadoop hadoop-0.20.1+152 from Cloudera) logs here. I=B9ve re=
ad
>>>> all
>>>> the documentation, and the archives; I can=B9t find anyone who seems to =
have
>>>> encountered my error before. I followed the instructions here for Coll=
ector
>>>> configuration: http://www.cs.berkeley.edu/~asrabkin/chukwa/admin.html.=
 ant
>>>> test runs without any test failures.
>>>>=20
>>>>                 The problem is that when I run
>>>> tools/init.d/chukwa-collector
>>>> I
>>>> don=B9t see the daemon listening on port 8080. Here is the output from t=
he
>>>> program launch:
>>>>=20
>>>> [root@hadoopm102.sacpa init.d]# ./chukwa-collector start
>>>> Starting chukwa-collector: /usr/local/chukwa/bin/chukwa-daemon.sh: lin=
e
>>>> 110:
>>>> /usr/local/chukwa/bin/../var/tmp/cron.200912180201: No such file or
>>>> directory
>>>> /usr/local/chukwa/bin/chukwa-daemon.sh: line 114:
>>>> /usr/local/chukwa/bin/../var/tmp/cron.200912180201: No such file or
>>>> directory
>>>> /usr/local/chukwa/bin/chukwa-daemon.sh: line 121:
>>>> /usr/local/chukwa/bin/../var/tmp/cron.200912180201: No such file or
>>>> directory
>>>> Registering watchdog..done
>>>> starting jettyCollector.sh, logging to
>>>>=20
>>=20
>=20
/var/chukwa/log/chukwa-chukwizzle-jettyCollector.sh-hadoopm102.sacpa.videoe=
gg>>
>
>>=20
>> .
>>>> com.out
>>>> 2009-12-18 02:01:15.677::INFO:  Logging to STDERR via
>>>> org.mortbay.log.StdErrLog
>>>> 2009-12-18 02:01:15.704::INFO:  jetty-6.1.11
>>>>=20
>>>> I have attached output showing that Chukwa is configured according to =
the
>>>> documentation to file, in order to keep the thread clear of clutter.
>>>>=20
>>>> Does anyone have troubleshooting suggestions?
>>>>=20
>>>> Thanks in advance for any help!
>>>>=20
>>>=20
>>=20
>=20