apex-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From d..@softiron.co.uk
Subject Re: malhar twitter demo problem
Date Mon, 26 Sep 2016 20:42:18 GMT
On 2016-09-25 23:10, Chinmay Kolhatkar wrote:
> Hi,
> 
> I can see RollingTopWordsDemo running fine in my local setup.

What variables did you set to configure your twitter credentials?
What xml file did you write them to?

> Can you please share complete exception?

All I see is:

2016-09-26 13:27:15,173 INFO 
com.datatorrent.gateway.resources.ws.v2.WSResource: Caught exception in 
processing web service: java.lang.IllegalArgumentException: Wrong FS: 
hdfs://namenode:9000/user/dtadmin/datatorrent/appPackages, expected: 
file:///

> Also, Do you see TwitterSampleInput class mentioned in exception
> anywhere?

I grep'd everything in /var/log/datatorrent and the only place it shows 
up is in
dtgateway.access.log:

<IPADDR> -  -  [22/Sep/2016:22:12:37 +0000] "GET 
/ws/v2/applications/application_1474394828255_0012/operatorClasses/com.datatorrent.contrib.twitter.TwitterSampleInput

HTTP/1.1" 200 1495 "http://namenode:9090/static/" "Mozilla/5.0 
<CONFIG_INFO>

I do get the following exception in dtgateway.log when shutting down the 
gateway.
I don't know if it's significant.

2016-09-26 13:40:44,366 INFO com.datatorrent.gateway.DTGateway: Shutting 
down
2016-09-26 13:40:44,427 ERROR com.datatorrent.gateway.I: DFS Directory 
cannot be written to with exception:
java.io.IOException: Filesystem closed
	at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:808)
	at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:2041)
	at 
org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:707)
	at 
org.apache.hadoop.hdfs.DistributedFileSystem$14.doCall(DistributedFileSystem.java:703)
	at 
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at 
org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:714)
	at com.datatorrent.stram.client.FSAgent.deleteFile(FSAgent.java:94)
	at com.datatorrent.gateway.I.h(gc:30)
	at com.datatorrent.gateway.l.K(pc:158)
	at com.datatorrent.gateway.l.h(pc:65)
	at com.datatorrent.gateway.K.run(yc:156)
	at java.lang.Thread.run(Thread.java:745)
2016-09-26 13:40:44,444 INFO com.datatorrent.gateway.DTGateway: Shutdown 
complete

> 
> -Chinmay.

Thanks much,
-david


> On Wed, Sep 21, 2016 at 1:06 AM, <dbs@softiron.co.uk> wrote:
> 
>> I'm trying to run the RollingTopWordsDemo option (#1) in the malhar
>> version 3.4 twitter demo,
>> and the TweetSampler operator gets the exception:
>> 
>> java.lang.RuntimeException: java.lang.InterruptedException: sleep
>> interrupted
>> at
>> com.google.common.base.Throwables.propagate(Throwables.java:156)
>> at
>> com.datatorrent.stram.engine.InputNode.run(InputNode.java:209)
>> at
>> 
> com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1407)
>> Caused by: java.lang.InterruptedException: sleep interrupted
>> at java.lang.Thread.sleep(Native Method)
>> at
>> com.datatorrent.stram.engine.InputNode.run(InputNode.java:101)
>> ... 1 more
>> 
>> I'm new to Apex, so I'm not sure how to debug this.
>> Any suggestions or ideas?
>> 
>> Thanks in advance,
>> -david


Mime
View raw message