incubator-s4-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From baojian Zhou <baojian.zhou.b...@gmail.com>
Subject Re: can anyone help me please
Date Tue, 28 May 2013 08:05:01 GMT
omg i forget the benchmark-cluster.sh's opts, i add the injector number and
other and it did work. thank you


2013/5/28 baojian Zhou <baojian.zhou.buaa@gmail.com>

> dear Mr Matthieu
>  thank you for your best advice. I had changed the startInjector.sh and
> startNode.sh two files;
> and then i also had changed the startInjector.sh add the ./s4 deploy
> command, it worked; and then i check the status´╝Ü
> App Status
>
> ----------------------------------------------------------------------------------------------------------------------------------
>         Name              Cluster
>          URI
>
> ----------------------------------------------------------------------------------------------------------------------------------
>       injector          testCluster1    null
>        pcApp            testCluster2    null
>
> ----------------------------------------------------------------------------------------------------------------------------------
>
>
>
> Cluster Status
>
> ----------------------------------------------------------------------------------------------------------------------------------
>
>           Active nodes
>         Name                App           Tasks
> --------------------------------------------------------------------------------
>                                                    Number    Task id
>                   Host                         Port
>
> ----------------------------------------------------------------------------------------------------------------------------------
>     testCluster1          injector         0         0
>     testCluster2           pcApp           2         2        Task-0
>                  node5                         13000
>                                                               Task-1
>                  node5                         13001
>
> ----------------------------------------------------------------------------------------------------------------------------------
>
>
>
> Stream Status
>
> ----------------------------------------------------------------------------------------------------------------------------------
>         Name                               Producers
>                        Consumers
>
> ----------------------------------------------------------------------------------------------------------------------------------
>     inputStream2                              --
>                  testCluster2(pcApp)
>     inputStream                               --
>                  testCluster2(pcApp)
>
> ----------------------------------------------------------------------------------------------------------------------------------
> then i found the there are no producers, also it should be the injector
> app work as the producers, why?
>
>
> 2013/5/27 Matthieu Morel <mmorel@apache.org>
>
>>
>> Unfortunately the s4-benchmarks were not completely updated with the
>> latest API changes. If you can file a jira ticket we'll update that.
>>
>> Changes include:
>> 1/ "Main" -> "S4Node" in startNode.sh and startInjector.sh
>> 3/ in the bench-cluster.sh script, configure app class for injector
>> cluster before starting the injector nodes, instead of passing that when
>> starting injectors (i.e. do a "s4 deploy" with the correct args instead of
>> passing them to the startInjector.sh scripts)
>>
>> It's not too difficult to change so you may give it a try. Otherwise
>> we'll fix that from a jira ticket.
>>
>> Regards,
>>
>> Matthieu
>>
>>
>>
>> On May 27, 2013, at 17:06 , baojian Zhou wrote:
>>
>> then i find these errors in the startInjector.sh and startNode.sh :
>> java $PROFILING_OPTS -Xmx1G -Xms1G -verbose:gc
>> -Xloggc:gc-injector-$host.log -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
>> -cp `cat classpath.txt` org.apache.s4.core.Main "@$INJECTOR_CONFIG" &
>> java -Xmx4G -Xms4G -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps
>> -Xloggc:gc-$host.log $PROFILING_OPTS -server -cp `cat classpath.txt`
>> org.apache.s4.core.Main "@$NODE_CONFIG" &
>>
>> how can i write the Main class, and let this benchmark to run ?
>>
>>
>>
>> 2013/5/27 baojian Zhou <baojian.zhou.buaa@gmail.com>
>>
>>> thank you Shrivastava and Morel, it dose resolve the issue by adding
>>> -clean opt. but when i run the benchmark-cluster.sh and then i got the
>>> following errors in the creating directory  2013-05-27--22-17-10  file
>>>  s4err_1.err and s4err_2.err:
>>> Exception in thread "main" java.lang.NoClassDefFoundError:
>>> org/apache/s4/core/Main
>>> Caused by: java.lang.ClassNotFoundException: org.apache.s4.core.Main
>>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>>>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
>>> Could not find the main class: org.apache.s4.core.Main. Program will
>>> exit.
>>>
>>> i know that java cannot find the Main class, but in the s4-src we have
>>> not this class, how can this happened?
>>> thank you
>>>
>>>
>>> 2013/5/27 Lokesh Shrivastava <lokesh.shrivastava@gmail.com>
>>>
>>>> I think script is not cleaning up your z4 cluster old configuration. If
>>>> you run the cluster by giving clean option, it should resolve the issue.
>>>>
>>>>
>>>> On 27 May 2013 19:18, baojian Zhou <baojian.zhou.buaa@gmail.com> wrote:
>>>>
>>>>> i start test the s4 benchmark application, and then run the
>>>>> ./bench-cluster.sh command then i got this error :
>>>>>
>>>>>  21:23:18.570 [main] INFO  org.apache.s4.tools.ZKServer - Zookeeper
>>>>> server started on port [2181]
>>>>> 21:23:18.618 [main] INFO  org.apache.s4.tools.ZKServer - Defined S4
>>>>> cluster [testCluster1] with [0] tasks with first listening port [12000]
>>>>> 21:23:18.706 [main] ERROR org.apache.s4.tools.ZKServer - Cannot
>>>>> initialize zookeeper with specified configuration
>>>>> org.I0Itec.zkclient.exception.ZkNodeExistsException:
>>>>> org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode
=
>>>>> NodeExists for /s4/clusters/testCluster2/tasks/Task-0
>>>>>         at
>>>>> org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at
>>>>> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at
>>>>> org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at org.apache.s4.comm.tools.TaskSetup.setup(TaskSetup.java:69)
>>>>> ~[s4-comm-0.6.0-incubating.jar:0.6.0-incubating]
>>>>>         at org.apache.s4.tools.ZKServer.main(ZKServer.java:94)
>>>>> ~[s4-tools-0.6.0-incubating.jar:0.6.0-incubating]
>>>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>> ~[na:1.6.0_20]
>>>>>         at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>>> ~[na:1.6.0_20]
>>>>>         at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>> ~[na:1.6.0_20]
>>>>>         at java.lang.reflect.Method.invoke(Method.java:616)
>>>>> ~[na:1.6.0_20]
>>>>>         at org.apache.s4.tools.Tools$Task.dispatch(Tools.java:57)
>>>>> [s4-tools-0.6.0-incubating.jar:0.6.0-incubating]
>>>>>         at org.apache.s4.tools.Tools.main(Tools.java:97)
>>>>> [s4-tools-0.6.0-incubating.jar:0.6.0-incubating]
>>>>> Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
>>>>> KeeperErrorCode = NodeExists for /s4/clusters/testCluster2/tasks/Task-0
>>>>>         at
>>>>> org.apache.zookeeper.KeeperException.create(KeeperException.java:110)
>>>>> ~[zookeeper-3.3.3.jar:3.3.3-1073969]
>>>>>         at
>>>>> org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
>>>>> ~[zookeeper-3.3.3.jar:3.3.3-1073969]
>>>>>         at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:637)
>>>>> ~[zookeeper-3.3.3.jar:3.3.3-1073969]
>>>>>         at
>>>>> org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         at
>>>>> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
>>>>> ~[zkclient-0.1.jar:na]
>>>>>         ... 10 common frames omitted
>>>>>
>>>>> can anyone tell me why?
>>>>>
>>>>
>>>>
>>>
>>
>>
>

Mime
View raw message