incubator-olio-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shanti Subramanyam <shanti.subraman...@gmail.com>
Subject Re: executing faban (errors)
Date Thu, 27 May 2010 00:12:43 GMT
2010/5/26 Bruno Guimarães Sousa <brgsousa@gmail.com>

> The mentioned load balancer is the one for app servers.
> So, would it be better if I install load balancer on a machine with app
> server, like Everest?
>
> Ideally it should be on it's own box but it doesn't matter.


> Why geocoder is not considered to be part of SUT ?
>
> Geocoder is a 3rd party service which we are emulating. So it's not part of
the olio application.


>
> --
> Bruno Guimarães Sousa
> www.ifba.edu.br
> PONTONET - DGTI - IFBA
> Ciência da Computação UFBA
> Registered Linux user #465914
>
>
> On Wed, May 26, 2010 at 12:57 AM, Shanti Subramanyam <
> shanti.subramanyam@gmail.com> wrote:
>
>> You don't need to worry about the Faban agent. Since you are using ssh, it
>> will automatically be started by the master on all machines. Note that these
>> agents really don't do much. They just start the monitoring tools etc. so we
>> usually don't worry about them at all.
>> I assume the Load Balancer you are showing on the MySQL system is to
>> balance load between the 3 app servers ?
>> The only draw back I see is that it may be difficult to separate out the
>> traffic going between load balancer->appserver and appserver->db. Other than
>> that, it looks good.
>> In this architecture, you at least have the system under test (SUT)
>> completely separate from the testing/emulator framework.
>>
>>
>> Shanti
>>
>> 2010/5/25 Bruno Guimarães Sousa <brgsousa@gmail.com>
>>
>>> ops, fixing bad english: "Aren't there two types ..."
>>>
>>> My goal is to do something like this:
>>> [image: estruturacluster.png]
>>>
>>> What do you think?
>>>
>>>
>>>
>>> --
>>> Bruno Guimarães Sousa
>>> www.ifba.edu.br
>>> PONTONET - DGTI - IFBA
>>> Ciência da Computação UFBA
>>> Registered Linux user #465914
>>>
>>>
>>> 2010/5/25 Bruno Guimarães Sousa <brgsousa@gmail.com>
>>>
>>>> Isn't there two types of faban agents? The one that is a driver (test a
>>>> workload against the SUT) and the one that's is not a driver, just a agent
>>>> to monitor cpu, memory etc...
>>>>
>>>>
>>>>
>>>> regards,
>>>> --
>>>> Bruno Guimarães Sousa
>>>> www.ifba.edu.br
>>>> PONTONET - DGTI - IFBA
>>>> Ciência da Computação UFBA
>>>> Registered Linux user #465914
>>>>
>>>>
>>>> On Tue, May 25, 2010 at 1:32 PM, Shanti Subramanyam <
>>>> shanti.subramanyam@gmail.com> wrote:
>>>>
>>>>> Bruno,
>>>>>  Run the faban driver on the same machine as the faban master. You
>>>>> really don't want to be running the driver on the server hosting the
app
>>>>> you're trying to measure (the web app). I suggest the following re-config
:
>>>>>
>>>>> SERVER 1 : faban master, faban driver agent, geocoder
>>>>> SERVER 2: web app, mysql
>>>>>
>>>>> This way, you have segregated the test framework from the system you
>>>>> are trying to test. Ultimately, you will need at least 3 servers - since
>>>>> mysql will consume a lot of cpu for the rails implementation.
>>>>> But for your initial configuration, this should work.
>>>>>
>>>>> Do the above changes and let's see if things get better.
>>>>>
>>>>> Shanti
>>>>>
>>>>> 2010/5/25 Bruno Guimarães Sousa <brgsousa@gmail.com>
>>>>>
>>>>>> Ok,
>>>>>>
>>>>>>
>>>>>>  reviewing:
>>>>>> SERVER 1 (192.168.1.13 - makalu):
>>>>>>
>>>>>>    - faban master
>>>>>>    - geocoder (tomcat)
>>>>>>    - mysql server
>>>>>> SERVER 2 (192.168.1.12 - K2):
>>>>>>
>>>>>>    - faban agent
>>>>>>    - web app (olio - rails)
>>>>>>
>>>>>> At a third time, execution is now running different errors. Faban
>>>>>> agent is running on web app server (K2 192.168.1.12), but executing
faban
>>>>>> master, on the other server, benchmarking goes like this:
>>>>>> Time Host Level Message 08:50:21   INFO Starting OlioDriver run using
>>>>>> /usr/local/faban/output/OlioDriver.1S/ 08:50:21   INFO START TIME
:
>>>>>> Mon May 24 08:50:21 EDT 2010 08:50:21   INFO Starting Registry.
>>>>>> 08:50:21 makalu INFO Registry started. 08:50:52   INFO CmdService:
>>>>>> Configured FileAgent@makalu on server makalu 08:50:52   INFO CmdService:
>>>>>> Configured FileAgent@192.168.1.13 on server makalu 08:50:52   SEVERE*
>>>>>> exception<http://csgengenharia.homeftp.net:9980/LogReader?runId=OlioDriver.1S&exception=6>
>>>>>> * Error accessing command agent on system 192.168.1.12 08:50:52
>>>>>> SEVERE CmdService setup failed. Exiting 08:50:56 makalu INFO [/usr/local/faban/bin/fenxi,
>>>>>> process, /usr/local/faban/output/OlioDriver.1S/,
>>>>>> /usr/local/faban/output/OlioDriver.1S//post/, OlioDriver.1S]
>>>>>> stdout:
>>>>>> Creating database ... 1.15s
>>>>>>
>>>>>> Parsing raw files ... 0.00s
>>>>>> Processing profile default_profile ...OK
>>>>>>  Opening Database ... 0.92s
>>>>>> Executing queries ... 0.04s
>>>>>> Generating html pages ... 0.13s 08:50:56   INFO Killing benchmark
>>>>>> 08:50:56   INFO killing CmdAgent@makalu 08:50:56   INFO killing
>>>>>> CmdAgent@192.168.1.13 08:50:56   INFO killing CmdAgent@192.168.1.12
>>>>>> 08:50:56   SEVERE*
>>>>>> exception<http://csgengenharia.homeftp.net:9980/LogReader?runId=OlioDriver.1S&exception=13>
>>>>>> * Kill Failed for CmdAgent@192.168.1.12 08:50:57   INFO OlioDriver
>>>>>> Completed/Terminated
>>>>>>
>>>>>>
>>>>>> Clicking on "exception" link:
>>>>>>
>>>>>> Record:6         Level: SEVERE
>>>>>> Message: Error accessing command agent on system 192.168.1.12
>>>>>> ------------------------------
>>>>>> Details: Host Sequence Date Millis   26 2010-05-24T08:50:52
>>>>>> 1274705452144
>>>>>> Logger: com.sun.faban.harness.engine.CmdService Thread Class Method
>>>>>> 11 com.sun.faban.harness.engine.CmdService getCmdAgent
>>>>>> ------------------------------
>>>>>> Exception: Message: java.rmi.ConnectException: Connection refused
to
>>>>>> host: 127.0.1.1; nested exception is:
>>>>>> java.net.ConnectException: Connection refused
>>>>>> Stack Trace: Class Method Line sun.rmi.transport.tcp.TCPEndpoint
>>>>>> newSocket 619 sun.rmi.transport.tcp.TCPChannel createConnection 216
>>>>>> sun.rmi.transport.tcp.TCPChannel newConnection 202
>>>>>> sun.rmi.server.UnicastRef invoke 128
>>>>>> com.sun.faban.harness.agent.CmdAgentImpl_Stub getHostName
>>>>>> com.sun.faban.harness.engine.CmdService getCmdAgent 626
>>>>>> com.sun.faban.harness.engine.CmdService setup 488
>>>>>> com.sun.faban.harness.engine.GenericBenchmark start 154
>>>>>> com.sun.faban.harness.engine.RunDaemon run 338 java.lang.Thread run
>>>>>> 636
>>>>>>
>>>>>>
>>>>>> *Open ports on each server:*
>>>>>> root@makalu:/usr/local/faban/master/bin# nmap 192.168.1.12 -p
>>>>>> 9980-9990
>>>>>> Interesting ports on 192.168.1.12:
>>>>>> PORT     STATE  SERVICE
>>>>>> 9980/tcp closed unknown
>>>>>> 9981/tcp open   unknown
>>>>>> 9982/tcp closed unknown
>>>>>> 9983/tcp closed unknown
>>>>>> 9984/tcp closed unknown
>>>>>> 9985/tcp closed unknown
>>>>>> 9986/tcp closed unknown
>>>>>> 9987/tcp closed unknown
>>>>>> 9988/tcp closed unknown
>>>>>> 9989/tcp closed unknown
>>>>>> 9990/tcp closed unknown
>>>>>>
>>>>>> root@makalu:/usr/local/faban/master/bin# nmap 192.168.1.13 -p
>>>>>> 9980-9990
>>>>>> Interesting ports on 192.168.1.13:
>>>>>> PORT     STATE  SERVICE
>>>>>> 9980/tcp open   unknown
>>>>>> 9981/tcp closed unknown
>>>>>> 9982/tcp closed unknown
>>>>>> 9983/tcp closed unknown
>>>>>> 9984/tcp closed unknown
>>>>>> 9985/tcp open   unknown
>>>>>> 9986/tcp closed unknown
>>>>>> 9987/tcp closed unknown
>>>>>> 9988/tcp closed unknown
>>>>>> 9989/tcp closed unknown
>>>>>> 9990/tcp closed unknown
>>>>>>
>>>>>> Don't know why there is a "Connection refused" error...
>>>>>>
>>>>>>
>>>>>> regards,
>>>>>> --
>>>>>> Bruno Guimarães Sousa
>>>>>> www.ifba.edu.br
>>>>>> PONTONET - DGTI - IFBA
>>>>>> Ciência da Computação UFBA
>>>>>> Registered Linux user #465914
>>>>>>
>>>>>>
>>>>>> On Tue, May 25, 2010 at 3:10 AM, Akara Sucharitakul <
>>>>>> akara.sucharitakul@oracle.com> wrote:
>>>>>>
>>>>>>>  Hi Bruno,
>>>>>>>
>>>>>>> Seems like the master cannot ssh to the other systems in the
rig
>>>>>>> without password. You need to setup ssh so that no password is
required.
>>>>>>> Follow this blog post how to do that:
>>>>>>>
>>>>>>> http://blogs.sun.com/timc/entry/ssh_cheat_sheet
>>>>>>>
>>>>>>> Thanks,
>>>>>>> -Akara
>>>>>>>
>>>>>>>
>>>>>>> On 05/24/2010 08:40 PM, Bruno Guimarães Sousa wrote:
>>>>>>>
>>>>>>> Hi,
>>>>>>> servers are like this:
>>>>>>>
>>>>>>> SERVER 1 (192.168.1.13):
>>>>>>>    - faban master
>>>>>>>    - geocoder (tomcat)
>>>>>>>    - mysql server
>>>>>>> SERVER 2 (192.168.1.12):
>>>>>>>    - faban agent
>>>>>>>    - web app (olio - rails)
>>>>>>>
>>>>>>> When I run tests in faban it reports that can't connect via ssh:
>>>>>>>   20:33:24 makalu INFO  20:33:34   WARNING http://192.168.1.13:9980/
>>>>>>> ]
>>>>>>> stderr:
>>>>>>> Permission denied, please try again.
>>>>>>> Permission denied, please try again.
>>>>>>> Permission denied (publickey,password).  23:36:43 k2 SEVERE
>>>>>>> 20:35:35   INFO  20:35:45   WARNING CmdAgent@192.168.1.13, count
1.
>>>>>>> 20:35:55   WARNING CmdAgent@192.168.1.13, count 2.  20:36:05
>>>>>>> WARNING CmdAgent@192.168.1.13, count 3.  20:36:15   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 4.  20:36:25   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 5.  20:36:35   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 6.  20:36:45   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 7.  20:36:55   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 8.  20:37:05   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 9.  20:37:15   WARNING
>>>>>>> CmdAgent@192.168.1.13, count 10.  20:37:15   SEVERE
>>>>>>> CmdAgent@192.168.1.13  20:37:15   SEVERE  20:37:19 makalu INFO
>>>>>>> stdout:
>>>>>>> Creating database ... 1.12s
>>>>>>> Parsing raw files ... 0.00s
>>>>>>> Processing profile default_profile ...OK
>>>>>>> Opening Database ... 0.87s
>>>>>>> Executing queries ... 0.04s
>>>>>>> Generating html pages ... 0.14s  20:37:19   INFO  20:37:19  
INFO
>>>>>>> 20:37:20   INFO
>>>>>>>
>>>>>>>
>>>>>>> Isn't there a way to used rsh instead? Or how can I make ssh
work?
>>>>>>>
>>>>>>> Tried to allow ssh access without asking for password (
>>>>>>> http://www.linuxhorizon.ro/ssh-wo-passw.html) and didn't succeded
in
>>>>>>> Debian Squeeze.
>>>>>>>
>>>>>>> regards,
>>>>>>> --
>>>>>>> Bruno Guimarães Sousa
>>>>>>> www.ifba.edu.br
>>>>>>> PONTONET - DGTI - IFBA
>>>>>>> Ciência da Computação UFBA
>>>>>>> Registered Linux user #465914
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Mime
View raw message