stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashan Dhananjaya <dhananjay...@gmail.com>
Subject Re: [Dev] [GSoC-2015] Showing health statistics in GUI
Date Thu, 09 Jul 2015 15:00:52 GMT
Noted Lahiru.

On Thu, Jul 9, 2015 at 7:48 PM, Lahiru Sandaruwan <lahirus@wso2.com> wrote:

> Hi Ashan,
>
> Good stuff. It is fine to set the time stamp from CEP for now. But
> ultimately we need the timestamp to be sent from Python cartridge agent.
> Let's fix that part we proceed.
>
> Thanks.
>
> On Thu, Jul 9, 2015 at 7:38 PM, Ashan Dhananjaya <dhananjaya92@gmail.com>
> wrote:
>
>> Hi All,
>>
>> I was able to get the TimeaStamp to the RDBMS without any conflict AFAIK.
>> I am testing the flow more. Please find the commits [1], [2] for the
>> Formatters.
>>
>> [1]=
>> https://github.com/ashandk/stratos/commit/efa25eb255cadbf2843e5f0d0e13b34c09535f91
>> [2]=
>> https://github.com/ashandk/stratos/commit/9c0fce9081c299c34031d602c94ea712602c7a6c
>>
>> Thank You!
>> Best Regards,
>> Ashan
>>
>> On Thu, Jul 9, 2015 at 2:41 PM, Lahiru Sandaruwan <lahirus@wso2.com>
>> wrote:
>>
>>> Great work Ashan.
>>>
>>> On Thu, Jul 9, 2015 at 2:39 PM, Ashan Dhananjaya <dhananjaya92@gmail.com
>>> > wrote:
>>>
>>>> Hi All,
>>>>
>>>> I was able to take the timestamp from the cartridge agent
>>>> (WSO2CEPHealthStatisticsPublisher and WSO2CEPInFlightRequestPublisher) to
>>>> CEP PayLoad definition.Git Hub commits can be found here[1], [2]. Currently
>>>> working on sending the timestamp to the RDBMS without conflicting execution
>>>> plans.
>>>>
>>>> I have included the read-me [2] file to the cep extensions how to
>>>> configure should happen for the Health Stat publishing to the RDBMS.
>>>>
>>>> [1]=
>>>> https://github.com/apache/stratos/commit/4c65e705be822fd420b4e48ebafef789c8686b76
>>>> [2]=
>>>> https://github.com/apache/stratos/commit/e09334cd98f245a4633c992f02db2878ac24d3d0
>>>> [3]=
>>>> https://github.com/apache/stratos/commit/5ca895ef030f6aaeba56183d982aa5ae95db9337
>>>>
>>>> Thank You!
>>>> Best Regards,
>>>> Ashan
>>>>
>>>> On Tue, Jul 7, 2015 at 1:13 PM, Lasantha Fernando <
>>>> lasantha.fdo@gmail.com> wrote:
>>>>
>>>>> Hi Ashan,
>>>>>
>>>>> Currently, you would not be able to get the timestamp out of the event
>>>>> unless you use a databridge agent callback. In that case, you can use
>>>>> Java code to simply get by calling event.getTimestamp().
>>>>>
>>>>> However, if you want to use the timestamp as an attribute while doing
>>>>> processing within CEP, you would have to pass the timestamp as an
>>>>> attribute of the stream. i.e. add it as an attribute of either meta,
>>>>> correlation or payload data. Then you can use that timestamp and
>>>>> format the output event as necessary.
>>>>>
>>>>> Thanks,
>>>>> Lasantha
>>>>>
>>>>> On Tue, Jul 7, 2015 at 1:04 PM, Ashan Dhananjaya <
>>>>> dhananjaya92@gmail.com> wrote:
>>>>> > Hi All,
>>>>> >
>>>>> > I applied the above patch and get the timestamp in the Input
>>>>> Adapter. The
>>>>> > formatter i used was
>>>>> "member_average_memory_consumption_stats:1.0.0". I
>>>>> > tried several time to get the timeStamp attribute but failed. Is
>>>>> there any
>>>>> > way to get a data which is outside in the payload? The Input stream
>>>>> is as
>>>>> > below,
>>>>> >
>>>>> > 10:40:27,757 [-] [DataBridge-Core-pool-2-thread-1]  INFO
>>>>> TenantId=-1234 :
>>>>> > Input Event Adaptor : DefaultWSO2EventInputAdaptor, received
>>>>> >
>>>>> > Event{
>>>>> >   streamId='cartridge_agent_health_stats:1.0.0',
>>>>> >   timeStamp=1436245827731,
>>>>> >   metaData=null,
>>>>> >   correlationData=null,
>>>>> >   payloadData=[single-cartridge-app.my-php.php.domain,
>>>>> > single-cartridge-app-1, network-partition-1,
>>>>> >
>>>>> single-cartridge-app.my-php.php.domaina5598e2b-995f-4620-b652-e66341e24c99,
>>>>> > partition-1, memory_consumption, 20.0],
>>>>> >   arbitraryDataMap={},
>>>>> > }
>>>>> >
>>>>> > Any help will be really appreciated.
>>>>> >
>>>>> > Thank You!
>>>>> > Best Regards,
>>>>> > Ashan
>>>>> >
>>>>> > On Tue, Jul 7, 2015 at 9:32 AM, Chamila De Alwis <chamilad@wso2.com>
>>>>> wrote:
>>>>> >>
>>>>> >> Hi Ashan,
>>>>> >>
>>>>> >> As I've seen from the PCA testing recently, the timestamp is
added
>>>>> to
>>>>> >> every ThriftEvent before publishing. Are you working on PCA
or the
>>>>> Mock
>>>>> >> IaaS? I took a look at the Mock IaaS and the
>>>>> WSO2CEPStatisticsPublisher as
>>>>> >> well, and found out that the latter indeed doesn't add the
>>>>> timestamp to the
>>>>> >> ThriftEvents. This means that the JCA also publishes Thrift
Events
>>>>> with
>>>>> >> empty timestamp fields.
>>>>> >>
>>>>> >> Following is the simple fix for that. I've attached the patch
>>>>> herewith.
>>>>> >> Could you quickly verify with the patch applied build also?
>>>>> >>
>>>>> >> chamilad@chamilad-ThinkPad-T530:~/dev/stratos[master *]$ git
diff
>>>>> >> diff --git
>>>>> >>
>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java
>>>>> >> b/c
>>>>> >> index 653288d..f1fe426 100644
>>>>> >> ---
>>>>> >>
>>>>> a/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java
>>>>> >> +++
>>>>> >>
>>>>> b/components/org.apache.stratos.common/src/main/java/org/apache/stratos/common/statistics/publisher/wso2/cep/WSO2CEPStatisticsPublisher.java
>>>>> >> @@ -29,6 +29,7 @@ import
>>>>> >> org.wso2.carbon.databridge.agent.thrift.exception.AgentException;
>>>>> >>  import org.wso2.carbon.databridge.commons.Event;
>>>>> >>  import org.wso2.carbon.databridge.commons.StreamDefinition;
>>>>> >>
>>>>> >> +import java.util.Date;
>>>>> >>  import java.util.HashMap;
>>>>> >>
>>>>> >>  /**
>>>>> >> @@ -98,6 +99,7 @@ public class WSO2CEPStatisticsPublisher implements
>>>>> >> StatisticsPublisher {
>>>>> >>
>>>>> >>          Event event = new Event();
>>>>> >>          event.setPayloadData(payload);
>>>>> >> +        event.setTimeStamp(new Date().getTime());
>>>>> >>          event.setArbitraryDataMap(new HashMap<String, String>());
>>>>> >>
>>>>> >>          try {
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >> Regards,
>>>>> >> Chamila de Alwis
>>>>> >> Committer and PMC Member - Apache Stratos
>>>>> >> Software Engineer | WSO2 | +94772207163
>>>>> >> Blog: code.chamiladealwis.com
>>>>> >>
>>>>> >>
>>>>> >
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> --
>>> Lahiru Sandaruwan
>>> Committer and PMC member, Apache Stratos,
>>> Senior Software Engineer,
>>> WSO2 Inc., http://wso2.com
>>> lean.enterprise.middleware
>>>
>>> phone: +94773325954
>>> email: lahirus@wso2.com blog: http://lahiruwrites.blogspot.com/
>>> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
>>>
>>>
>>> _______________________________________________
>>> Dev mailing list
>>> Dev@wso2.org
>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>
>>>
>>
>
>
> --
> --
> Lahiru Sandaruwan
> Committer and PMC member, Apache Stratos,
> Senior Software Engineer,
> WSO2 Inc., http://wso2.com
> lean.enterprise.middleware
>
> phone: +94773325954
> email: lahirus@wso2.com blog: http://lahiruwrites.blogspot.com/
> linked-in: http://lk.linkedin.com/pub/lahiru-sandaruwan/16/153/146
>
>

Mime
View raw message