metron-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Youzha <yuza.ras...@gmail.com>
Subject Re: no data emitted on metron topology
Date Fri, 10 Feb 2017 14:11:09 GMT
Oh i see.
So i must prepare the data first to the kafka broker right.

Could you give me some example of the data that can be sent to kafka
broker? I need some format example like data dummy i think.

Thanks before
On Feb 10, 2017 6:40 PM, "Zeolla@GMail.com" <zeolla@gmail.com> wrote:

> So if I understand correctly, you deployed Metron via Ansible on top of an
> existing Ambari managed HDP cluster.  I don't think there are any current
> issues with that approach but the long term goal is to deprecate that
> deployment method in favor of the mpack install.  That's more of an FYI
> than anything because like I said, it still works as of now.
>
> This also means that no data will go through your cluster until you
> manually put something on the parser topics.
>
> Do you have some logs that you'd like Metron to process?  If so you can
> cat those logs and pipe it through the Kafka producer script with the right
> arguments to get them processed.  If you don't have logs, you could
> probably repurpose the sensor-stubs code to send logs to your Kafka
> brokers, but I haven't looked at doing that specifically.
>
> Jon
>
> On Fri, Feb 10, 2017, 6:32 AM Youzha <yuza.rasfar@gmail.com> wrote:
>
>> Hi.
>>
>> I'm using ansible installation with metron_install.yml config
>>
>> I also use an existing ambari managed hdp. So i install the ambari
>> separated with metron.
>>
>> Any suggestion?
>>
>> Thanks
>> On Feb 10, 2017 6:28 PM, "Zeolla@GMail.com" <zeolla@gmail.com> wrote:
>>
>> When you say VM cluster, do you mean you installed on an existing Ambari
>> managed HDP cluster?  If so, then you will need to put messages onto the
>> right Kafka topics to get processed.  You can use NiFi for this, but you
>> could also just use the Kafka producer scripts.
>>
>> If this isn't what you're talking about and you installed via
>> vagrant/Ansible can you provide which environment you used (quick, full,
>> etc.)?  Thanks,
>>
>> Jon
>>
>> On Fri, Feb 10, 2017, 2:42 AM tkg_cangkul <yuza.rasfar@gmail.com> wrote:
>>
>> hi thx for your response.
>>
>> sorry i install metron using playbook ane i thought there is no nifi
>> installation there. am i must installed nifi first ? i've checked on metron
>> req and there is no nifi requirement.
>>
>> Best Regards,
>>
>>
>> On 10/02/17 13:58, Ali Nazemian wrote:
>>
>> Hi,
>>
>> Have you checked the Nifi part? Are you able to see any incoming stream
>> to kafkaspout?
>>
>> On Fri, Feb 10, 2017 at 5:47 PM, tkg_cangkul <yuza.rasfar@gmail.com>
>> wrote:
>>
>> i try to start some metron topology in my vm cluster. it was succesfull
>> submitted but when i check it on storm ui there is no data emitted. there
>> is no error message too. anyone can help me for this? i've check the worker
>> log but there is no error too. below is the capture from my storm ui & from
>> my worker log :
>>
>>
>>
>>
>>
>>
>>
>>
>> --
>> A.Nazemian
>>
>>
>> --
>>
>> Jon
>>
>> Sent from my mobile device
>>
>> --
>
> Jon
>
> Sent from my mobile device
>

Mime
View raw message