Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 9DF5E200C3C for ; Mon, 3 Apr 2017 13:56:29 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 9C5BD160B76; Mon, 3 Apr 2017 11:56:29 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B1B15160BA8 for ; Mon, 3 Apr 2017 13:56:25 +0200 (CEST) Received: (qmail 86917 invoked by uid 500); 3 Apr 2017 11:56:25 -0000 Mailing-List: contact commits-help@eagle.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@eagle.apache.org Delivered-To: mailing list commits@eagle.apache.org Received: (qmail 85672 invoked by uid 99); 3 Apr 2017 11:56:21 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 03 Apr 2017 11:56:21 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id D7B66E04DB; Mon, 3 Apr 2017 11:56:21 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: hao@apache.org To: commits@eagle.apache.org Date: Mon, 03 Apr 2017 11:57:03 -0000 Message-Id: <5bf5d1ebcdcd43b48c82e954b6263440@git.apache.org> In-Reply-To: <63c4db84ab954dbfb7f170c81426aac6@git.apache.org> References: <63c4db84ab954dbfb7f170c81426aac6@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [44/51] [partial] eagle git commit: Rename site directory archived-at: Mon, 03 Apr 2017 11:56:29 -0000 http://git-wip-us.apache.org/repos/asf/eagle/blob/d6fed677/_site/data/userprofile-validate.txt ---------------------------------------------------------------------- diff --git a/_site/data/userprofile-validate.txt b/_site/data/userprofile-validate.txt new file mode 100644 index 0000000..b59df0b --- /dev/null +++ b/_site/data/userprofile-validate.txt @@ -0,0 +1,8 @@ +2015-10-11 00:52:56,601 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=setPermission src=/dir1/dir2/dir3/2015/10/08/02/00/00/xxx2b01c-b089/_SUCCESS dst=null perm=null +2015-10-11 00:52:57,367 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=setTimes src=/dir1/dir2/dir3/2015/10/08/01/00/00/xyx8b03c-34bd/header dst=null perm=null +2015-10-11 00:52:58,011 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=delete src=/dir1/dir2/dir3/2015/10/08/01/00/00/xyx4b03c-40ee/part-00000 dst=null perm=null +2015-10-11 00:52:59,371 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=fsck src=/dir1/dir2/dir3/2015/10/08/02/00/00/xxx2b02c-ec44/_SUCCESS dst=null perm=null +2015-10-11 00:53:00,371 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=fsck src=/dir1/dir2/dir3/2015/10/08/02/00/00/xxx2b02c-ec44/_SUCCESS dst=null perm=null +2015-10-11 00:53:01,371 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=fsck src=/dir1/dir2/dir3/2015/10/08/02/00/00/xxx2b02c-ec44/_SUCCESS dst=null perm=null +2015-10-11 00:53:02,371 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=fsck src=/dir1/dir2/dir3/2015/10/08/02/00/00/xxx2b02c-ec44/_SUCCESS dst=null perm=null +2015-10-11 00:53:03,371 INFO FSNamesystem.audit: allowed=true ugi=user1 (auth:KERBEROS) ip=/10.10.10.01 cmd=fsck src=/dir1/dir2/dir3/2015/10/08/02/00/00/xxx2b02c-ec44/_SUCCESS dst=null perm=null http://git-wip-us.apache.org/repos/asf/eagle/blob/d6fed677/_site/docs/FAQ.html ---------------------------------------------------------------------- diff --git a/_site/docs/FAQ.html b/_site/docs/FAQ.html new file mode 100644 index 0000000..78881fd --- /dev/null +++ b/_site/docs/FAQ.html @@ -0,0 +1,259 @@ + + + + + + Eagle - Frequently Asked Questions + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+
+
+
+ + +
+
+
+
+
+
    +
  • Slide 1
  • +
+
+
+
+
+
+
+ + + +
+
+

Analyze Big Data Platforms For Security and Performance

+ +
+
+
+ + +
+
+
+ + +
+

Frequently Asked Questions

+
    +
  • +

    Q1. Not able to access storm worker log via browser

    + +
    +

    Add the following line in host machine’s hosts file

    +
    + +
    127.0.0.1 sandbox.hortonworks.com
    +
    +
  • +
  • +

    Q2. Not able to send data into kafka using kafka console producer:

    + +
    /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list localhost:6667 --topic sandbox_hdfs_audit_log
    +
    + +
    +

    Apache Kafka broker are binding to host sandbox.hortonworks.com

    +
    +
  • +
  • +

    Q3. Cannot visit eagle service url http://localhost:9099 through the browser

    + +
    +

    If your network is NAT, then you need to add forwarding port 9099 for eagle service, or you should check if Apache HBase is alive.

    +
    +
  • +
  • +

    Q4: There is no data in Kafka topic after installing log4j Kafka appender

    + +
    +

    There are a few reasons for this: 1) check if the log4j kafka appender is installed successfully and there is no exceptions when restarting the namenode. 2) check if Apache Kafka is started. 3) If everything is ok, the final choice is to restart the namenode again.

    +
    +
  • +
  • +

    Q5: There is no workers in some topologies.

    + +
    +

    Apache Storm in sandbox has only two slots (workers) to run topologies by default. If want to run more than two topologies, a user should add extra slots in the configurations and restart Storm.

    +
    + +

    Add slots

    +
  • +
+ + +
+
+ +
+
+ + + +
+
+
+
+
+
+
+ + + +
+
+Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. +
+
+Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation. +
+
+
+
+
+ + + + + + + + + + + + + http://git-wip-us.apache.org/repos/asf/eagle/blob/d6fed677/_site/docs/ambari-plugin-install.html ---------------------------------------------------------------------- diff --git a/_site/docs/ambari-plugin-install.html b/_site/docs/ambari-plugin-install.html new file mode 100644 index 0000000..b1f6578 --- /dev/null +++ b/_site/docs/ambari-plugin-install.html @@ -0,0 +1,287 @@ + + + + + + Eagle - Install Apache Eagle Ambari Plugin + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+
+
+
+ + +
+
+
+
+
+
    +
  • Slide 1
  • +
+
+
+
+
+
+
+ + + +
+
+

Analyze Big Data Platforms For Security and Performance

+ +
+
+
+ + +
+
+
+ + +
+

Install Apache Eagle Ambari Plugin

+

Assume Apache Eagle (called Eagle in the following) package has been copied and exacted under /usr/hdp/current/eagle.

+ +
+

WARNING: the following instructions work in sandbox currently.

+
+ +

Pre-requisites

+ +
    +
  1. +

    Create a Kafka1 topic if you have not. Here is an example command.

    + +
    $ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
    +
    +
  2. +
  3. +

    Stream HDFS log data to Kafka, and refer to here on how to do it .

    +
  4. +
+ +

Installation Steps

+ +
    +
  1. +

    Start dependent services Storm2, Spark3, HBase4 & Kafka via Ambari5.

    +
  2. +
  3. +

    Install Eagle Ambari plugin

    + +
    $ /usr/hdp/current/eagle/bin/eagle-ambari.sh install
    +
    +
  4. +
  5. +

    Restart Ambari click on disable and enable Ambari back.

    +
  6. +
  7. +

    Add Eagle Service to Ambari. Click on “Add Service” on Ambari Main page

    + +

    AddService + Eagle Services

    +
  8. +
  9. +

    Add Policies and meta data required by running the below script.

    + +
    $ cd <eagle-home>
    +$ examples/sample-sensitivity-resource-create.sh
    +$ examples/sample-policy-create.sh
    +
    +
  10. +
+ +
+ +

Footnotes

+ +
+
    +
  1. +

    All mentions of “kafka” on this page represent Apache Kafka.

    +
  2. +
  3. +

    Apache Storm.

    +
  4. +
  5. +

    Apache Spark.

    +
  6. +
  7. +

    Apache HBase.

    +
  8. +
  9. +

    All mentions of “ambari” on this page represent Apache Ambari.

    +
  10. +
+
+ +
+
+ +
+
+ + + +
+
+
+
+
+
+
+ + + +
+
+Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. +
+
+Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation. +
+
+
+
+
+ + + + + + + + + + + + + http://git-wip-us.apache.org/repos/asf/eagle/blob/d6fed677/_site/docs/cloudera-integration.html ---------------------------------------------------------------------- diff --git a/_site/docs/cloudera-integration.html b/_site/docs/cloudera-integration.html new file mode 100644 index 0000000..20dbf64 --- /dev/null +++ b/_site/docs/cloudera-integration.html @@ -0,0 +1,377 @@ + + + + + + Eagle - Cloudera Integration + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+
+
+
+ + +
+
+
+
+
+
    +
  • Slide 1
  • +
+
+
+
+
+
+
+ + + +
+
+

Analyze Big Data Platforms For Security and Performance

+ +
+
+
+ + +
+
+
+ + +
+

Cloudera Integration

+

Since Eagle 0.4.0

+ +

Configuring Apache Eagle on Cloudera is very similar to configuring it on Hortonworks, but still there are some difference. +This tutorial is to address these issues before you continue to follow the tutorials originally prepared for Hortonworks.

+ +

Prerequisites

+ +

To get Apache Eagle works on Cloudera, we need:

+ +
    +
  • Zookeeper (installed through Cloudera Manager)
  • +
  • Kafka (installed through Cloudera Manager)
  • +
  • Storm (0.9.x or 0.10.x, installed manually)
  • +
  • Logstash (2.X, installed manually on NameNode)
  • +
+ +

Kafka

+ +

Configuration

+ +

There are two configurations needed to be mentioned:

+ +
    +
  • +

    Open Cloudera Manager and open “kafka” configuration, then set “zookeeper Root” to “/”.

    +
  • +
  • +

    If Kafka cannot be started successfully, check kafka’s log. If stack trace shows: “java.lang.OutOfMemoryError: Java heap space”. Increase heap size by setting "KAFKA_HEAP_OPTS"in /bin/kafka-server-start.sh.

    +
  • +
+ +

Example:

+ +
                  export KAFKA_HEAP_OPTS="-Xmx2G -Xms2G"
+
+ +

Verification

+ +
    +
  • Step1: create a kafka topic (here I created a topic called “test”, which will be used in logstash configuration file to receive hdfsAudit log messages from Cloudera.
  • +
+ +
bin/kafka-topics.sh --create --zookeeper 127.0.0.1:2181 --replication-factor 1 --partitions 1 --topic test
+
+ +
    +
  • Step2: check if topic has been created successfully.
  • +
+ +
bin/kafka-topics.sh --list --zookeeper 127.0.0.1:2181
+
+ +

this command will show all created topics.

+ +
    +
  • Step3: open two terminals, start “producer” and “consumer” separately.
  • +
+ +
/usr/bin/kafka-console-producer --broker-list hostname:9092 --topic test
+/usr/bin/kafka-console-consumer --zookeeper hostname:2181 --topic test
+
+ +
    +
  • Step4: type in some message in producer. If consumer can receive the messages sent from producer, then kafka is working fine. Otherwise please check the configuration and logs to identify the root cause of issues.
  • +
+ +

Logstash

+ +

Installation

+ +

You can follow logstash online doc to download and install logstash on your machine:

+ +

Or you can install it through yum if you are using centos:

+ +
    +
  • download and install the public signing key:
  • +
+ +
rpm --import  https://packages.elastic.co/GPG-KEY-elasticsearch
+
+ +
    +
  • Add the following lines in /etc/yum.repos.d/ directory in a file with a .repo suffix, for example logstash.repo.
  • +
+ +
[logstash-2.3]
+name=Logstash repository for 2.3.x packages
+baseurl=https://packages.elastic.co/logstash/2.3/centos
+gpgcheck=1
+gpgkey=https://packages.elastic.co/GPG-KEY-elasticsearch
+enabled=1
+
+ +
    +
  • Then install it using yum:
  • +
+ +
yum install logstash
+
+ +

Create conf file

+ +

Follow Apache Eagle online documentation to create logstash configuration file for Apache Eagle.

+ +

Start logstash

+ +
bin/logstash -f conf/first-pipeline.conf
+
+ +

Verification

+ +

Open a terminal and start a kafka consumer to see if it can receive the messages sent by logstash, if there is no message, double check the configuration parameters in conf file. Otherwise logstash is all set.

+ +

Apache Storm

+

As Apache Storm is not in Cloudera’s stack, we need to install Storm manually.

+ +

Installation

+ +

Download Apache Storm from here, the version you choose should be 0.10.x or 0.9.x release. +Then follow Apache Storm online doc) to install Apache Storm on your cluster.

+ +

In /etc/profile, add this:

+ +
export PATH=$PATH:/opt/apache-storm-0.10.1/bin/
+
+ +

save the profile and then type:

+ +
source /etc/profile 
+
+ +

to make it work.

+ +

Configuration

+ +

In storm/conf/storm.yaml, change the hostname to your own host.

+ +

Start Apache Storm

+ +

In Termial, type:

+ +
$: storm nimbus
+$: storm supervisor
+$: storm UI
+
+ +

Verification

+ +

Open storm UI in your browser, default URL is : http://hostname:8080/index.html.

+ +

Apache Eagle

+ +

To download and install Apache Eagle, please refer to Get Started with Sandbox. .

+ +

One thing need to mention is: in “/bin/eagle-topology.sh”, line 102:

+ +
			storm_ui=http://localhost:8080
+
+ +

If you are not using the default port number, change this to your own Storm UI url.

+ +

I know it takes time to finish these configuration, but now it is time to have fun! +Just try HDFS Data Activity Monitoring with Demo listed in HDFS Data Activity Monitoring.

+ + +
+
+ +
+
+ + + +
+
+
+
+
+
+
+ + + +
+
+Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. +
+
+Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation. +
+
+
+
+
+ + + + + + + + + + + + + http://git-wip-us.apache.org/repos/asf/eagle/blob/d6fed677/_site/docs/community.html ---------------------------------------------------------------------- diff --git a/_site/docs/community.html b/_site/docs/community.html new file mode 100644 index 0000000..9df21e5 --- /dev/null +++ b/_site/docs/community.html @@ -0,0 +1,396 @@ + + + + + + Eagle - Apache Eagle Community + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+
+
+
+ + +
+
+
+
+
+
    +
  • Slide 1
  • +
+
+
+
+
+
+
+ + + +
+
+

Analyze Big Data Platforms For Security and Performance

+ +
+
+
+ + +
+
+
+ + +
+

Apache Eagle Community

+

Mailing Lists

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Name    Email    SubscribeUnsubscribeArchive
User Mailling List    user@eagle.apache.org    subscribeunsubscribeeagle-user
Dev Mailling List    dev@eagle.apache.org    subscribeunsubscribeeagle-dev
Issues Mailling List    issues@eagle.apache.org    subscribeunsubscribeeagle-issues
Commits Mailling List    commits@eagle.apache.org    subscribeunsubscribeeagle-commits
+ +

Issue Tracker

+ +

https://issues.apache.org/jira/browse/EAGLE

+ +

Eagle Team

+ +

PMC Members

+ + + +

Commiters

+ + + +

Contributors

+ + + +

Project History

+ +
    +
  • Oct 20th, 2015 Eagle was officially open sourced by eBay Inc..
  • +
+ +

Credits

+ + + +

Social Network

+ + + +

Events and Meetups1

+ +

Conferences

+ + + +
+ +

Footnotes

+ +
+
    +
  1. +

    All mentions of “hadoop” on this page represent Apache Hadoop.

    +
  2. +
+
+ +
+
+ +
+
+ + + +
+
+
+
+
+
+
+ + + +
+
+Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. +
+
+Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation. +
+
+
+
+
+ + + + + + + + + + + + + http://git-wip-us.apache.org/repos/asf/eagle/blob/d6fed677/_site/docs/configuration.html ---------------------------------------------------------------------- diff --git a/_site/docs/configuration.html b/_site/docs/configuration.html new file mode 100644 index 0000000..83501ae --- /dev/null +++ b/_site/docs/configuration.html @@ -0,0 +1,686 @@ + + + + + + Eagle - Application Configuration + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+
+
+
+ + +
+
+
+
+
+
    +
  • Slide 1
  • +
+
+
+
+
+
+
+ + + +
+
+

Analyze Big Data Platforms For Security and Performance

+ +
+
+
+ + +
+
+
+ + +
+

Application Configuration

+

Apache Eagle (called Eagle in the following) requires you to create a configuration file under $EAGLE_HOME/conf/ for each application. Basically, there are some common properties shared, e.g., envContextConfig, eagleProps, and dynamicConfigSource. While dataSourceConfig differs from application to application.

+ +

In this page we take the following two application as examples

+ +
    +
  • HDFS Audit Log Configuration
  • +
  • Hive1 Query Log Configuration
  • +
+ +

HDFS Audit Log Configuration

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Class  Property Name  Description
envContextConfig  env  currently only Storm2 is supported.
   mode  local or cluster
   topologyName  in the format {site}-{topology-name}
   stormConfigFile  a storm configuration file for overriding some Storm properties
   parallelismConfig  parallelism for both Kafka3 consumer and alert executors
dataSourceConfig  topic  Kafka topic for audit log streaming, make sure it exists
   zkConnection*  ZooKeeper4 connection string, you can also specify multiple hosts in the form hostname1:port1,hostname2:port2, …
   zkConnectionTimeoutMS  zookeeper connection timeout
   fetchSize  kafka maximal message fetching size, default value is 1048586
   deserializerClass  org.apache.eagle.security.auditlog.HdfsAuditLogKafkaDeserializer
   transactionZKServers  ZooKeeper servers, you can also specify multiple hosts in the form hostname1,hostname2,hostname3
   transactionZKPort  ZooKeeper connection port
   transactionZKRoot  ZooKeeper chroot path for Eagle
   consumerGroupId  only for hdfsAuditLog
   transactionStateUpdateMS  default is 2000
alertExecutorConfigs  parallelism  default is 1
   partitioner  default value is eagle.alert.policy.DefaultPolicyPartitioner
   needValidation  true or false
eagleProps  site*  site name, such as sandbox, datacenter1, datacenter2
   dataSource  hdfsAuditLog
   dataJoinPollIntervalSec  time interval for retrieving data from HBase5
   mailHost*  SMTP server
   mailSmtpPort*  SMTP server port, default is 25
   mailDebug  true or false
   eagleService.host  Tomcat6 server host, default is localhost
   eagleService.port  9099
   eagleService.username  admin
   eagleService.password  secret
dynamicConfigSource  enabled  true or false, default is true
   initDelayMillis  default is 0
   delayMillis  default is 30000
+ +


+ +

Hive Query Log Configuration

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Class  Property Name  Description
envContextConfig  same as HDF   
dataSourceConfig  flavor  stormrunning
   zkQuorum*  ZooKeeper connection string, you can also specify multiple hosts in the form hostname1:port1,hostname2:port2,hostname3:port3
   zkRoot*  ZooKeeper chroot path for Eagle to store data, default is /jobrunning
   zkSessionTimeoutMs  ZooKeeper session timeout, default is 15000
   zkRetryTimes  ZooKeeper retry times, default is 3
   zkRetryInterval  default is 2000
   RMEndPoints*  yarn.resourcemanager.webapp.address. Default value is http://localhost:8088/
   HSEndPoint*  mapreduce.jobhistory.webapp.address. Default values is http://localhost:19888/
   partitionerCls  eagle.job.DefaultJobPartitionerImpl
alertExecutorConfigs  same as HDFS   
eagleProps  same as HDFS   
dynamicConfigSource  same as HDFS   
+ +


+ +
+ +

Footnotes

+ +
+
    +
  1. +

    All mentions of “hive” on this page represent Apache Hive.

    +
  2. +
  3. +

    All mentions of “storm” on this page represent Apache Storm.

    +
  4. +
  5. +

    All mentions of “kafka” on this page represent Apache Kafka.

    +
  6. +
  7. +

    All mentions of “zookeeper” on this page represent Apache ZooKeeper.

    +
  8. +
  9. +

    Apache HBase.

    +
  10. +
  11. +

    Apache Tomcat.

    +
  12. +
+
+ +
+
+ +
+
+ + + +
+
+
+
+
+
+
+ + + +
+
+Copyright © 2015 The Apache Software Foundation, Licensed under the Apache License, Version 2.0. +
+
+Apache Eagle, Eagle, Apache Hadoop, Hadoop, Apache HBase, HBase, Apache Hive, Hive, Apache Ambari, Ambari, Apache Spark, Spark, Apache Kafka, Kafka, Apache Storm, Storm, Apache Maven, Maven, Apache Tomcat, Tomcat, Apache Derby, Derby, Apache Cassandra, Cassandra, Apache ZooKeeper, ZooKeeper, Apache, the Apache feather logo, and the Apache project logo are trademarks of The Apache Software Foundation. +
+
+
+
+
+ + + + + + + + + + + + +