ambari-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jayush Luniya (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (AMBARI-14714) [Umbrella] Multi Everything Architecture
Date Wed, 15 Mar 2017 18:15:42 GMT

     [ https://issues.apache.org/jira/browse/AMBARI-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jayush Luniya updated AMBARI-14714:
-----------------------------------
    Description: 
*Multi Stack Services*
Scenario: Deploy HDP & HDF services in same cluster
- Deploy HDFS from HDP and Kafka, Storm, NiFI from HDF in the same cluster.

*Multiple Service Instances*
Scenario: Multi service instances on same version
- Cluster includes instance of ZooKeeper vX which is being used by HDFS, YARN.
- User wants to add instance of ZooKeeper vX which is being used by STORM and KAFKA
Scenario: Multi service instances on different versions
- Cluster includes instance of SPARK vX.
- User wants to add additional instance of SPARK vY.

*Multi Host Component Instances*
Scenario: Multi component instances from a service instance on the same host
- Single host with 128GB RAM, 16 (actual) Cores, 12*4TB disks.
- Single instance of KAFKA broker is unable to utilize all the resources on the host. 
- User wants to scale up performance by deploying multiple instances of the KAFKA brokers/host.

*Multi Cluster*
Scenario: Manage multiple Hadoop clusters under single Ambari Server
- Customer has multiple small Hadoop clusters and would like to manage and monitor them with
a single Ambari Server instance.

*Multi Yarn Hosted Services*
Scenario: HBase on YARN
- Deploy second instance of HBase as a long running YARN service.
- Manage YARN hosted service similar to traditional hosted services. 
- First class support for Yarn hosted services.
Scenario: Credit Fraud Detection YARN Assembly
- YARN Assembly can have its own ZK, KAFKA etc.
- Manage YARN Assemblies as first-class citizen.







  was:
*Multi Stack Services*
# Scenario: Deploy HDP & HDF services in same cluster
- Deploy HDF services in an HDP cluster (Nifi from HDF, HDFS from HDP stack).

*Multiple Service Instances*
# Scenario: Multi service instances on same version
- Cluster includes instance of ZooKeeper vX which is being used by HDFS, YARN.
- User wants to add instance of ZooKeeper vX which is being used by STORM and KAFKA
# Scenario: Multi service instances on different versions
- Cluster includes instance of SPARK vX.
- User wants to add additional instance of SPARK vY.


# Deploy cluster with multiple instances of a service
# 
Provide an ability to handle multiple instances of a Service in a given cluster. In addition,
provide ability for a Stack definition to handle multiple versions of a given Service (which
than can have 0 or more instances in a given cluster).


> [Umbrella] Multi Everything Architecture
> ----------------------------------------
>
>                 Key: AMBARI-14714
>                 URL: https://issues.apache.org/jira/browse/AMBARI-14714
>             Project: Ambari
>          Issue Type: Epic
>          Components: stacks
>    Affects Versions: 2.4.0
>            Reporter: Jeff Sposetti
>            Assignee: Jayush Luniya
>            Priority: Critical
>             Fix For: 3.0.0
>
>
> *Multi Stack Services*
> Scenario: Deploy HDP & HDF services in same cluster
> - Deploy HDFS from HDP and Kafka, Storm, NiFI from HDF in the same cluster.
> *Multiple Service Instances*
> Scenario: Multi service instances on same version
> - Cluster includes instance of ZooKeeper vX which is being used by HDFS, YARN.
> - User wants to add instance of ZooKeeper vX which is being used by STORM and KAFKA
> Scenario: Multi service instances on different versions
> - Cluster includes instance of SPARK vX.
> - User wants to add additional instance of SPARK vY.
> *Multi Host Component Instances*
> Scenario: Multi component instances from a service instance on the same host
> - Single host with 128GB RAM, 16 (actual) Cores, 12*4TB disks.
> - Single instance of KAFKA broker is unable to utilize all the resources on the host.

> - User wants to scale up performance by deploying multiple instances of the KAFKA brokers/host.
> *Multi Cluster*
> Scenario: Manage multiple Hadoop clusters under single Ambari Server
> - Customer has multiple small Hadoop clusters and would like to manage and monitor them
with a single Ambari Server instance.
> *Multi Yarn Hosted Services*
> Scenario: HBase on YARN
> - Deploy second instance of HBase as a long running YARN service.
> - Manage YARN hosted service similar to traditional hosted services. 
> - First class support for Yarn hosted services.
> Scenario: Credit Fraud Detection YARN Assembly
> - YARN Assembly can have its own ZK, KAFKA etc.
> - Manage YARN Assemblies as first-class citizen.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message