Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 296EC200C80 for ; Thu, 25 May 2017 20:38:09 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 27FE1160BCA; Thu, 25 May 2017 18:38:09 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 474D8160BB4 for ; Thu, 25 May 2017 20:38:08 +0200 (CEST) Received: (qmail 73455 invoked by uid 500); 25 May 2017 18:38:07 -0000 Mailing-List: contact dev-help@atlas.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@atlas.incubator.apache.org Delivered-To: mailing list dev@atlas.incubator.apache.org Received: (qmail 73444 invoked by uid 99); 25 May 2017 18:38:07 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 25 May 2017 18:38:07 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 15209CD72C for ; Thu, 25 May 2017 18:38:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -100.002 X-Spam-Level: X-Spam-Status: No, score=-100.002 tagged_above=-999 required=6.31 tests=[RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id z4GlQumfK4JY for ; Thu, 25 May 2017 18:38:06 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTP id 1237D5F477 for ; Thu, 25 May 2017 18:38:06 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 60D7AE0BDF for ; Thu, 25 May 2017 18:38:05 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 82B7C21B57 for ; Thu, 25 May 2017 18:38:04 +0000 (UTC) Date: Thu, 25 May 2017 18:38:04 +0000 (UTC) From: "Mandy Chessell (JIRA)" To: dev@atlas.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ATLAS-1768) Create common types for Open Metadata MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Thu, 25 May 2017 18:38:09 -0000 [ https://issues.apache.org/jira/browse/ATLAS-1768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025180#comment-16025180 ] Mandy Chessell commented on ATLAS-1768: --------------------------------------- These are the comments added by [~davidrad] in Jira ATLAS-1410. 210 I wonder if language should be a code table value - or more generally an valid value from reference data ===> It is a descriptive field that we are not going to process - it is for human consumption so no value in creating a code table that will need to be synchronized between all of the metadata repositories. We can add language identifier - such as "En" is we need to process this in the future. 210 I am wondering about usage. Should this also be a code table - it seems more structural than the description ==> the usage is a description and examples of how the term is used - it is a string. Look 220 I suggest the supercategory to the subcategory be a composition (filled in diamond) relationship. ==> This would not be correct because the subcategory is not deleted when the supercategory is deleted. It remains linked to the Glossary object. I have added an aggregation (open diamond) to show that the category is collecting subcategories. 230 I think the GlossaryCategory role name should be categories rather than category ==> done 240 I wonder about the "to" and "from" ends of the related term as they imply a direction - for a SYNONYM and TRANSLATION there is no direction. It is almost like synonyms and transactions should be in a synonym group or translation group respectively. Maybe we introduce an equivalence group concept, where everything in the group is related to everything else in the group. This would help for tag propagation for these terms. ==> I think this over-complicates the model and would make it difficult to map to IGC. Typically the synonyms are in different glossaries, connecting the canonical model. I would be nervous about doing tag propagation along glossary relationships that are not from the spine model. I don't think we have a way in the current Atlas model to constrain the number of classifications to 0..1. ==> Classifications have a cardinality - are you saying it does not work? Or something else? > Create common types for Open Metadata > ------------------------------------- > > Key: ATLAS-1768 > URL: https://issues.apache.org/jira/browse/ATLAS-1768 > Project: Atlas > Issue Type: New Feature > Components: atlas-core > Affects Versions: 0.9-incubating > Reporter: Mandy Chessell > Assignee: Mandy Chessell > Labels: VirtualDataConnector > > This JIRA describes a proposal for standard types for open metadata entities and relationships. For example, glossaries, database definitions, rules, policies, ... > The value of having standard definitions for metadata is to enable type safe APIs and business level UIs plus be able to exchange metadata between different instances of metadata repositories. > The implementation of these common types is divided into 8 areas: > * Area 0 - for extensions to Apache Atlas's base model > * Area 1 - for definitions of the data-related assets we are governing and using > * Area 2 - for a glossary of meanings and semantic relationships > * Area 3 - for information about asset use, crowd-sourced definitions and collaboration around the data-related assets > * Area 4 - for governance such as policies, rules and classifications > * Area 5 - for reference models and reference data > * Area 6 - for metadata discovery processes (see https://issues.apache.org/jira/browse/ATLAS-1748) > * Area 7 - for lineage > Adaptation and flexibility are key in metadata environments so these common definitions must be extensible - and we still need to support the ad hoc definition of new types in Atlas. > Apache Atlas supports meta-types that are used in the definition of new types. These are currently enumeration, struct, classification and entity. JIRA https://issues.apache.org/jira/browse/ATLAS-1690 adds relationships to this list. The open metadata models make use of all of these meta-types. These are represented by sterotypes on the classes of the open metadata definitions. > The Atlas wiki has the models as a set of linked pages which are probably the easiest way to view the models. > Start here: https://cwiki.apache.org/confluence/display/ATLAS/Building+out+the+Apache+Atlas+Typesystem -- This message was sent by Atlassian JIRA (v6.3.15#6346)