Return-Path: X-Original-To: apmail-asterixdb-notifications-archive@minotaur.apache.org Delivered-To: apmail-asterixdb-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7A327173D0 for ; Fri, 18 Sep 2015 20:48:08 +0000 (UTC) Received: (qmail 78715 invoked by uid 500); 18 Sep 2015 20:48:08 -0000 Delivered-To: apmail-asterixdb-notifications-archive@asterixdb.apache.org Received: (qmail 78689 invoked by uid 500); 18 Sep 2015 20:48:08 -0000 Mailing-List: contact notifications-help@asterixdb.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@asterixdb.incubator.apache.org Delivered-To: mailing list notifications@asterixdb.incubator.apache.org Received: (qmail 78680 invoked by uid 99); 18 Sep 2015 20:48:08 -0000 Received: from Unknown (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Sep 2015 20:48:08 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id E20EE1A2510 for ; Fri, 18 Sep 2015 20:48:07 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.774 X-Spam-Level: * X-Spam-Status: No, score=1.774 tagged_above=-999 required=6.31 tests=[KAM_ASCII_DIVIDERS=0.8, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.006] autolearn=disabled Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id tWdEkY9apPdK for ; Fri, 18 Sep 2015 20:48:06 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with SMTP id 0E517207D6 for ; Fri, 18 Sep 2015 20:48:05 +0000 (UTC) Received: (qmail 78529 invoked by uid 99); 18 Sep 2015 20:48:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Sep 2015 20:48:04 +0000 Date: Fri, 18 Sep 2015 20:48:04 +0000 (UTC) From: "Ian Maxon (JIRA)" To: notifications@asterixdb.incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ASTERIXDB-1102) Add a TEXT-like data type to enable storing the string longer than 64K MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ASTERIXDB-1102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14876364#comment-14876364 ] Ian Maxon commented on ASTERIXDB-1102: -------------------------------------- We just use a default type for the literal AFAIK. For example, once upon a time you would say something like {"foo":42} and that'd be an int32, but it's an int64 now. There's ways to express the fact that a literal should be of a certain type, like 42i32 vs 42i64, but of course that'd be specific to ADM and not applicable to JSON. That's kind of why I couldn't imagine a totally clean solution to this if there's some real performance difference between string and text. If text turns out to just be like string with a wider length field though, it might not even make sense to keep the old format around as something user visible, just as long as we can read it in existing datasets. > Add a TEXT-like data type to enable storing the string longer than 64K > ---------------------------------------------------------------------- > > Key: ASTERIXDB-1102 > URL: https://issues.apache.org/jira/browse/ASTERIXDB-1102 > Project: Apache AsterixDB > Issue Type: Improvement > Components: Data Model > Reporter: Jianfeng Jia > Assignee: Jianfeng Jia > > The current "String" type can't handle the string longer than 64K. The first reason is that we are using java DataOutputStream to serialize it. It stores the length using two bytes. However, it should serve the basic requirement for "string" type. > We need a special TEXT-like datatype to deal with long strings. And probably add some search-related functionalities. -- This message was sent by Atlassian JIRA (v6.3.4#6332)