Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: jira@apache.org
Date: Thu, 30 Nov 2017 20:58:00 +0000 (UTC)
From: "Keith Turner (JIRA)" <jira@apache.org>
To: notifications@accumulo.apache.org
Message-ID: <JIRA.13119773.1511212166000.359003.1512075480682@Atlassian.JIRA>
In-Reply-To: <JIRA.13119773.1511212166000@Atlassian.JIRA>
References: <JIRA.13119773.1511212166000@Atlassian.JIRA> <JIRA.13119773.1511212166097@jira-lw-us.apache.org>
Subject: [jira] [Assigned] (ACCUMULO-4744) Using RFile API with cache and
 multiple files hides data
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 30 Nov 2017 20:58:05 -0000


     [ https://issues.apache.org/jira/browse/ACCUMULO-4744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Keith Turner reassigned ACCUMULO-4744:
--------------------------------------

    Assignee: Keith Turner

> Using RFile API with cache and multiple files hides data
> --------------------------------------------------------
>
>                 Key: ACCUMULO-4744
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-4744
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.8.0, 1.8.1
>            Reporter: Keith Turner
>            Assignee: Keith Turner
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 1.8.2, 2.0.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Noticed this bug in source code while working on ACCUMULO-4641.  When using the RFile API introduced in 1.8 to read from multiple files with cache enabled, not all data may be seen.  This happens because internally the code gives all input sources the same cache id.  Therefore index and data blocks from multiple files collide in the cache.
> This bug does not happen when reading data through tserver, only the RFile API.
> {code:java}
>   Scanner scanner =
>        RFile.newScanner()
>            .from(file1, file2, file3)   //multiple input files
>            .withFileSystem(localFs)
>            .withIndexCache(1000000)   //enabled cache 
>            .withDataCache(10000000)  //enabled cache
>            .build();
> {code}


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)