Return-Path: X-Original-To: apmail-cassandra-commits-archive@www.apache.org Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3899B18536 for ; Fri, 18 Mar 2016 14:16:34 +0000 (UTC) Received: (qmail 18685 invoked by uid 500); 18 Mar 2016 14:16:34 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 18657 invoked by uid 500); 18 Mar 2016 14:16:34 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 18400 invoked by uid 99); 18 Mar 2016 14:16:33 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 18 Mar 2016 14:16:33 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id B2DC02C1F75 for ; Fri, 18 Mar 2016 14:16:33 +0000 (UTC) Date: Fri, 18 Mar 2016 14:16:33 +0000 (UTC) From: "Aleksey Yeschenko (JIRA)" To: commits@cassandra.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (CASSANDRA-4047) Bulk hinting MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CASSANDRA-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15201523#comment-15201523 ] Aleksey Yeschenko commented on CASSANDRA-4047: ---------------------------------------------- [~pkolaczk] Please reopen if anything has changed since Dec 2014 and this is now relevant for Spark. > Bulk hinting > ------------ > > Key: CASSANDRA-4047 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4047 > Project: Cassandra > Issue Type: Improvement > Reporter: Brandon Williams > Labels: hints > Attachments: 4047-2.0-wip.txt, 4047-wip.txt > > > With the introduction of the BulkOutputFormat, there may be cases where someone would like to tolerate node failures and have the job complete, but afterwards since we streamed they have to repair or rely on read repair. We don't currently have any way of hinting streams, but a node could take a snapshot before acknowledging the stream session, then remember to send the files in the snapshot to the unavailable nodes when they come back up. This isn't quite ideal since of course the node may have compacted these files, however it's much simpler than any sort of key tracking at this scale. -- This message was sent by Atlassian JIRA (v6.3.4#6332)