Return-Path: X-Original-To: apmail-crunch-user-archive@www.apache.org Delivered-To: apmail-crunch-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6974C19922 for ; Fri, 15 Apr 2016 12:34:40 +0000 (UTC) Received: (qmail 33916 invoked by uid 500); 15 Apr 2016 12:34:40 -0000 Delivered-To: apmail-crunch-user-archive@crunch.apache.org Received: (qmail 33873 invoked by uid 500); 15 Apr 2016 12:34:40 -0000 Mailing-List: contact user-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@crunch.apache.org Delivered-To: mailing list user@crunch.apache.org Received: (qmail 33855 invoked by uid 99); 15 Apr 2016 12:34:40 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 15 Apr 2016 12:34:40 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id BC3B7180225 for ; Fri, 15 Apr 2016 12:34:39 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id YgpiZhegZh8Q for ; Fri, 15 Apr 2016 12:34:37 +0000 (UTC) Received: from mail-oi0-f50.google.com (mail-oi0-f50.google.com [209.85.218.50]) by mx2-lw-eu.apache.org (ASF Mail Server at mx2-lw-eu.apache.org) with ESMTPS id EA4AE5F571 for ; Fri, 15 Apr 2016 12:34:36 +0000 (UTC) Received: by mail-oi0-f50.google.com with SMTP id p188so122315581oih.2 for ; Fri, 15 Apr 2016 05:34:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to; bh=iLN61dJ4ELXn+0L9Z91gbgj+68NN5iBY/6NDBmfSxuA=; b=XMkghj2hJGUi9beAf+WWETC+hl/m1hgw44cjB4Wf415lk/WD0Tm+J/AW+DIu15ZI7N laAN5DvCP+uj3CmLOaTLjo7H2kl8PPeI4wI6qCP6GRPaIiUnFKlRTfhR2Lzf/sWuHLqu vWQuF65sxVsrpoiGzPG3N/JoMoYZCm3Gx+JPhaWKaBDSDOCQjOvxgE7oZsEd/oCMrwNT dlAN60H4av9LIPognR1kBovAqagQ2TAGeCHiAicRykUrmEUskW0yvdnNs15I0PfrhaNL YkRJhTV90JVn0tZhoKhE4tbMNa0r38vJE8wYPvm7rPYlPLNucAQQGG2/OZ65vIzpMQfh js5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to; bh=iLN61dJ4ELXn+0L9Z91gbgj+68NN5iBY/6NDBmfSxuA=; b=RC5N8ubMkO9MZJpGnh4lf5NPUVMf2rxMQr6lx8ngvnJSmgxMNFRo5+ow5Y7IgQeM26 rS2uqTlmePR7Wyn7X1umxHUocL9rRROOcarU8R53ZOKgYNXkvTVYoYwsY+AOFiklP9CW ApwN6g/38P03HqdRIw8ufEVXovw7QlXNaBMFEWFR3W/glnBTbr/gKblkuyDS9Q6vdmmn 7Mg868D1sRsHE++F8cwb0MZLwBhgsVxbhB5ZdDHY4IZ5T29Zz+npoAKpCvdHz2JKJPkJ 6VRAA1fHSSCbyjDsfMevn1tbcFDPP/CJZk5ifA8U5TzzkyyvpwPB7Zdy4Gth/PZa7BK7 QLqw== X-Gm-Message-State: AOPr4FUz4lRvmbHMRGJ2e6o9GKMF0lzrYi4Q/IfrNA11Pv7yLec3bs9/3zzwmHGD2FiDVAK396lHcU5rReEpCg== MIME-Version: 1.0 X-Received: by 10.157.61.225 with SMTP id l88mr10874224otc.95.1460723675868; Fri, 15 Apr 2016 05:34:35 -0700 (PDT) Received: by 10.202.196.212 with HTTP; Fri, 15 Apr 2016 05:34:35 -0700 (PDT) In-Reply-To: References: Date: Fri, 15 Apr 2016 07:34:35 -0500 Message-ID: Subject: Re: Using counters in OutputFormat From: Micah Whitacre To: user@crunch.apache.org Content-Type: multipart/alternative; boundary=001a11492d1cd0b84a0530853b18 --001a11492d1cd0b84a0530853b18 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Would this issue make your life easier? https://issues.apache.org/jira/browse/CRUNCH-579 On Fri, Apr 15, 2016 at 7:21 AM, Cl=C3=A9ment MATHIEU wrote: > Hi, > > While writing a Target based on FileTargetImpl and a custom OutputFormat = I > discovered that Crunch seems to prevent OutputFormats from using counters > (CrunchOutputs#getTaskContext instanciates TaskAttemptContextImpl with it= s > two args ctor which means that reporter is a black hole). > > Is there any technical reason to a such limitation ? Wouldn't it be > possible to pass baseContext's reporter as third argument ? > > Thanks, > > Clement > --001a11492d1cd0b84a0530853b18 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Would this issue make your life easier?=C2=A0
<= br>
On Fri, Apr 15, 2016 at 7:21 AM, Cl=C3=A9ment= MATHIEU <clement@unportant.info> wrote:
Hi,

While writing a Target based on FileTargetImpl and a custom OutputFormat I = discovered that Crunch seems to prevent OutputFormats from using counters (= CrunchOutputs#getTaskContext instanciates TaskAttemptContextImpl with its t= wo args ctor which means that reporter is a black hole).

Is there any technical reason to a such limitation ? Wouldn't it be pos= sible to pass baseContext's reporter as third argument ?

Thanks,

Clement

--001a11492d1cd0b84a0530853b18--