Return-Path: X-Original-To: apmail-hadoop-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 54ED610FE6 for ; Sat, 1 Mar 2014 09:59:49 +0000 (UTC) Received: (qmail 88668 invoked by uid 500); 1 Mar 2014 09:59:42 -0000 Delivered-To: apmail-hadoop-user-archive@hadoop.apache.org Received: (qmail 88120 invoked by uid 500); 1 Mar 2014 09:59:40 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 88113 invoked by uid 99); 1 Mar 2014 09:59:40 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2014 09:59:40 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of raofengyun@gmail.com designates 209.85.128.169 as permitted sender) Received: from [209.85.128.169] (HELO mail-ve0-f169.google.com) (209.85.128.169) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 01 Mar 2014 09:59:32 +0000 Received: by mail-ve0-f169.google.com with SMTP id pa12so1880261veb.28 for ; Sat, 01 Mar 2014 01:59:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ps9jK1l1MPXiZPKb5bVpjojb9/65l/5wUm5a08da+Cw=; b=X5aHXLxRz0gGHKMzgBqDds1jJAnmV8QfEmkmi1hLrkNPjQQPrC3v6YQVO2MJNq46l8 Hgxik5OR5D2Wn4COFbsBnAOJ3eJFx962hs/H3ejS4XDwtgOet3v1pxuYOUQzSLFCvuRU ctirQ/pCY93lGngLpIdaSH8jJpHBqIFe/rHXelxXB5y5vTAvbzKOa48S/vG/hiLGJCmq wlmNmaJutEd/CS+nZXX2zPcvo1eUe2LuZNECOBwSu3lmjcOVQueWPtyjQ/tLIz6awfha WhLnkkIdoqaivdGMmpv7DXH0raNbzBzzjm9CfsmZJomkdfVEwXbZmq9ZZrUFMkO1irkG remw== MIME-Version: 1.0 X-Received: by 10.52.65.171 with SMTP id y11mr143909vds.52.1393667951735; Sat, 01 Mar 2014 01:59:11 -0800 (PST) Received: by 10.220.232.68 with HTTP; Sat, 1 Mar 2014 01:59:11 -0800 (PST) In-Reply-To: References:

Date: Sat, 1 Mar 2014 17:59:11 +0800 Message-ID: Subject: Re: Map-Reduce: How to make MR output one file an hour? From: Fengyun RAO To: user@hadoop.apache.org Cc: akumarb2010@gmail.com Content-Type: multipart/alternative; boundary=20cf307abdab32bae504f3889b54 X-Virus-Checked: Checked by ClamAV on apache.org --20cf307abdab32bae504f3889b54 Content-Type: text/plain; charset=ISO-8859-1 Thanks, but how to set reducer number to X? X is dependent on input (run-time), which is unknown on job configuration (compile time). 2014-03-01 17:44 GMT+08:00 AnilKumar B : > Hi, > > Write the custom partitioner on and as you mentioned set > #reducers to X. > > > --20cf307abdab32bae504f3889b54 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Thanks, but how to set reducer number to X? X is dependent= on input (run-time), which is unknown on job configuration (compile time).=

2014-03= -01 17:44 GMT+08:00 AnilKumar B <akumarb2010@gmail.com>:=

Hi,

Write= the custom partitioner on <timestamp> and as you mentioned set #redu= cers to X.

--20cf307abdab32bae504f3889b54--