Return-Path: X-Original-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id DBAC3F70E for ; Thu, 9 May 2013 15:43:26 +0000 (UTC) Received: (qmail 51867 invoked by uid 500); 9 May 2013 15:43:21 -0000 Delivered-To: apmail-hadoop-hdfs-user-archive@hadoop.apache.org Received: (qmail 51703 invoked by uid 500); 9 May 2013 15:43:21 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 51693 invoked by uid 99); 9 May 2013 15:43:20 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 May 2013 15:43:20 +0000 X-ASF-Spam-Status: No, hits=1.7 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of yypvsxf19870706@gmail.com designates 209.85.216.182 as permitted sender) Received: from [209.85.216.182] (HELO mail-qc0-f182.google.com) (209.85.216.182) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 May 2013 15:43:15 +0000 Received: by mail-qc0-f182.google.com with SMTP id c10so1704956qcz.41 for ; Thu, 09 May 2013 08:42:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:x-received:date:message-id:subject:from:to :content-type; bh=dOKytZhoObvScbvMBKrYY4zpjaDfO/R2adOb2EeXwcw=; b=hIDGbS2CbezDpaIk/GqAA8JGgKEczb+Op2/ORtyvpJfu4Yf60KNPsd1Ymu8t+DqZQR SmdukpPMtfdN8Yy4SHYZqIxVr1OJSLA4wysbyY8bf6AbT9R5usuYzdZVgt7jhyRc7wgt qlazOoXWC+zu2uY+9lZH5j1WhF47nIFg8X5K5qDFCoIeqzs+dR9Tc1DWkkzYys0ToDcp +V+9QDL5sYJGiourfq4Y8rw3hjqii/ectI4fiLTdomE6yWbYo9P1tTd+PPiIsbbSuFa8 AY7BrPQ+qCOirgAPKW04KVARBJnZ0z7a4pCubqbzSjFWXjbWYSC6pVtMSmuWoTZVZqvy wYbg== MIME-Version: 1.0 X-Received: by 10.224.126.69 with SMTP id b5mr8907264qas.23.1368114175046; Thu, 09 May 2013 08:42:55 -0700 (PDT) Received: by 10.49.72.233 with HTTP; Thu, 9 May 2013 08:42:54 -0700 (PDT) Received: by 10.49.72.233 with HTTP; Thu, 9 May 2013 08:42:54 -0700 (PDT) Date: Thu, 9 May 2013 23:42:54 +0800 Message-ID: Subject: issues with decrease the default.block.size From: YouPeng Yang To: user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001a11c303b06a8ae604dc4ae7b9 X-Virus-Checked: Checked by ClamAV on apache.org --001a11c303b06a8ae604dc4ae7b9 Content-Type: text/plain; charset=ISO-8859-1 hi ALL I am going to setup a new hadoop environment, .Because of there are lots of small files, I would like to change the default.block.size to 16MB other than adopting the ways to merge the files into large enough (e.g using sequencefiles). I want to ask are there any bad influences or issues? Regards --001a11c303b06a8ae604dc4ae7b9 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

hi ALL
=A0=A0=A0
=A0=A0=A0=A0 I am going to setup a new hadoop=A0 environment, .Because=A0 o= f=A0 there=A0 are lots of small=A0 files, I would=A0 like to change=A0 the= =A0 default.block.size to 16MB
other than adopting the ways to merge=A0 the files into large=A0 enough (e= .g using=A0 sequencefiles).
=A0=A0=A0 I want to ask are=A0 there=A0 any bad influences or issues?

Regards
=A0=A0

--001a11c303b06a8ae604dc4ae7b9--