Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.223.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CA+NDPec=5Sgk4cF5hqHYYgx4a=x-seY1kox0f0p7FhH-MuXdNw@mail.gmail.com>
References: 
 <CA+NDPec=5Sgk4cF5hqHYYgx4a=x-seY1kox0f0p7FhH-MuXdNw@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Fri, 11 Jan 2013 11:34:54 +0530
Message-ID: 
 <CAOcnVr0kQXnR=d5n4MJQDjoV=8-P6ysXoDDisQUJ5gO=maO30A@mail.gmail.com>
Subject: Re: queues in haddop
To: "<user@hadoop.apache.org>" <user@hadoop.apache.org>
Content-Type: text/plain; charset=ISO-8859-1

Your question in unclear: HDFS has no queues for ingesting data (it is
a simple, distributed FileSystem). The Hadoop M/R and Hadoop YARN
components have queues for processing data purposes.

On Fri, Jan 11, 2013 at 8:42 AM, Panshul Whisper <ouchwhisper@gmail.com> wrote:
> Hello,
>
> I have a hadoop cluster setup of 10 nodes and I an in need of implementing
> queues in the cluster for receiving high volumes of data.
> Please suggest what will be more efficient to use in the case of receiving
> 24 Million Json files.. approx 5 KB each in every 24 hours :
> 1. Using Capacity Scheduler
> 2. Implementing RabbitMQ and receive data from them using Spring Integration
> Data pipe lines.
>
> I cannot afford to loose any of the JSON files received.
>
> Thanking You,
>
> --
> Regards,
> Ouch Whisper
> 010101010101


-- 
Harsh J