Return-Path: X-Original-To: apmail-flume-user-archive@www.apache.org Delivered-To: apmail-flume-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 587D011E27 for ; Fri, 12 Sep 2014 23:26:02 +0000 (UTC) Received: (qmail 76587 invoked by uid 500); 12 Sep 2014 23:26:01 -0000 Delivered-To: apmail-flume-user-archive@flume.apache.org Received: (qmail 76525 invoked by uid 500); 12 Sep 2014 23:26:01 -0000 Mailing-List: contact user-help@flume.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@flume.apache.org Delivered-To: mailing list user@flume.apache.org Received: (qmail 76515 invoked by uid 99); 12 Sep 2014 23:26:01 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Sep 2014 23:26:01 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of roshan@hortonworks.com designates 209.85.214.181 as permitted sender) Received: from [209.85.214.181] (HELO mail-ob0-f181.google.com) (209.85.214.181) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 12 Sep 2014 23:25:35 +0000 Received: by mail-ob0-f181.google.com with SMTP id wo20so1007179obc.40 for ; Fri, 12 Sep 2014 16:25:34 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=zg2FJ8tqmlvwm3kdGPgsAX5giHbA4wVRqJqXuZcpZ94=; b=ToycWTM+gV+SO5Rkml5RIteR765Cd30+Qt8S3GKQHSvqS4mL0ZnZAbC3a30gh3UIOZ PRJLiu87IowniF5Kb0zYt7tJ0jcYoUhaey+FRKbWs3QUz2SMAMKs7MQM029QYdC3RAy0 cf6GdFiloQnTawZFyXhUyeQH+xk3hh286xVxHIz1nwcfYyHGQpQUSKmJwf/WjshtkvoJ US47Y5RCXn4xcprpKFdwDnjJeUvcBh1YoQiMT8IwW2lw5H6zF88yfPN2+cG7JQCceaMu vcbtv+8ecH9SZhaJLOqXxi06N+zoxnTjMI4vLRMYG+GIuc/ALXDA0f9x+Cdzx3eTHEJ0 TdEg== X-Gm-Message-State: ALoCoQlgUJI8Fv5xz94BsVHJjUrvvwIBrccvs1uF+078k2YITp8L9leR9QCjnEo38HGvJY/ZWJJfzpgwZ25AZK7i5WxfIQH3XUjR89mKnzsvip9XEwuXLak= MIME-Version: 1.0 X-Received: by 10.60.45.7 with SMTP id i7mr12236371oem.2.1410564334123; Fri, 12 Sep 2014 16:25:34 -0700 (PDT) Received: by 10.182.146.51 with HTTP; Fri, 12 Sep 2014 16:25:34 -0700 (PDT) In-Reply-To: <52d8665ccda14e8da12470f13efa6531@BL2PR02MB404.namprd02.prod.outlook.com> References: <2A57EAD9-589E-4453-8C65-71CCF4859CD3@gmail.com> <52d8665ccda14e8da12470f13efa6531@BL2PR02MB404.namprd02.prod.outlook.com> Date: Fri, 12 Sep 2014 16:25:34 -0700 Message-ID: Subject: Re: flume on windows ? From: Roshan Naik To: "user@flume.apache.org" Content-Type: multipart/alternative; boundary=089e0149cb92118fdb0502e69a8e X-Virus-Checked: Checked by ClamAV on apache.org --089e0149cb92118fdb0502e69a8e Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Otis, Your mileage on trying to run the current release on windows will depend upon what components you are trying to run and what features you use. Off the top of my head... the available patches address several things spanning from a windows startup script, version info printing, some fie channel patches to disable dual checkpointing, to fixes in tests. You may not care about test related fixes. Morphline and kite sinks will most likely not work since Kite is not supported on Windows AFAIK. Here is a list of windows patches https://issues.apache.org/jira/issues/?jql=3Dproject%20%3D%20FLUME%20AND%20= status%20%3D%20%22Patch%20Available%22%20AND%20text%20~%20%22windows%22%20A= ND%20assignee%20in%20(roshan_naik) -roshan On Fri, Sep 12, 2014 at 9:32 AM, Paul Chavez wrote: > We=E2=80=99ve been running the 1.4 release of flume on windows for over = a year. > We had to do a custom build at first before it was initially released to > pick up a SpoolDir source issue. > > > > I use winsw (https://github.com/kohsuke/winsw/wiki) to wrap the java > command, with 64-bit JDK6. > > > > The java command line switches that runs the agent are: > > > > -Xms1500m -Xmx4000m -Dflume.monitoring.type=3DHTTP > -Dflume.monitoring.port=3D41414 > -Dlog4j.configuration=3Dfile:///C:\Services\Flume\flume-ng\conf\log4j.pro= perties > -cp "C:\Services\Flume\flume-ng\lib\*" org.apache.flume.node.Application = -f > C:\Services\Flume\flume_appserver.conf -n appserver > > > > > > > > *From:* Otis Gospodnetic [mailto:otis.gospodnetic@gmail.com] > *Sent:* Thursday, September 11, 2014 9:19 PM > *To:* user@flume.apache.org > *Subject:* Re: flume on windows ? > > > > Hi Roshan, > > > > I haven't tried Flume on Windows yet..... but are you saying that one > currently cannot run the latest Flume release under Windows (until those > patches are committed)? > > > > Thanks, > > Otis > -- > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > > Solr & Elasticsearch Support * http://sematext.com/ > > > > > > > > On Thu, Sep 11, 2014 at 10:55 PM, Roshan Naik > wrote: > > Windows patches are waiting to be committed. > > > > As of now you have two ways.. > > - Look for all the patches with 'Windows' in the title, manually apply > them to a locally checked out version of flume source and build. > > - Use flume from HDP for windows > > > > -roshan > > > > > > > > On Thu, Sep 11, 2014 at 7:06 PM, terreyshih wrote: > > Hi, > > How can I run the agent on windows environment ? > > thanks, > Terrey > > > > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential= , > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified th= at > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediate= ly > and delete it from your system. Thank You. > > > --=20 CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to= =20 which it is addressed and may contain information that is confidential,=20 privileged and exempt from disclosure under applicable law. If the reader= =20 of this message is not the intended recipient, you are hereby notified that= =20 any printing, copying, dissemination, distribution, disclosure or=20 forwarding of this communication is strictly prohibited. If you have=20 received this communication in error, please contact the sender immediately= =20 and delete it from your system. Thank You. --089e0149cb92118fdb0502e69a8e Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Otis,
=C2=A0 =C2=A0Your mileage on trying to run the c= urrent release on windows will depend upon what components you are trying t= o run and what features you use. Off the top of my head... the available pa= tches address several things spanning from a windows startup script, versio= n info printing, some fie channel patches to disable dual checkpointing, to= fixes in tests. =C2=A0You may not care about test related fixes. =C2=A0Mor= phline and kite sinks will most likely not work since Kite is not supported= on Windows AFAIK.


Here is a list o= f windows patches


-roshan

On Fri, Sep 12, 2014 at 9:32 AM, Paul Chavez &l= t;pchavez@ntent.com<= /a>> wrote:

We=E2=80=99ve been runnin= g the 1.4 release of flume on windows for over a year. We had to do a custo= m build at first before it was initially released to pick up a SpoolDir source issue.

=C2=A0

I use winsw (https://github.com/= kohsuke/winsw/wiki) to wrap the java command, with 64-bit JDK6.<= u>

=C2=A0

The java command line swi= tches that runs the agent are:

=C2=A0

-Xms1500m -Xmx4000m -Dflu= me.monitoring.type=3DHTTP -Dflume.monitoring.port=3D41414 -Dlog4j.configura= tion=3Dfile:///C:\Services\Flume\flume-ng\conf\log4j.properties -cp "C:\Services\Flume\flume-ng\lib\*" org.apache.flume.node.App= lication -f C:\Services\Flume\flume_appserver.conf -n appserver

=C2=A0

=C2=A0

=C2=A0

From: Otis G= ospodnetic [mailto:otis.gospodnetic@gmail.com]
Sent: Thursday, September 11, 2014 9:19 PM
To: user@= flume.apache.org
Subject: Re: flume on windows ?

=C2=A0

Hi Roshan,

=C2=A0

I haven't tried Flume on Windows yet..... but ar= e you saying that one currently cannot run the latest Flume release under W= indows (until those patches are committed)?

=C2=A0

Thanks,

Otis
--

Monitoring * Alerting * Anomaly Detection * Centrali= zed Log Management

Solr & Elasticsearch Support *=C2=A0http://sematext.com/

=C2=A0

=C2=A0

=C2=A0

On Thu, Sep 11, 2014 at 10:55 PM, Roshan Naik <roshan@hortonwork= s.com> wrote:

Windows patches are waiting to be committed.<= u>

=C2=A0

As of now you have two ways..=C2=A0

=C2=A0- Look for all the patches with 'Windows&#= 39; in the title, manually apply them to a locally checked out version of f= lume source and build.=C2=A0

=C2=A0- Use flume from HDP for windows=

=C2=A0

-roshan

=C2=A0

=C2=A0

CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to= which it is addressed and may contain information that is confidential, pr= ivileged and exempt from disclosure under applicable law. If the reader of = this message is not the intended recipient, you are hereby notified that any printing, copying, disseminati= on, distribution, disclosure or forwarding of this communication is strictl= y prohibited. If you have received this communication in error, please cont= act the sender immediately and delete it from your system. Thank You.

=C2=A0



CONFIDENTIALITY NOTICE
NOTICE: This message is = intended for the use of the individual or entity to which it is addressed a= nd may contain information that is confidential, privileged and exempt from= disclosure under applicable law. If the reader of this message is not the = intended recipient, you are hereby notified that any printing, copying, dis= semination, distribution, disclosure or forwarding of this communication is= strictly prohibited. If you have received this communication in error, ple= ase contact the sender immediately and delete it from your system. Thank Yo= u. --089e0149cb92118fdb0502e69a8e--