Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Message-ID: <55705F89.40801@gmail.com>
Date: Thu, 04 Jun 2015 07:24:09 -0700
From: Motty Cruz <motty.cruz@gmail.com>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
 rv:31.0) Gecko/20100101 Thunderbird/31.7.0
MIME-Version: 1.0
To: cdh-user@cloudera.org
CC: user@hadoop.apache.org
Subject: Re: upgrade CDH 5.3.1 to 5.4.1 - Event Server health issue
References: <556F2965.5070604@gmail.com> <556F399C.6070601@gmail.com>
 <93dabfc4-4055-4050-8c3e-7b13df475530@cloudera.org>
In-Reply-To: <93dabfc4-4055-4050-8c3e-7b13df475530@cloudera.org>
Content-Type: multipart/alternative;
 boundary="------------040906060200010702050009"

This is a multi-part message in MIME format.
--------------040906060200010702050009
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit

Thanks for your reply Atul,
I believe it has to do with version of Java. We Also updated Java to 
version 8 previously we were using java version 1.7-67.

I have not resolve the issue yet. do you mind sharing the steps you 
taken to enable "trace".

Thanks,
Motty

On 06/03/2015 06:18 PM, Atul Kulkarni wrote:
> We had the same issue (upgrade from 5.3.3 to 5.4.0) - while trying to 
> debug I enabled trace and it started working correctly - it was very 
> odd, in the mean time we did not care about the previous events data, 
> hence we also whacked directory (after backing it up, of course!) 
> where it stores some intermediate data.
>
> As this is not a perfect or even sensible solution this may not work 
> for you, we are still investigating the real reason but since we have 
> not been able reproduce it - we are not sure how to debug further.
>
> Just thought of sharing this random act that we still can't believe 
> turned out to be the solution. Let us know if this works for you too.
>
> Regards,
> Atul.
>
> On Wednesday, June 3, 2015 at 10:30:13 AM UTC-7, motty cruz wrote:
>
>     Hello,
>     Just finished upgrading CDH from 5.3.1 to 5.4.1 using
>
>     http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/install_upgrade_to_cdh54_parcels.html
>     <http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/install_upgrade_to_cdh54_parcels.html>
>
>
>     however Event health issues warnings " eventserver (cloudera1)
>     <http://cloudera1.sscs.ad:7180/cmf/services/6/instances/28/status>
>     Process Status, Unexpected Exits"
>
>     2015-02-24 14:18:06,012 INFO
>     com.cloudera.cmf.eventcatcher.server.EventCatcherService: Starting
>     EventCatcherService. JVM Args: [-XX:+UseConcMarkSweepGC,
>     -XX:-CMSConcurrentMTEnabled, -XX:+UseParNewGC,
>     -Dmgmt.log.file=mgmt-cmf-mgmt-EVENTSERVER-cloudera1.domain.ad.log.out,
>     -Djava.awt.headless=true, -Djava.net.preferIPv4Stack=true,
>     -Xms52428800, -Xmx52428800,
>     -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh],
>     Args: [], Version: 5.3.1 (#191 built by jenkins on 20150123-2020
>     git: b0377087cf605a686591e659eb14078923bc3c83)
>
>     Any ideas? we're using Java 8
>
>     Thanks,
>     Motty
>
>
> -- 
>
> ---
> You received this message because you are subscribed to the Google 
> Groups "CDH Users" group.
> To unsubscribe from this group and stop receiving emails from it, send 
> an email to cdh-user+unsubscribe@cloudera.org 
> <mailto:cdh-user+unsubscribe@cloudera.org>.
> For more options, visit https://groups.google.com/a/cloudera.org/d/optout.


--------------040906060200010702050009
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    Thanks for your reply Atul, <br>
    I believe it has to do with version of Java. We Also updated Java to
    version 8 previously we were using java version 1.7-67. <br>
    <br>
    I have not resolve the issue yet. do you mind sharing the steps you
    taken to enable "trace". <br>
    <br>
    Thanks, <br>
    Motty<br>
    <br>
    <div class="moz-cite-prefix">On 06/03/2015 06:18 PM, Atul Kulkarni
      wrote:<br>
    </div>
    <blockquote
      cite="mid:93dabfc4-4055-4050-8c3e-7b13df475530@cloudera.org"
      type="cite">
      <div dir="ltr">We had the same issue (upgrade from 5.3.3 to 5.4.0)
        - while trying to debug I enabled trace and it started working
        correctly - it was very odd, in the mean time we did not care
        about the previous events data, hence we also whacked directory
        (after backing it up, of course!) where it stores some
        intermediate data. 
        <div><br>
        </div>
        <div>As this is not a perfect or even sensible solution this may
          not work for you, we are still investigating the real reason
          but since we have not been able reproduce it - we are not sure
          how to debug further.
          <div><br>
          </div>
          <div>Just thought of sharing this random act that we still
            can't believe turned out to be the solution. Let us know if
            this works for you too.<br>
            <br>
            Regards,</div>
          <div>Atul.</div>
          <div><br>
            On Wednesday, June 3, 2015 at 10:30:13 AM UTC-7, motty cruz
            wrote:
            <blockquote class="gmail_quote" style="margin:
              0;margin-left: 0.8ex;border-left: 1px #ccc
              solid;padding-left: 1ex;">
              <div text="#000000" bgcolor="#FFFFFF"> Hello, <br>
                <div> Just finished upgrading CDH from 5.3.1 to 5.4.1
                  using <br>
                  <p class="MsoNormal"><font face="Calibri" size="2"><span
                        style="font-size:11.0pt"><a
                          moz-do-not-send="true"
href="http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/install_upgrade_to_cdh54_parcels.html"
                          target="_blank" rel="nofollow"
                          onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Fwww.cloudera.com%2Fcontent%2Fcloudera%2Fen%2Fdocumentation%2Fcore%2Flatest%2Ftopics%2Finstall_upgrade_to_cdh54_parcels.html\46sa\75D\46sntz\0751\46usg\75AFQjCNEti-AiWgkJ6iw5mYJR3_UCYiaBxw';return
                          true;"
                          onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Fwww.cloudera.com%2Fcontent%2Fcloudera%2Fen%2Fdocumentation%2Fcore%2Flatest%2Ftopics%2Finstall_upgrade_to_cdh54_parcels.html\46sa\75D\46sntz\0751\46usg\75AFQjCNEti-AiWgkJ6iw5mYJR3_UCYiaBxw';return
                          true;">http://www.cloudera.com/<wbr>content/cloudera/en/<wbr>documentation/core/latest/<wbr>topics/install_upgrade_to_<wbr>cdh54_parcels.html</a></span></font></p>
                  <p class="MsoNormal"><font face="Calibri" size="2"><span
                        style="font-size:11.0pt"> <br>
                        however Event health issues warnings "</span></font>
                    <a moz-do-not-send="true"
                      href="http://cloudera1.sscs.ad:7180/cmf/services/6/instances/28/status"
                      target="_blank" rel="nofollow"
                      onmousedown="this.href='http://www.google.com/url?q\75http%3A%2F%2Fcloudera1.sscs.ad%3A7180%2Fcmf%2Fservices%2F6%2Finstances%2F28%2Fstatus\46sa\75D\46sntz\0751\46usg\75AFQjCNGJvp3sfmBpaF1qLumZVJFMHYMADw';return
                      true;"
                      onclick="this.href='http://www.google.com/url?q\75http%3A%2F%2Fcloudera1.sscs.ad%3A7180%2Fcmf%2Fservices%2F6%2Finstances%2F28%2Fstatus\46sa\75D\46sntz\0751\46usg\75AFQjCNGJvp3sfmBpaF1qLumZVJFMHYMADw';return
                      true;">eventserver (cloudera1)</a> Process Status,
                    Unexpected Exits"<br>
                    <br>
                  </p>
                  2015-02-24 14:18:06,012 INFO
                  com.cloudera.cmf.eventcatcher.<wbr>server.EventCatcherService:
                  Starting EventCatcherService. JVM Args:
                  [-XX:+UseConcMarkSweepGC, -XX:-CMSConcurrentMTEnabled,
                  -XX:+UseParNewGC, -Dmgmt.log.file=mgmt-cmf-mgmt-<wbr>EVENTSERVER-cloudera1.domain.<wbr>ad.log.out,

                  -Djava.awt.headless=true, -Djava.net.preferIPv4Stack=<wbr>true,

                  -Xms52428800, -Xmx52428800,
                  -XX:OnOutOfMemoryError=/usr/<wbr>lib64/cmf/service/common/<wbr>killparent.sh],

                  Args: [], Version: 5.3.1 (#191 built by jenkins on
                  20150123-2020 git: b0377087cf605a686591e659eb1407<wbr>8923bc3c83)<br>
                  <br>
                  Any ideas? we're using Java 8<br>
                  <br>
                  Thanks, <br>
                  Motty<br>
                  <br>
                </div>
                <br>
              </div>
            </blockquote>
          </div>
        </div>
      </div>
      -- <br>
      <br>
      --- <br>
      You received this message because you are subscribed to the Google
      Groups "CDH Users" group.<br>
      To unsubscribe from this group and stop receiving emails from it,
      send an email to <a moz-do-not-send="true"
        href="mailto:cdh-user+unsubscribe@cloudera.org">cdh-user+unsubscribe@cloudera.org</a>.<br>
      For more options, visit <a moz-do-not-send="true"
        href="https://groups.google.com/a/cloudera.org/d/optout">https://groups.google.com/a/cloudera.org/d/optout</a>.<br>
    </blockquote>
    <br>
  </body>
</html>

--------------040906060200010702050009--