Mailing-List: contact user-help@accumulo.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@accumulo.apache.org
Date: Mon, 14 Aug 2017 04:32:06 +0000 (UTC)
From: o haya <ohaya@yahoo.com>
Reply-To: o haya <ohaya@yahoo.com>
To: <user@accumulo.apache.org>, o haya <ohaya@yahoo.com>
Message-ID: <847351420.1036995.1502685126571@mail.yahoo.com>
Subject: Re: Modifying VisibilityEvaluator - Problem with Classpath for
 scanner
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
References: <847351420.1036995.1502685126571.ref@mail.yahoo.com>
archived-at: Mon, 14 Aug 2017 04:36:22 -0000

Hi,

For the record:

- Re. including the JARs I needed in the classpath:

I was able to make this work by modifying the bin/accumulo file.  I had to =
add the JARs to the classpath.  In that accumulo file, I:

   o Added a var (e.g., MY_JARS) and added paths to all my JARs to that var=
 (just below the SLF4J_JAR line)
   o A few lines after that in included the $MY_JARS var in the CLASSPATH l=
ine

- Re .getting my Java logging to appear:

Originally, I had the system property for pointing to the logging.propertie=
s being set inside one of my classes, but then the logging output didn't ap=
pear, so instead I added the code to set the system property directly in on=
e of the Accumulo classes.  Then, the logging from my classes appeared.

Thanks,
Jim


--------------------------------------------
On Mon, 7/31/17, o haya <ohaya@yahoo.com> wrote:

 Subject: Re: Modifying VisibilityEvaluator - Problem with Classpath for sc=
anner
 To: user@accumulo.apache.org, "o haya" <ohaya@yahoo.com>
 Date: Monday, July 31, 2017, 6:11 PM
=20
 Hi,
=20
 I have a method in one of my classes
 that dumps out the system properties, and that includes the
 Java path and it is showing this:
=20
 In listSystemProperties: [00001]
 java.class.path:
 [/apps/accumulo-1.8.1/conf:/apps/accumulo-1.8.1/lib/accumulo-start.jar:/ap=
ps/accumulo-1.8.1/lib/slf4j-api.jar:/apps/accumulo-1.8.1/lib/slf4j-log4j12.=
jar:/apps/hadoop-2.7.3//share/hadoop/common/lib/log4j-1.2.17.jar:]
=20
 I think that that is a (maybe 'the')
 problem, i.e., the classpath when it executes my code only
 has the Accumulo/hadoop JARs and the classpath doesn't
 include any of the JARs that my code requires.=20
=20
 Is there a way that I can configure
 Accumulo so that when my Java code is executed, that the
 classpath can include JARs that my code requires?
=20
=20
 Also, I think there is another
 problem.=C2=A0 The place where it is blowing up is in my
 code, and it's inside a try-catch.=C2=A0 And inside the
 catch, I output some error messages to stdout, but that
 output does not appear in any of the logs including the trc
 and err files.=C2=A0 Why is that?=C2=A0 And can I get the
 output of the catch to output somewhere?
=20
 Thanks,
 Jim
=20
=20
=20
 --------------------------------------------
 On Mon, 7/31/17, o haya <ohaya@yahoo.com>
 wrote:
=20
  Subject: Re: Modifying
 VisibilityEvaluator - Problem with Classpath for scanner
  To: user@accumulo.apache.org,
 "o haya" <ohaya@yahoo.com>
  Date: Monday, July 31, 2017, 2:04 PM
 =20
  Hi,
 =20
  Ok, I checked and there are .err and
  .trc files.=C2=A0=20
 =20
  The .err files are empty, but I do
 see
  the stdout output from my classes in
 the
  tserver_localhost.whatever.com.out.
 =20
  So, it definitely is getting into my
  code, but it looks like any errors are
 not showing up in the
  .out file.
 =20
  Jim
 =20
=20
 --------------------------------------------
  On Mon, 7/31/17, o haya <ohaya@yahoo.com>
  wrote:
 =20
 =C2=A0 Subject: Re: Modifying
  VisibilityEvaluator - Problem with
 Classpath for scanner
 =C2=A0 To: user@accumulo.apache.org
 =C2=A0 Date: Monday, July 31, 2017,
 12:17 PM
 =C2=A0=20
 =C2=A0 Josh and Ivan,
 =C2=A0=20
 =C2=A0 I don't have access to my test
 =C2=A0 environment now, but FYI, from
 the
  stacktraces that I saw, I
 =C2=A0 can see that it actually got
 quite a
  bit into my code, and
 =C2=A0 there was a lot of output (to
 stdout)
  that was not in the
 =C2=A0 Accumulo logs or in the
 Accumulo
  console output.=C2=A0 I
 =C2=A0 will check later today about
 the
  tserver files u mentioned
 =C2=A0 but I don't remember iseeing any
 .out
  or .err files in the
 =C2=A0 logs directory?=C2=A0 Do the .err
 and .out
  files show up in
 =C2=A0 a different directory than the
  Accumulo logs directory?
 =C2=A0=20
 =C2=A0=20
 =C2=A0=20
 =20
=20
 --------------------------------------------
 =C2=A0 On Mon, 7/31/17, ivan bella
 <ivan@ivan.bella.name>
 =C2=A0 wrote:
 =C2=A0=20
  =C2=A0 Subject: Re: Modifying
 =C2=A0 VisibilityEvaluator - Problem
 with
  Classpath for scanner
  =C2=A0 To: user@accumulo.apache.org
  =C2=A0 Date: Monday, July 31, 2017,
  11:55 AM
  =C2=A0=20
  =C2=A0 I would
  =C2=A0 expect that all output going to
 =C2=A0 stdout/stderr is being
  =C2=A0 captured in the tserver*.out or
 =C2=A0 tserver*.err files (or
  =C2=A0 master equivalents).=C2=A0 Of course
  if a
 =C2=A0 class is not being
  =C2=A0 loaded then it does not get much
  of a
 =C2=A0 chance to output
  =C2=A0 anything....
  =C2=A0 On July 31, 2017 at 10:34 AM
  =C2=A0 o haya <ohaya@yahoo.com>
 =C2=A0 wrote:Hi
  =C2=A0 Michael,I did use the "accumulo
 =C2=A0 classpath"
  =C2=A0 and it shows all my JARs. Also
  during
 =C2=A0 the startup I can see
  =C2=A0 it "Push" each of the JARs, but
  still
 =C2=A0 get the
  =C2=A0 error.Sorry - I also just
  remembered -
 =C2=A0 I output a TON
  =C2=A0 of debug info in my JAR that I
  added,
 =C2=A0 to stdout, but I
  =C2=A0 don't see any of that debug
  output in
 =C2=A0 the Accumulo
  =C2=A0 console/stdout or in any of the
 =C2=A0 Accumulo logs. Is there a
  =C2=A0 way that I can have the debug
  output
 =C2=A0 from my JAR show up
  =C2=A0 somewhere? That might
 =C2=A0=20
 =20
=20
 help...Thanks,Jim--------------------------------------------
  =C2=A0 On Mon, 7/31/17, Michael Wall
  =C2=A0 <mjwall@gmail.com>
 =C2=A0 wrote:Subject: Re: Modifying
  =C2=A0 VisibilityEvaluator - Problem
  with
 =C2=A0 Classpath for scanner
 =C2=A0 =C2=A0 To: user@accumulo.apache.org,
 =C2=A0 "o
  =C2=A0 haya" <ohaya@yahoo.com>
 =C2=A0 =C2=A0 Date:
  =C2=A0 Monday, July 31, 2017, 8:34
  AMYou can
 =C2=A0 =C2=A0 use the classpath command to
 =C2=A0 help troubleshoot
  =C2=A0 as
 =C2=A0 =C2=A0 well
  =C2=A0=20
  =C2=A0 $ACCUMULO_HOME/bin/accumulo
 =C2=A0 =C2=A0 classpath
 =C2=A0 =C2=A0 On Mon, Jul
 =C2=A0 =C2=A0 31, 2017 at 8:33
  =C2=A0 AM ivan bella <ivan@ivan.bella.name>
  =C2=A0=20
  =C2=A0 wrote:Jim,
 =C2=A0 =C2=A0 Putting the jars in the
  =C2=A0 lib/ext
 =C2=A0 =C2=A0 directory is a perfectly
 =C2=A0 acceptable
  =C2=A0 mechanism. Make sure
 =C2=A0 =C2=A0 your jars are in place
  =C2=A0 on all of your tservers before
  you
 =C2=A0 =C2=A0 start
  =C2=A0 them up. Perhaps this class is
  being
 =C2=A0 found but is
 =C2=A0 =C2=A0 failing to initialize itself
 =C2=A0 which can lead to
  =C2=A0 a
 =C2=A0 =C2=A0 ClassNoDefError.
  =C2=A0=20
  =C2=A0 IvanOn July 31, 2017 at 2:39 AM
  o
 =C2=A0 haya
  =C2=A0 <ohaya@yahoo.com>
  =C2=A0=20
  =C2=A0 wrote:Hi,I am trying to make
  some
  =C2=A0 modifications to
 =C2=A0 =C2=A0 the Accumulo
  =C2=A0 VisibilityModifier, but when I
  add my
 =C2=A0 code, and
 =C2=A0 =C2=A0 try to run a scan on a table,
 I
 =C2=A0 am getting
  =C2=A0 ClassNoDefError
 =C2=A0 =C2=A0 for a class that my
  =C2=A0 modified code uses.So far, what
  I have
 =C2=A0 been trying to
  =C2=A0 add
 =C2=A0 =C2=A0 my JARs to the classpath is
 to
 =C2=A0 put the
  =C2=A0 JARs in the Accumulo
 =C2=A0 =C2=A0 lib/ext directory AND
  =C2=A0 also, editing the
  accumulo-site.xml
 =C2=A0 =C2=A0 and
  =C2=A0 adding the same JARs to that
  file.Is
 =C2=A0 there
  =C2=A0 somewhere
 =C2=A0 =C2=A0 else I need to configure or
 do
 =C2=A0 I
  =C2=A0 need to put the JAR in
 =C2=A0 =C2=A0 somewhere other than
  =C2=A0 the lib/ext directory?Thanks,
  =C2=A0 Jim