accumulo-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From o haya <oh...@yahoo.com>
Subject Re: Modifying VisibilityEvaluator - Problem with Classpath for scanner
Date Mon, 14 Aug 2017 04:32:06 GMT
Hi,

For the record:

- Re. including the JARs I needed in the classpath:

I was able to make this work by modifying the bin/accumulo file.  I had to add the JARs to
the classpath.  In that accumulo file, I:

   o Added a var (e.g., MY_JARS) and added paths to all my JARs to that var (just below the
SLF4J_JAR line)
   o A few lines after that in included the $MY_JARS var in the CLASSPATH line

- Re .getting my Java logging to appear:

Originally, I had the system property for pointing to the logging.properties being set inside
one of my classes, but then the logging output didn't appear, so instead I added the code
to set the system property directly in one of the Accumulo classes.  Then, the logging from
my classes appeared.

Thanks,
Jim



--------------------------------------------
On Mon, 7/31/17, o haya <ohaya@yahoo.com> wrote:

 Subject: Re: Modifying VisibilityEvaluator - Problem with Classpath for scanner
 To: user@accumulo.apache.org, "o haya" <ohaya@yahoo.com>
 Date: Monday, July 31, 2017, 6:11 PM
 
 Hi,
 
 I have a method in one of my classes
 that dumps out the system properties, and that includes the
 Java path and it is showing this:
 
 In listSystemProperties: [00001]
 java.class.path:
 [/apps/accumulo-1.8.1/conf:/apps/accumulo-1.8.1/lib/accumulo-start.jar:/apps/accumulo-1.8.1/lib/slf4j-api.jar:/apps/accumulo-1.8.1/lib/slf4j-log4j12.jar:/apps/hadoop-2.7.3//share/hadoop/common/lib/log4j-1.2.17.jar:]
 
 I think that that is a (maybe 'the')
 problem, i.e., the classpath when it executes my code only
 has the Accumulo/hadoop JARs and the classpath doesn't
 include any of the JARs that my code requires. 
 
 Is there a way that I can configure
 Accumulo so that when my Java code is executed, that the
 classpath can include JARs that my code requires?
 
 
 Also, I think there is another
 problem.  The place where it is blowing up is in my
 code, and it's inside a try-catch.  And inside the
 catch, I output some error messages to stdout, but that
 output does not appear in any of the logs including the trc
 and err files.  Why is that?  And can I get the
 output of the catch to output somewhere?
 
 Thanks,
 Jim
 
 
 
 --------------------------------------------
 On Mon, 7/31/17, o haya <ohaya@yahoo.com>
 wrote:
 
  Subject: Re: Modifying
 VisibilityEvaluator - Problem with Classpath for scanner
  To: user@accumulo.apache.org,
 "o haya" <ohaya@yahoo.com>
  Date: Monday, July 31, 2017, 2:04 PM
  
  Hi,
  
  Ok, I checked and there are .err and
  .trc files.  
  
  The .err files are empty, but I do
 see
  the stdout output from my classes in
 the
  tserver_localhost.whatever.com.out.
  
  So, it definitely is getting into my
  code, but it looks like any errors are
 not showing up in the
  .out file.
  
  Jim
  
 
 --------------------------------------------
  On Mon, 7/31/17, o haya <ohaya@yahoo.com>
  wrote:
  
   Subject: Re: Modifying
  VisibilityEvaluator - Problem with
 Classpath for scanner
   To: user@accumulo.apache.org
   Date: Monday, July 31, 2017,
 12:17 PM
   
   Josh and Ivan,
   
   I don't have access to my test
   environment now, but FYI, from
 the
  stacktraces that I saw, I
   can see that it actually got
 quite a
  bit into my code, and
   there was a lot of output (to
 stdout)
  that was not in the
   Accumulo logs or in the
 Accumulo
  console output.  I
   will check later today about
 the
  tserver files u mentioned
   but I don't remember iseeing any
 .out
  or .err files in the
   logs directory?  Do the .err
 and .out
  files show up in
   a different directory than the
  Accumulo logs directory?
   
   
   
  
 
 --------------------------------------------
   On Mon, 7/31/17, ivan bella
 <ivan@ivan.bella.name>
   wrote:
   
    Subject: Re: Modifying
   VisibilityEvaluator - Problem
 with
  Classpath for scanner
    To: user@accumulo.apache.org
    Date: Monday, July 31, 2017,
  11:55 AM
    
    I would
    expect that all output going to
   stdout/stderr is being
    captured in the tserver*.out or
   tserver*.err files (or
    master equivalents).  Of course
  if a
   class is not being
    loaded then it does not get much
  of a
   chance to output
    anything....
    On July 31, 2017 at 10:34 AM
    o haya <ohaya@yahoo.com>
   wrote:Hi
    Michael,I did use the "accumulo
   classpath"
    and it shows all my JARs. Also
  during
   the startup I can see
    it "Push" each of the JARs, but
  still
   get the
    error.Sorry - I also just
  remembered -
   I output a TON
    of debug info in my JAR that I
  added,
   to stdout, but I
    don't see any of that debug
  output in
   the Accumulo
    console/stdout or in any of the
   Accumulo logs. Is there a
    way that I can have the debug
  output
   from my JAR show up
    somewhere? That might
   
  
 
 help...Thanks,Jim--------------------------------------------
    On Mon, 7/31/17, Michael Wall
    <mjwall@gmail.com>
   wrote:Subject: Re: Modifying
    VisibilityEvaluator - Problem
  with
   Classpath for scanner
     To: user@accumulo.apache.org,
   "o
    haya" <ohaya@yahoo.com>
     Date:
    Monday, July 31, 2017, 8:34
  AMYou can
     use the classpath command to
   help troubleshoot
    as
     well
    
    $ACCUMULO_HOME/bin/accumulo
     classpath
     On Mon, Jul
     31, 2017 at 8:33
    AM ivan bella <ivan@ivan.bella.name>
    
    wrote:Jim,
     Putting the jars in the
    lib/ext
     directory is a perfectly
   acceptable
    mechanism. Make sure
     your jars are in place
    on all of your tservers before
  you
     start
    them up. Perhaps this class is
  being
   found but is
     failing to initialize itself
   which can lead to
    a
     ClassNoDefError.
    
    IvanOn July 31, 2017 at 2:39 AM
  o
   haya
    <ohaya@yahoo.com>
    
    wrote:Hi,I am trying to make
  some
    modifications to
     the Accumulo
    VisibilityModifier, but when I
  add my
   code, and
     try to run a scan on a table,
 I
   am getting
    ClassNoDefError
     for a class that my
    modified code uses.So far, what
  I have
   been trying to
    add
     my JARs to the classpath is
 to
   put the
    JARs in the Accumulo
     lib/ext directory AND
    also, editing the
  accumulo-site.xml
     and
    adding the same JARs to that
  file.Is
   there
    somewhere
     else I need to configure or
 do
   I
    need to put the JAR in
     somewhere other than
    the lib/ext directory?Thanks,
    Jim

Mime
View raw message