lucene-java-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From abdul aleem <janaabdulal...@yahoo.com>
Subject Re: Using Lucene to search log files
Date Mon, 11 Dec 2006 13:22:18 GMT
Many thanks Grant,
I will now dirty my hands with Lucene to get our
requirements

regards,
Abdul

--- Grant Ingersoll <gsingers@apache.org> wrote:

> See below
> 
> On Dec 11, 2006, at 7:04 AM, abdul aleem wrote:
> 
> > Hi All,
> >
> > Im a Lucene newbie,
> >
> >
> > Requirement :
> > ==============
> > a) Build a log viewer tool, search log files for
> > keywords and time stamp
> >
> > b)  files in production approx 200 logs per day
> and
> > each log file may range from 1MB - 5MB
> >
> > Lucene
> > ========
> > We wanted to utilize Lucene's search capabilities
> > especially search all 200 log files content
> quickly
> >
> > a) Search criteria:
> >     i) Timestamp search: Fetch contents between
> any
> > two timestamps
> >
> >    ii) Fetch log file contents for specified
> keyword
> >
> >
> > Query
> > ========
> >     a ) Would greatly appreciate if some
> suggestions
> >         whether Lucene will be appropriate tool
> for
> > the requirement ??
> >
> 
> Yes, I think this is a reasonable application of
> Lucene.  You  
> probably need a to customize analysis to handle your
> log files, but  
> the rest should be pretty straightforward.
> 
> >
> >     b) I have tried to use SpanQuery however
> > struggling to fetch entire conents e.g. (between
> two
> > timestamps)
> 
> You're probably better off using the approach
> mentioned in c).   Also  
> search this list for usage of RangeFilter and 
> search this list for  
> log file searching, as I am sure this topic has come
> up before.
> 
> >
> >     c) I had also looked at
> > LargeScaleDateRangeProcessing in the wiki, is that
> a
> > right approach for the requirement
> 
> --------------------------
> Grant Ingersoll
> Center for Natural Language Processing
> http://www.cnlp.org
> 
> Read the Lucene Java FAQ at
> http://wiki.apache.org/jakarta-lucene/ 
> LuceneFAQ
> 
> 
> 
>
---------------------------------------------------------------------
> To unsubscribe, e-mail:
> java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail:
> java-user-help@lucene.apache.org
> 
> 



 
____________________________________________________________________________________
Need a quick answer? Get one in minutes from people who know.
Ask your question on www.Answers.yahoo.com

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Mime
View raw message