Mailing-List: contact solr-user-help@lucene.apache.org; run by ezmlm
Precedence: bulk
Reply-To: solr-user@lucene.apache.org
From: "Anatharaman, Srinatha (Contractor)" <Srinatha_Anantharaman@comcast.com>
To: "solr-user@lucene.apache.org" <solr-user@lucene.apache.org>
Subject: Flume SolrSink No Error but not Indexing
Thread-Topic: Flume SolrSink No Error but not Indexing
Thread-Index: AdKBhGYVmGGB3JWORraUtU90+pkB+QAAZ9yw
Date: Tue, 7 Feb 2017 21:06:33 +0000
Message-ID: <b3c6229bc65d446b9e328fc3f8041394@pacdcex47.cable.comcast.com>
References: <a5fecbfdd56d4bc7942b32517ad82b14@pacdcex47.cable.comcast.com>
In-Reply-To: <a5fecbfdd56d4bc7942b32517ad82b14@pacdcex47.cable.comcast.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: multipart/alternative;
	boundary="_000_b3c6229bc65d446b9e328fc3f8041394pacdcex47cablecomcastco_"
MIME-Version: 1.0
archived-at: Tue, 07 Feb 2017 21:07:42 -0000

--_000_b3c6229bc65d446b9e328fc3f8041394pacdcex47cablecomcastco_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi,


I am indexing text document using Flume,
I do not see any error or warning message but data is not getting ingested =
to Solr
Log level for both Solr and Flume is set to TRACE, ALL

Flume version : 1.5.2.2.3
Solr Version : 5.5
Config files are as below
Flume Config :
agent.sources =3D SpoolDirSrc
agent.channels =3D FileChannel
agent.sinks =3D SolrSink

# Configure Source
agent.sources.SpoolDirSrc.channels =3D fileChannel
agent.sources.SpoolDirSrc.type =3D spooldir
agent.sources.SpoolDirSrc.spoolDir =3D /home/flume/source_emails
agent.sources.SpoolDirSrc.basenameHeader =3D true
agent.sources.SpoolDirSrc.fileHeader =3D true
#agent.sources.src1.fileSuffix =3D .COMPLETED
agent.sources.SpoolDirSrc.deserializer =3D org.apache.flume.sink.solr.morph=
line.BlobDeserializer$Builder
# Use a channel that buffers events in memory
agent.channels.FileChannel.type =3D file
agent.channels.FileChannel.capacity =3D 10000
#agent.channels.FileChannel.transactionCapacity =3D 10000
# Configure Solr Sink
agent.sinks.SolrSink.type =3D org.apache.flume.sink.solr.morphline.Morphlin=
eSolrSink
agent.sinks.SolrSink.morphlineFile =3D /etc/flume/conf/morphline.conf
agent.sinks.SolrSink.batchsize =3D 1000
agent.sinks.SolrSink.batchDurationMillis =3D 2500
agent.sinks.SolrSink.channel =3D fileChannel
agent.sinks.SolrSink.morphlineId =3D morphline1
agent.sources.SpoolDirSrc.channels =3D FileChannel
agent.sinks.SolrSink.channel =3D FileChannel

Morphline Config
solrLocator: {
collection : gsearch
#zkHost : "127.0.0.1:9983"
zkHost : "codesolr-as-r3p:21810,codesolr-as-r3p:21811,codesolr-as-r3p:21812=
"
}
morphlines :
[
  {
    id : morphline1
    importCommands : ["org.kitesdk.**", "org.apache.solr.**"]
    commands :
    [
      { detectMimeType { includeDefaultMimeTypes : true } }
      {
        solrCell {
          solrLocator : ${solrLocator}
          captureAttr : true
          lowernames : true
          capture : [_attachment_body, _attachment_mimetype, basename, cont=
ent, content_encoding, content_type, file, meta]
          parsers : [ { parser : org.apache.tika.parser.txt.TXTParser } ]
         }
      }
      { generateUUID { field : id } }
      { sanitizeUnknownSolrFields { solrLocator : ${solrLocator} } }
      { logDebug { format : "output record: {}", args : ["@{}"] } }
      { loadSolr: { solrLocator : ${solrLocator} } }
    ]
  }
]

Please help me what could be the issue
Regards,
~Sri


--_000_b3c6229bc65d446b9e328fc3f8041394pacdcex47cablecomcastco_--