kafka-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jay Kreps (Commented) (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (KAFKA-202) Make the request processing in kafka asynchonous
Date Fri, 13 Jan 2012 20:50:40 GMT

    [ https://issues.apache.org/jira/browse/KAFKA-202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13185842#comment-13185842
] 

Jay Kreps commented on KAFKA-202:
---------------------------------

Hey Neha, 0.8 doesn't build for me and is missing a few files in the patch. Did those get
missed in the checkin?

[info] == core-kafka / compile ==
[info]   Source analysis: 134 new/modified, 0 indirectly invalidated, 0 removed.
[info] Compiling main sources...
[error] /Users/jkreps/work/kafka-git/core/src/main/scala/kafka/network/SocketServer.scala:45:
not found: type RequestChannel
[error]   val requestChannel = new RequestChannel(numProcessorThreads, maxQueuedRequests)
[error]                            ^
[error] /Users/jkreps/work/kafka-git/core/src/main/scala/kafka/network/SocketServer.scala:190:
not found: type RequestChannel
[error]                                val requestChannel: RequestChannel,
[error]                                                    ^
[error] /Users/jkreps/work/kafka-git/core/src/main/scala/kafka/network/SocketServer.scala:301:
not found: value RequestChannel
[error]       val req = RequestChannel.Request(processor = id, requestKey = key, request =
request, start = time.nanoseconds)
[error]                 ^
[error] /Users/jkreps/work/kafka-git/core/src/main/scala/kafka/server/KafkaServer.scala:26:
RequestChannel is not a member of kafka.network
[error] import kafka.network.{SocketServerStats, SocketServer, RequestChannel}
[error]        ^
[error] /Users/jkreps/work/kafka-git/core/src/main/scala/kafka/server/KafkaServer.scala:40:
not found: type KafkaRequestHandlerPool
[error]   var requestHandlerPool: KafkaRequestHandlerPool = null
[error]                           ^
[error] /Users/jkreps/work/kafka-git/core/src/main/scala/kafka/server/KafkaServer.scala:69:
not found: type KafkaRequestHandlerPool
[error]     requestHandlerPool = new KafkaRequestHandlerPool(socketServer.requestChannel,
new KafkaApis(logManager).handle, config.numIoThreads)
[error]                              ^
[error] 6 errors found
[info] == core-kafka / compile ==
[error] Error running compile: Compilation failed
[info] 
[info] Total time: 21 s, completed Jan 13, 2012 12:46:07 PM
[info] 
[info] Total session time: 24 s, completed Jan 13, 2012 12:46:07 PM
[error] Error during build
                
> Make the request processing in kafka asynchonous
> ------------------------------------------------
>
>                 Key: KAFKA-202
>                 URL: https://issues.apache.org/jira/browse/KAFKA-202
>             Project: Kafka
>          Issue Type: New Feature
>            Reporter: Jay Kreps
>            Assignee: Jay Kreps
>             Fix For: 0.8
>
>         Attachments: KAFKA-202-v2.patch, KAFKA-202-v3.patch, KAFKA-202-v4.patch, KAFKA-202-v5.patch,
KAFKA-202-v6.patch, KAFKA-48-socket-server-refactor-draft.patch
>
>
> We need to handle long-lived requests to support replication. To make this work we need
to make the processing mechanism asynchronous from the network threads.
> To accomplish this we will retain the existing pool of network threads but add a new
pool of request handling threads. These will do all the disk I/O. There will be a queue mechanism
to transfer requests to and from this secondary pool.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message