pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Remi Catherinot (JIRA)" <j...@apache.org>
Subject [jira] [Created] (PIG-4581) thread safe issue in NodeIdGenerator
Date Mon, 01 Jun 2015 08:24:17 GMT
Remi Catherinot created PIG-4581:
------------------------------------

             Summary: thread safe issue in NodeIdGenerator
                 Key: PIG-4581
                 URL: https://issues.apache.org/jira/browse/PIG-4581
             Project: Pig
          Issue Type: Bug
          Components: impl
    Affects Versions: 0.14.0
         Environment: any computer with multiple cores, does not always happen since it is
not a determinitic bug. The more threads and real cpu, the more chances it will happen.
            Reporter: Remi Catherinot
            Priority: Trivial


NodeIdGenerator use an HashMap without any synchronization. In multithreaded environment it
may lead to concurrent access to the HashMap which, in some case, triggers an infinite loop
inside the HashMap implementation => the parsing of the pig request never ends so the job
will never run + it eats a threads in the JVM that just keep burning CPU cycles.

since it is hard to reproduce and it is not a deterministic bug it is impossible to provide
a viable unit tests for it to demonstrate both the bug and the fix.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message