aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Oliver, James" <James.Oli...@pegs.com>
Subject Re: Storage is not READY
Date Thu, 16 Oct 2014 16:56:59 GMT
+1

This bit me a while back.



On 10/16/14 9:35 AM, "Jay Buffington" <me@jaybuff.com> wrote:

>We should fix this bug in Mesos:
>https://issues.apache.org/jira/browse/MESOS-1703
>
>If the error message hadn't been terrible, Joe could have easily fixed
>and moved on.
>
>On Thu, Oct 16, 2014 at 9:32 AM, Bill Farner <wfarner@apache.org> wrote:
>> Piggy-backing on Zameer's reply:
>> 
>>https://github.com/apache/incubator-aurora/blob/master/docs/deploying-aur
>>ora-scheduler.md#initializing-the-replicated-log
>>
>> Relevant ticket for today's doc day,
>> https://issues.apache.org/jira/browse/AURORA-840
>>
>> -=Bill
>>
>> On Thu, Oct 16, 2014 at 9:30 AM, Zameer Manji <zmanji@twopensource.com>
>> wrote:
>>
>>> Did you initialize the replicated log?
>>>
>>> On Thu, Oct 16, 2014 at 9:13 AM, Joe Stein <joe.stein@stealth.ly>
>>>wrote:
>>>
>>> > My build is from latest master. I only have one scheduler running.  I
>>> also
>>> > see this in the log over and over (and over and over) again. Not
>>>sure it
>>> is
>>> > related.
>>> >
>>> > I1016 16:12:27.234133 26081 replica.cpp:638] Replica in EMPTY status
>>> > received a broadcasted recover request
>>> > I1016 16:12:27.234256 26084 recover.cpp:188] Received a recover
>>>response
>>> > from a replica in EMPTY status
>>> > I1016 16:12:27.804043 26069 replica.cpp:638] Replica in EMPTY status
>>> > received a broadcasted recover request
>>> > I1016 16:12:27.804126 26081 recover.cpp:188] Received a recover
>>>response
>>> > from a replica in EMPTY status
>>> > I1016 16:12:28.515256 26078 replica.cpp:638] Replica in EMPTY status
>>> > received a broadcasted recover request
>>> > I1016 16:12:28.515329 26078 recover.cpp:188] Received a recover
>>>response
>>> > from a replica in EMPTY status
>>> > I1016 16:12:29.333498 26084 replica.cpp:638] Replica in EMPTY status
>>> > received a broadcasted recover request
>>> > I1016 16:12:29.333580 26076 recover.cpp:188] Received a recover
>>>response
>>> > from a replica in EMPTY status
>>> > I1016 16:12:29.838642 26071 replica.cpp:638] Replica in EMPTY status
>>> > received a broadcasted recover request
>>> > I1016 16:12:29.838726 26070 recover.cpp:188] Received a recover
>>>response
>>> > from a replica in EMPTY status
>>> > ^CI1016 16:12:30.623003 26076 replica.cpp:638] Replica in EMPTY
>>>status
>>> > received a broadcasted recover request
>>> > I1016 16:12:30.623085 26071 recover.cpp:188] Received a recover
>>>response
>>> > from a replica in EMPTY status
>>> >
>>> > /*******************************************
>>> >  Joe Stein
>>> >  Founder, Principal Consultant
>>> >  Big Data Open Source Security LLC
>>> >  http://www.stealth.ly
>>> >  Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>>> > ********************************************/
>>> >
>>> > On Thu, Oct 16, 2014 at 11:41 AM, Jay Buffington <me@jaybuff.com>
>>>wrote:
>>> >
>>> > > This was fixed about three months ago:
>>> > > https://issues.apache.org/jira/browse/AURORA-584  Perhaps you're
>>> > > running an older version that doesn't have that commit?
>>> > >
>>> > > The tl;dr of that jira is that when you go to a scheduler that
>>>isn't
>>> > > the leader it should do a HTTP redirect (302?) to the leader.
>>> > >
>>> > > Jay
>>> > >
>>> > >
>>> > > On Thu, Oct 16, 2014 at 8:15 AM, Joe Stein <joe.stein@stealth.ly>
>>> wrote:
>>> > > > Hi, I am getting an error when going to /scheduler in the UI and
>>>not
>>> > sure
>>> > > > what it is. Thanks in advance!!!
>>> > > >
>>> > > >
>>> > > > W1016 15:13:14.419 THREAD133
>>> > > > org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke:
>>> > > Uncaught
>>> > > > transient exception while handling getRoleSummary()
>>> > > >
>>> org.apache.aurora.scheduler.storage.Storage$TransientStorageException:
>>> > > > Storage is not READY
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.storage.CallOrderEnforcingStorage.checkInSta
>>>te(CallOrderEnforcingStorage.java:78)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.storage.CallOrderEnforcingStorage.weaklyCons
>>>istentRead(CallOrderEnforcingStorage.java:122)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.storage.Storage$Util.weaklyConsistentFetchTa
>>>sks(Storage.java:307)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.thrift.SchedulerThriftInterface.getRoleSumma
>>>ry(SchedulerThriftInterface.java:582)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.thrift.aop.ServerInfoInterceptor.invoke(Serv
>>>erInfoInterceptor.java:32)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.thrift.aop.ThriftStatsExporterInterceptor.in
>>>voke(ThriftStatsExporterInterceptor.java:47)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.thrift.aop.FeatureToggleInterceptor.invoke(F
>>>eatureToggleInterceptor.java:38)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke(Logging
>>>Interceptor.java:88)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.gen.ReadOnlyScheduler$Processor$getRoleSummary.getResu
>>>lt(ReadOnlyScheduler.java:946)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>org.apache.aurora.gen.ReadOnlyScheduler$Processor$getRoleSummary.getResu
>>>lt(ReadOnlyScheduler.java:931)
>>> > > > at 
>>>org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>>> > > > at 
>>>org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>>> > > > at org.apache.thrift.server.TServlet.doPost(TServlet.java:83)
>>> > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>>> > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.
>>>java:263)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.ServletDefinition.service(ServletDefinition.ja
>>>va:178)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletP
>>>ipeline.java:91)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvo
>>>cation.java:62)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.jav
>>>a:168)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvo
>>>cation.java:58)
>>> > > > at
>>> > > >
>>> > >
>>> >
>>> 
>>>com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.jav
>>>a:168)
>>> > > >
>>> > > >
>>> > > > /*******************************************
>>> > > >  Joe Stein
>>> > > >  Founder, Principal Consultant
>>> > > >  Big Data Open Source Security LLC
>>> > > >  http://www.stealth.ly
>>> > > >  Twitter: @allthingshadoop
>>><http://www.twitter.com/allthingshadoop>
>>> > > > ********************************************/
>>> > >
>>> >
>>>
>>>
>>>
>>> --
>>> Zameer Manji
>>>


Mime
View raw message