aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Buffington ...@jaybuff.com>
Subject Re: Storage is not READY
Date Thu, 16 Oct 2014 16:35:31 GMT
We should fix this bug in Mesos:
https://issues.apache.org/jira/browse/MESOS-1703

If the error message hadn't been terrible, Joe could have easily fixed
and moved on.

On Thu, Oct 16, 2014 at 9:32 AM, Bill Farner <wfarner@apache.org> wrote:
> Piggy-backing on Zameer's reply:
> https://github.com/apache/incubator-aurora/blob/master/docs/deploying-aurora-scheduler.md#initializing-the-replicated-log
>
> Relevant ticket for today's doc day,
> https://issues.apache.org/jira/browse/AURORA-840
>
> -=Bill
>
> On Thu, Oct 16, 2014 at 9:30 AM, Zameer Manji <zmanji@twopensource.com>
> wrote:
>
>> Did you initialize the replicated log?
>>
>> On Thu, Oct 16, 2014 at 9:13 AM, Joe Stein <joe.stein@stealth.ly> wrote:
>>
>> > My build is from latest master. I only have one scheduler running.  I
>> also
>> > see this in the log over and over (and over and over) again. Not sure it
>> is
>> > related.
>> >
>> > I1016 16:12:27.234133 26081 replica.cpp:638] Replica in EMPTY status
>> > received a broadcasted recover request
>> > I1016 16:12:27.234256 26084 recover.cpp:188] Received a recover response
>> > from a replica in EMPTY status
>> > I1016 16:12:27.804043 26069 replica.cpp:638] Replica in EMPTY status
>> > received a broadcasted recover request
>> > I1016 16:12:27.804126 26081 recover.cpp:188] Received a recover response
>> > from a replica in EMPTY status
>> > I1016 16:12:28.515256 26078 replica.cpp:638] Replica in EMPTY status
>> > received a broadcasted recover request
>> > I1016 16:12:28.515329 26078 recover.cpp:188] Received a recover response
>> > from a replica in EMPTY status
>> > I1016 16:12:29.333498 26084 replica.cpp:638] Replica in EMPTY status
>> > received a broadcasted recover request
>> > I1016 16:12:29.333580 26076 recover.cpp:188] Received a recover response
>> > from a replica in EMPTY status
>> > I1016 16:12:29.838642 26071 replica.cpp:638] Replica in EMPTY status
>> > received a broadcasted recover request
>> > I1016 16:12:29.838726 26070 recover.cpp:188] Received a recover response
>> > from a replica in EMPTY status
>> > ^CI1016 16:12:30.623003 26076 replica.cpp:638] Replica in EMPTY status
>> > received a broadcasted recover request
>> > I1016 16:12:30.623085 26071 recover.cpp:188] Received a recover response
>> > from a replica in EMPTY status
>> >
>> > /*******************************************
>> >  Joe Stein
>> >  Founder, Principal Consultant
>> >  Big Data Open Source Security LLC
>> >  http://www.stealth.ly
>> >  Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>> > ********************************************/
>> >
>> > On Thu, Oct 16, 2014 at 11:41 AM, Jay Buffington <me@jaybuff.com> wrote:
>> >
>> > > This was fixed about three months ago:
>> > > https://issues.apache.org/jira/browse/AURORA-584  Perhaps you're
>> > > running an older version that doesn't have that commit?
>> > >
>> > > The tl;dr of that jira is that when you go to a scheduler that isn't
>> > > the leader it should do a HTTP redirect (302?) to the leader.
>> > >
>> > > Jay
>> > >
>> > >
>> > > On Thu, Oct 16, 2014 at 8:15 AM, Joe Stein <joe.stein@stealth.ly>
>> wrote:
>> > > > Hi, I am getting an error when going to /scheduler in the UI and not
>> > sure
>> > > > what it is. Thanks in advance!!!
>> > > >
>> > > >
>> > > > W1016 15:13:14.419 THREAD133
>> > > > org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke:
>> > > Uncaught
>> > > > transient exception while handling getRoleSummary()
>> > > >
>> org.apache.aurora.scheduler.storage.Storage$TransientStorageException:
>> > > > Storage is not READY
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.storage.CallOrderEnforcingStorage.checkInState(CallOrderEnforcingStorage.java:78)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.storage.CallOrderEnforcingStorage.weaklyConsistentRead(CallOrderEnforcingStorage.java:122)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.storage.Storage$Util.weaklyConsistentFetchTasks(Storage.java:307)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.thrift.SchedulerThriftInterface.getRoleSummary(SchedulerThriftInterface.java:582)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.thrift.aop.ServerInfoInterceptor.invoke(ServerInfoInterceptor.java:32)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.thrift.aop.ThriftStatsExporterInterceptor.invoke(ThriftStatsExporterInterceptor.java:47)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.thrift.aop.FeatureToggleInterceptor.invoke(FeatureToggleInterceptor.java:38)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke(LoggingInterceptor.java:88)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.gen.ReadOnlyScheduler$Processor$getRoleSummary.getResult(ReadOnlyScheduler.java:946)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.aurora.gen.ReadOnlyScheduler$Processor$getRoleSummary.getResult(ReadOnlyScheduler.java:931)
>> > > > at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>> > > > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>> > > > at org.apache.thrift.server.TServlet.doPost(TServlet.java:83)
>> > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>> > > > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58)
>> > > > at
>> > > >
>> > >
>> >
>> com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:168)
>> > > >
>> > > >
>> > > > /*******************************************
>> > > >  Joe Stein
>> > > >  Founder, Principal Consultant
>> > > >  Big Data Open Source Security LLC
>> > > >  http://www.stealth.ly
>> > > >  Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>> > > > ********************************************/
>> > >
>> >
>>
>>
>>
>> --
>> Zameer Manji
>>

Mime
View raw message