aurora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Oliver, James" <James.Oli...@pegs.com>
Subject Re: Storage is not READY
Date Thu, 16 Oct 2014 19:57:21 GMT
Huzzah! Thanks Jie!!


On 10/16/14 12:29 PM, "Bill Farner" <wfarner@apache.org> wrote:

>You can all rejoice, Jie stepped up and posted a patch :-)
>
>https://reviews.apache.org/r/26815/
>
>-=Bill
>
>On Thu, Oct 16, 2014 at 9:56 AM, Oliver, James <James.Oliver@pegs.com>
>wrote:
>
>> +1
>>
>> This bit me a while back.
>>
>>
>>
>> On 10/16/14 9:35 AM, "Jay Buffington" <me@jaybuff.com> wrote:
>>
>> >We should fix this bug in Mesos:
>> >https://issues.apache.org/jira/browse/MESOS-1703
>> >
>> >If the error message hadn't been terrible, Joe could have easily fixed
>> >and moved on.
>> >
>> >On Thu, Oct 16, 2014 at 9:32 AM, Bill Farner <wfarner@apache.org>
>>wrote:
>> >> Piggy-backing on Zameer's reply:
>> >>
>> >>
>> 
>>https://github.com/apache/incubator-aurora/blob/master/docs/deploying-aur
>> >>ora-scheduler.md#initializing-the-replicated-log
>> >>
>> >> Relevant ticket for today's doc day,
>> >> https://issues.apache.org/jira/browse/AURORA-840
>> >>
>> >> -=Bill
>> >>
>> >> On Thu, Oct 16, 2014 at 9:30 AM, Zameer Manji
>><zmanji@twopensource.com>
>> >> wrote:
>> >>
>> >>> Did you initialize the replicated log?
>> >>>
>> >>> On Thu, Oct 16, 2014 at 9:13 AM, Joe Stein <joe.stein@stealth.ly>
>> >>>wrote:
>> >>>
>> >>> > My build is from latest master. I only have one scheduler
>>running.  I
>> >>> also
>> >>> > see this in the log over and over (and over and over) again. Not
>> >>>sure it
>> >>> is
>> >>> > related.
>> >>> >
>> >>> > I1016 16:12:27.234133 26081 replica.cpp:638] Replica in EMPTY
>>status
>> >>> > received a broadcasted recover request
>> >>> > I1016 16:12:27.234256 26084 recover.cpp:188] Received a recover
>> >>>response
>> >>> > from a replica in EMPTY status
>> >>> > I1016 16:12:27.804043 26069 replica.cpp:638] Replica in EMPTY
>>status
>> >>> > received a broadcasted recover request
>> >>> > I1016 16:12:27.804126 26081 recover.cpp:188] Received a recover
>> >>>response
>> >>> > from a replica in EMPTY status
>> >>> > I1016 16:12:28.515256 26078 replica.cpp:638] Replica in EMPTY
>>status
>> >>> > received a broadcasted recover request
>> >>> > I1016 16:12:28.515329 26078 recover.cpp:188] Received a recover
>> >>>response
>> >>> > from a replica in EMPTY status
>> >>> > I1016 16:12:29.333498 26084 replica.cpp:638] Replica in EMPTY
>>status
>> >>> > received a broadcasted recover request
>> >>> > I1016 16:12:29.333580 26076 recover.cpp:188] Received a recover
>> >>>response
>> >>> > from a replica in EMPTY status
>> >>> > I1016 16:12:29.838642 26071 replica.cpp:638] Replica in EMPTY
>>status
>> >>> > received a broadcasted recover request
>> >>> > I1016 16:12:29.838726 26070 recover.cpp:188] Received a recover
>> >>>response
>> >>> > from a replica in EMPTY status
>> >>> > ^CI1016 16:12:30.623003 26076 replica.cpp:638] Replica in EMPTY
>> >>>status
>> >>> > received a broadcasted recover request
>> >>> > I1016 16:12:30.623085 26071 recover.cpp:188] Received a recover
>> >>>response
>> >>> > from a replica in EMPTY status
>> >>> >
>> >>> > /*******************************************
>> >>> >  Joe Stein
>> >>> >  Founder, Principal Consultant
>> >>> >  Big Data Open Source Security LLC
>> >>> >  http://www.stealth.ly
>> >>> >  Twitter: @allthingshadoop
>><http://www.twitter.com/allthingshadoop>
>> >>> > ********************************************/
>> >>> >
>> >>> > On Thu, Oct 16, 2014 at 11:41 AM, Jay Buffington <me@jaybuff.com>
>> >>>wrote:
>> >>> >
>> >>> > > This was fixed about three months ago:
>> >>> > > https://issues.apache.org/jira/browse/AURORA-584  Perhaps
you're
>> >>> > > running an older version that doesn't have that commit?
>> >>> > >
>> >>> > > The tl;dr of that jira is that when you go to a scheduler
that
>> >>>isn't
>> >>> > > the leader it should do a HTTP redirect (302?) to the leader.
>> >>> > >
>> >>> > > Jay
>> >>> > >
>> >>> > >
>> >>> > > On Thu, Oct 16, 2014 at 8:15 AM, Joe Stein
>><joe.stein@stealth.ly>
>> >>> wrote:
>> >>> > > > Hi, I am getting an error when going to /scheduler in
the UI
>>and
>> >>>not
>> >>> > sure
>> >>> > > > what it is. Thanks in advance!!!
>> >>> > > >
>> >>> > > >
>> >>> > > > W1016 15:13:14.419 THREAD133
>> >>> > > > 
>>org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke:
>> >>> > > Uncaught
>> >>> > > > transient exception while handling getRoleSummary()
>> >>> > > >
>> >>> 
>>org.apache.aurora.scheduler.storage.Storage$TransientStorageException:
>> >>> > > > Storage is not READY
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.storage.CallOrderEnforcingStorage.checkInS
>>>>>ta
>> >>>te(CallOrderEnforcingStorage.java:78)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.storage.CallOrderEnforcingStorage.weaklyCo
>>>>>ns
>> >>>istentRead(CallOrderEnforcingStorage.java:122)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.storage.Storage$Util.weaklyConsistentFetch
>>>>>Ta
>> >>>sks(Storage.java:307)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.thrift.SchedulerThriftInterface.getRoleSum
>>>>>ma
>> >>>ry(SchedulerThriftInterface.java:582)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.thrift.aop.ServerInfoInterceptor.invoke(Se
>>>>>rv
>> >>>erInfoInterceptor.java:32)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> >>>
>> org.apache.aurora.scheduler.thrift.aop.ThriftStatsExporterInterceptor.in
>> >>>voke(ThriftStatsExporterInterceptor.java:47)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.thrift.aop.FeatureToggleInterceptor.invoke
>>>>>(F
>> >>>eatureToggleInterceptor.java:38)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.scheduler.thrift.aop.LoggingInterceptor.invoke(Loggi
>>>>>ng
>> >>>Interceptor.java:88)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.gen.ReadOnlyScheduler$Processor$getRoleSummary.getRe
>>>>>su
>> >>>lt(ReadOnlyScheduler.java:946)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>org.apache.aurora.gen.ReadOnlyScheduler$Processor$getRoleSummary.getRe
>>>>>su
>> >>>lt(ReadOnlyScheduler.java:931)
>> >>> > > > at
>> >>>org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
>> >>> > > > at
>> >>>org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
>> >>> > > > at org.apache.thrift.server.TServlet.doPost(TServlet.java:83)
>> >>> > > > at 
>>javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
>> >>> > > > at 
>>javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.ServletDefinition.doService(ServletDefinitio
>>>>>n.
>> >>>java:263)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.ServletDefinition.service(ServletDefinition.
>>>>>ja
>> >>>va:178)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.ManagedServletPipeline.service(ManagedServle
>>>>>tP
>> >>>ipeline.java:91)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainIn
>>>>>vo
>> >>>cation.java:62)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.j
>>>>>av
>> >>>a:168)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainIn
>>>>>vo
>> >>>cation.java:58)
>> >>> > > > at
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> 
>>>>>com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.j
>>>>>av
>> >>>a:168)
>> >>> > > >
>> >>> > > >
>> >>> > > > /*******************************************
>> >>> > > >  Joe Stein
>> >>> > > >  Founder, Principal Consultant
>> >>> > > >  Big Data Open Source Security LLC
>> >>> > > >  http://www.stealth.ly
>> >>> > > >  Twitter: @allthingshadoop
>> >>><http://www.twitter.com/allthingshadoop>
>> >>> > > > ********************************************/
>> >>> > >
>> >>> >
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>> Zameer Manji
>> >>>
>>
>>


Mime
View raw message