couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Samuel Newson <rnew...@apache.org>
Subject Re: CouchDB 2.0 blog series
Date Tue, 09 Aug 2016 12:56:08 GMT
I am working on a patch to restore _compact on 5984, yes. Mayya and Jay's advice on managing
this more carefully at the node level is still good advice and we should recommend it in general.
So long as we're clear about the downsides of hitting _compact on all shards (and all copies
of those shards), I think having the option is best.

> On 9 Aug 2016, at 12:11, Jan Lehnardt <jan@apache.org> wrote:
> 
> Great work Jay and Mayya!
> 
> I left a few minor suggestions.
> 
> @rnewson: could you look over the “compaction is a node-local operation” section,
I believe you were working on something?
> 
> Best
> Jan
> --
> 
>> On 09 Aug 2016, at 12:55, Mayya Sharipova <mayyas@ca.ibm.com> wrote:
>> 
>> Hello everyone!
>> Jay Doane and me have written a blog on compaction: https://docs.google.com/document/d/1PGkXpHri9cgAgV5Rb2U6UhucfdwfLR-FBgyZGWSxnhE/edit#heading=h.xp2dcsbjr3xh
>> 
>> We would appreciate your suggestions/comments on it.
>> 
>> Thanks,
>> Mayya
>> 
>> 
>> -----Garren Smith <garren@apache.org> wrote: -----
>> To: "dev@couchdb.apache.org" <dev@couchdb.apache.org>
>> From: Garren Smith <garren@apache.org>
>> Date: 08/08/2016 12:25PM
>> Subject: Re: CouchDB 2.0 blog series
>> 
>> Hi Sebastian,
>> 
>> That would be a useful blog post. +1 from me. The more blog posts the
>> better.
>> 
>> On Sunday, 07 August 2016, Sebastian Rothbucher <
>> sebastianrothbucher@googlemail.com> wrote:
>> 
>>> Hi there,
>>> 
>>> if you want, I can help w/ the migration guide and briefly write up some
>>> aspects on how 2 migrate application code (and data). Most we found during
>>> testing is already summed up in the jira ticket.
>>> 
>>> Let me know...
>>> 
>>> Best
>>>  Sebastian
>>> 
>>> 
>>> On Mon, Jul 25, 2016 at 8:13 PM, Jenn Turner <jenn@thehoodiefirm.com
>>> <javascript:;>> wrote:
>>> 
>>>> Hello!
>>>> 
>>>> 
>>>> 
>>>> Based on the responses to my initial requests for volunteers I’ve put
>>>> together
>>>> a tentative schedule for the series. I've also created issues in JIRA and
>>>> if
>>>> there aren't any objections, I'll be assigning these dates as the due
>>>> dates.
>>>> 
>>>> 
>>>> 
>>>> Please let me know if these dates don’t work for you!
>>>> 
>>>> 
>>>> 
>>>> Week 1
>>>> Jul 25: The Road to CouchDB 2.0, Jan Lehnardt
>>>> Jul 27: Feature: Fauxton, Garren Smith
>>>> 
>>>> Week 2
>>>> Aug 1: The CouchDB 2.0 Architecture, Robert Newson
>>>> Aug 3: Feature: Mango query, Tony Sun
>>>> 
>>>> Week 3
>>>> Aug 8: Release Candidates, Joan Touzet
>>>> Aug 10: Feature: compactor, Maaya Sharipova
>>>> 
>>>> Week 4
>>>> Aug 15: Feature: replicator, Nick Vatamaniuc
>>>> Aug 17: Migration Guide, (need volunteer)
>>>> 
>>>> Week 5
>>>> Aug 22: Miscellaneous improvements and bugfixes, Jan Lehnardt
>>>> 
>>>> 
>>>> 
>>>> Also – For the Migration Guide post, we had a volunteer, but I'd like to
>>>> pair
>>>> them up with someone who has been on the project a bit longer, is there
>>>> anyone
>>>> who wants to volunteer to do that?
>>>> 
>>>> 
>>>> 
>>>> Thanks again to everyone who has volunteered, you're awesome :D
>>>> 
>>>> 
>>>> 
>>>> Jenn Turner
>>>> 
>>>> The Neighbourhoodie Software GmbH
>>>> Adalbertstr. 7-8, 10999 Berlin
>>>> [neighbourhood.ie](https://link.nylas.com/link/c4yg26doe3du1m7gpdgdrj1jp
>>>> /local-667de70f-
>>>> 5a2e/0?redirect=http%3A%2F%2Fneighbourhood.ie%2F&r=
>>>> ZGV2QGNvdWNoZGIuYXBhY2hlLm9yZw==
>>>> "http://neighbourhood.ie/" )
>>>> 
>>>> 
>>>> Handelsregister HRB 157851 B Amtsgericht Charlottenburg
>>>> Geschäftsführung: Jan Lehnardt
>>>> 
>>>> 
>>>> 
>>>> On Jul 25 2016, at 2:19 am, Andy Wenk &lt;andywenk@apache.org
>>> <javascript:;>&gt; wrote:
>>>> 
>>>>> awesome !!!! Spread the word everybody !
>>>> 
>>>>> 
>>>> 
>>>>> Cheers
>>>> 
>>>>> 
>>>> 
>>>>> Andy
>>>> 
>>>>> 
>>>> 
>>>>> \--
>>>>> Andy Wenk
>>>>> RockIt!
>>>> 
>>>>> 
>>>> 
>>>>> Hamburg / Germany
>>>> 
>>>>> 
>>>> 
>>>>> GPG public key:
>>>> https://pgp.mit.edu/pks/lookup?op=get&amp;search=0x4F1D0C59BC90917D
>>>> 
>>>>> 
>>>> 
>>>>> &gt; On 25 Jul 2016, at 11:14, Jan Lehnardt &lt;jan@apache.org
>>> <javascript:;>&gt;
>>>> wrote:
>>>>> &gt;
>>>>> &gt; And we’re live: https://blog.couchdb.org/2016/07/25/the-road-to-
>>>> couchdb-2-0/
>>>>> &gt;
>>>>> &gt; Thanks everyone for their comments! &lt;3
>>>>> &gt;
>>>>> &gt; Best
>>>>> &gt; Jan
>>>>> &gt; \--
>>>>> &gt;
>>>>> &gt;&gt; On 24 Jul 2016, at 18:43, Jan Lehnardt &lt;jan@apache.org
>>> <javascript:;>&gt;
>>>> wrote:
>>>>> &gt;&gt;
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; On 19 Jul 2016, at 22:07, Jenn Turner
>>>> &lt;jenn@thehoodiefirm.com <javascript:;>&gt; wrote:
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Hello there!
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; We’re getting closer to releasing CouchDB
2.0 and leading
>>>> up to
>>>> its official
>>>>> &gt;&gt;&gt; release, we want to publish a series of blog
posts
>>> examining
>>>> topics like the
>>>>> &gt;&gt;&gt; history of the project, differences between
the 2.0 and
>>> 1.0
>>>> architecture,
>>>>> &gt;&gt;&gt; unpacking the new features, and so forth.
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; To accomplish this **we need your help**, we
need 7-8
>>>> CouchDB
>>>> users to help
>>>>> &gt;&gt;&gt; write these posts. Don’t worry, we’re not
after
>>> Shakespeare
>>>> here, just
>>>>> &gt;&gt;&gt; introducing an idea in 200-300 words, to get
folks
>>>> interested
>>>> in CouchDB 2.0.
>>>>> &gt;&gt;&gt; I’ll be available to help with editing and
coordinating
>>> the
>>>> publication
>>>>> &gt;&gt;&gt; schedule.
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Ideally, we’ll be able to release two posts
a week, one on
>>>> Monday and
>>>>> &gt;&gt;&gt; Wednesday, with the weekly news still going
out on
>>>> Thursdays,
>>>> so we’re not
>>>>> &gt;&gt;&gt; over saturating the blog. Jan Lehnardt has volunteered
to
>>>> kick
>>>> off the series
>>>>> &gt;&gt;&gt; next week, with a post on the The Road to CouchDB
2.0 on
>>>> Monday.
>>>>> &gt;&gt;
>>>>> &gt;&gt; Here’s my first draft: https://docs.google.com/document/d/1S-
>>>> LMaEsVQD0MXX4VEzbC8j_nWJcnbmlTKuMK8NksLKk/edit#
>>>> &lt;https://docs.google.com/document/d/1S-
>>>> LMaEsVQD0MXX4VEzbC8j_nWJcnbmlTKuMK8NksLKk/edit#&gt;
>>>>> &gt;&gt;
>>>>> &gt;&gt; Jenn has editing permissions, everybody else, please
leave
>>>> comments.
>>>>> &gt;&gt;
>>>>> &gt;&gt; Paul or Bob, if you have the photo of Bob on Paul’s
couch
>>>> somewhere, we could include it :)
>>>>> &gt;&gt;
>>>>> &gt;&gt; Best
>>>>> &gt;&gt; Jan
>>>>> &gt;&gt; \--
>>>>> &gt;&gt;
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; That means we need a volunteer to write one
for next
>>>> Wednesday,
>>>> July 27. We’re
>>>>> &gt;&gt;&gt; still tossing around ideas for giving the 7-8
authors of
>>>> these
>>>> posts a special
>>>>> &gt;&gt;&gt; kind of CouchDB swag, if that helps. :)
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Below is a list of topics (also important: if
you have an
>>>> idea
>>>> for a topic you
>>>>> &gt;&gt;&gt; **don’t see** below, please let us know!):
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; **The Road to CouchDB 2.0**: (Jan)
>>>>> &gt;&gt;&gt; \\- History of the big Couch fork
>>>>> &gt;&gt;&gt; \\- Cloudant
>>>>> &gt;&gt;&gt; \\- Big Couch merge announcement
>>>>> &gt;&gt;&gt; \\- Davisphack (rnewson on the couch)
>>>>> &gt;&gt;&gt; \\- Windsor merge
>>>>> &gt;&gt;&gt; \\- New build system
>>>>> &gt;&gt;&gt; \\- Cluster setup
>>>>> &gt;&gt;&gt; \\- Tests! Tests! Tests!
>>>>> &gt;&gt;&gt; \\- RC1
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; **The CouchDB 2.0 Architecture**: (need volunteer)
>>>>> &gt;&gt;&gt; \\- Dynamo
>>>>> &gt;&gt;&gt; \\- BigCouch
>>>>> &gt;&gt;&gt; \\- Cluster/Shards/Consistency
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; **Release Candidates**: (need volunteer)
>>>>> &gt;&gt;&gt; \\- Please test:
>>>>> &gt;&gt;&gt; \\- Install
>>>>> &gt;&gt;&gt; \\- 1 node
>>>>> &gt;&gt;&gt; \\- 3 node
>>>>> &gt;&gt;&gt; \\- n node
>>>>> &gt;&gt;&gt; \\- App Devs &amp;amp; Library devs:
>>>>> &gt;&gt;&gt; \\- Run your software against each
>>>>> &gt;&gt;&gt; \\- Fix any issues on your side
>>>>> &gt;&gt;&gt; \\- Report any issues to us
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; **Migration Guide**: (need volunteer)
>>>>> &gt;&gt;&gt; \\- 99% is the same
>>>>> &gt;&gt;&gt; \\- update_seq is opaque string now
>>>>> &gt;&gt;&gt; \\- Changes feed can include duplicates
>>>>> &gt;&gt;&gt; \\- JS apps using /_utils/*.js: copy 1.6 files
and put
>>> into
>>>> your apps
>>>>> &gt;&gt;&gt; \\- /_config is not available on the cluster,
but there is
>>>> /_node/&amp;lt;fqdn&amp;gt;/
>>>>> &gt;&gt;&gt; _config/ for your setup needs, make sure you
do it on all
>>>> nodes
>>>>> &gt;&gt;&gt; \\- Test suites:
>>>>> &gt;&gt;&gt; \\- If you are creating and deleting databases
in quick
>>>> succession, start using
>>>>> &gt;&gt;&gt; unique db names (and add cleanup)
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; New features posts
>>>>> &gt;&gt;&gt; \\- **Feature: compactor** (need volunteer)
>>>>> &gt;&gt;&gt; \\- faster
>>>>> &gt;&gt;&gt; \\- lower i/o
>>>>> &gt;&gt;&gt; \\- more compact files
>>>>> &gt;&gt;&gt; \\- faster post compaction files
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; \\- **Feature: replicator** (need volunteer)
>>>>> &gt;&gt;&gt; \\- TBD
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; \\- **Feature: fauxton** (need volunteer)
>>>>> &gt;&gt;&gt; \\- Complete rewrite
>>>>> &gt;&gt;&gt; \\- First Backbone
>>>>> &gt;&gt;&gt; \\- Now React
>>>>> &gt;&gt;&gt; \\- Extendable
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; \\- **Feature: Mango query** (need volunteer)
>>>>> &gt;&gt;&gt; \\- Import from Cloudant Query
>>>>> &gt;&gt;&gt; \\- MongoDB-inspired query language
>>>>> &gt;&gt;&gt; \\- Create indexes
>>>>> &gt;&gt;&gt; \\- Query patterns
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; \\- **Miscellaneous improvements and bugfixes**
(need
>>>> volunteer)
>>>>> &gt;&gt;&gt; \\- /_db_updates gets persisted, supports ?since
like
>>>> changes
>>>>> &gt;&gt;&gt; \\- Preview: view based changes
>>>>> &gt;&gt;&gt; \\- Uses rebar under the hood for building,
ditched
>>>> autotools
>>>> \o/
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Also, if you have an idea of someone who would
be a good
>>>> candidate to write
>>>>> &gt;&gt;&gt; one of these blog posts, let me know so I can
reach out to
>>>> them.
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Please help us get the community excited for
the changes
>>>> coming
>>>> to CouchDB. :D
>>>>> &gt;&gt;&gt; :D :D
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Cheers!
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Jenn Turner
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; The Neighbourhoodie Software GmbH
>>>>> &gt;&gt;&gt; Adalbertstr. 7-8, 10999 Berlin
>>>>> &gt;&gt;&gt;
>>>> [neighbourhood.ie](https://link.nylas.com/link/c4yg26doe3du1m7gpdgdrj1jp
>>>>> &gt;&gt;&gt; /local-eda5af1b-
>>>>> &gt;&gt;&gt;
>>>> bbb8/0?redirect=http%3A%2F%2Fneighbourhood.ie%2F&amp;r=
>>>> bWFya2V0aW5nQGNvdWNoZGIuYXBhY2hlLm9yZw==
>>>>> &gt;&gt;&gt; "http://neighbourhood.ie/" )
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;&gt; Handelsregister HRB 157851 B Amtsgericht Charlottenburg
>>>>> &gt;&gt;&gt; Geschäftsführung: Jan Lehnardt
>>>>> &gt;&gt;&gt;
>>>>> &gt;&gt;
>>>>> &gt;&gt; \--
>>>>> &gt;&gt; Professional Support for Apache CouchDB:
>>>>> &gt;&gt; https://neighbourhood.ie/couchdb-support/
>>>> &lt;https://neighbourhood.ie/couchdb-support/&gt;
>>>>> &gt; \--
>>>>> &gt; Professional Support for Apache CouchDB:
>>>>> &gt; https://neighbourhood.ie/couchdb-support/
>>>>> &gt;
>>>> 
>>>> 
>>> 
>> 
> 
> -- 
> Professional Support for Apache CouchDB:
> https://neighbourhood.ie/couchdb-support/
> 


Mime
View raw message