couchdb-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joan Touzet <woh...@apache.org>
Subject Re: CouchDB 2.0 blog series
Date Wed, 27 Jul 2016 17:47:25 GMT
We had a question in IRC recently about compaction of individual shards
and having to go through the 5986 port. Some discussion of when this is
necessary and why would be most useful.

-Joan

----- Original Message -----
> From: "Mayya Sharipova" <mayyas@ca.ibm.com>
> To: dev@couchdb.apache.org
> Sent: Wednesday, July 27, 2016 12:59:21 PM
> Subject: Re: CouchDB 2.0 blog series
> 
> Hello everyone!
> Does anyone know any user-facing changes in compaction between v1.6
> and v2.0?
> 
> Jay and me have identified the following two changes that we would
> like to address in the blog:
> 
> 1) use ioq to separately prioritise compaction requests
>  https://github.com/apache/couchdb-couch/commit/95b60be72c271db1fc4317c9a1aa0a1537798fda
> 
> 2) improved compaction efficiency with a temp file:
>  https://github.com/apache/couchdb-couch/commit/9d830590f8a9a699315c78b329a8e80079ed48bd
> 
> 
> Were there any other major changes that worth mentioning in the
> compaction blog?
> 
> Thanks,
> Mayya
> 
> 
> 
> 
> 
> -----Jenn Turner <jenn@thehoodiefirm.com> wrote: -----
> To: "dev@couchdb.apache.org" <dev@couchdb.apache.org>
> From: Jenn Turner <jenn@thehoodiefirm.com>
> Date: 07/25/2016 02:14PM
> Cc: "dev@couchdb.apache.org" <dev@couchdb.apache.org>,
> "marketing@couchdb.apache.org" <marketing@couchdb.apache.org>
> Subject: Re: CouchDB 2.0 blog series
> 
> Hello!
> 
>   
> 
> Based on the responses to my initial requests for volunteers I’ve put
> together
> a tentative schedule for the series. I've also created issues in JIRA
> and if
> there aren't any objections, I'll be assigning these dates as the due
> dates.
> 
>   
> 
> Please let me know if these dates don’t work for you!
> 
>   
> 
> Week 1
> Jul 25: The Road to CouchDB 2.0, Jan Lehnardt
> Jul 27: Feature: Fauxton, Garren Smith
>   
> Week 2
> Aug 1: The CouchDB 2.0 Architecture, Robert Newson
> Aug 3: Feature: Mango query, Tony Sun
>   
> Week 3
> Aug 8: Release Candidates, Joan Touzet
> Aug 10: Feature: compactor, Maaya Sharipova
>   
> Week 4
> Aug 15: Feature: replicator, Nick Vatamaniuc
> Aug 17: Migration Guide, (need volunteer)
>   
> Week 5
> Aug 22: Miscellaneous improvements and bugfixes, Jan Lehnardt
> 
>   
> 
> Also – For the Migration Guide post, we had a volunteer, but I'd like
> to pair
> them up with someone who has been on the project a bit longer, is
> there anyone
> who wants to volunteer to do that?
> 
>   
> 
> Thanks again to everyone who has volunteered, you're awesome :D
> 
>   
> 
> Jenn Turner
> 
> The Neighbourhoodie Software GmbH
> Adalbertstr. 7-8, 10999 Berlin
> [neighbourhood.ie](https://link.nylas.com/link/c4yg26doe3du1m7gpdgdrj1jp
> /local-667de70f-
> 5a2e/0?redirect=http%3A%2F%2Fneighbourhood.ie%2F&r=ZGV2QGNvdWNoZGIuYXBhY2hlLm9yZw==
> "http://neighbourhood.ie/" )
>   
> 
> Handelsregister HRB 157851 B Amtsgericht Charlottenburg
> Geschäftsführung: Jan Lehnardt
> 
>   
> 
> On Jul 25 2016, at 2:19 am, Andy Wenk &lt;andywenk@apache.org>;
> wrote:
> 
> > awesome !!!! Spread the word everybody !
> 
> >
> 
> > Cheers
> 
> >
> 
> > Andy
> 
> >
> 
> > \--
> > Andy Wenk
> > RockIt!
> 
> >
> 
> > Hamburg / Germany
> 
> >
> 
> > GPG public key:
> https://pgp.mit.edu/pks/lookup?op=get&amp;search=0x4F1D0C59BC90917D
> 
> >
> 
> > &gt; On 25 Jul 2016, at 11:14, Jan Lehnardt &lt;jan@apache.org>;
> > wrote:
> > &gt;
> > &gt; And we’re live:
> > https://blog.couchdb.org/2016/07/25/the-road-to-
> couchdb-2-0/
> > &gt;
> > &gt; Thanks everyone for their comments! &lt;3
> > &gt;
> > &gt; Best
> > &gt; Jan
> > &gt; \--
> > &gt;
> > &gt;&gt; On 24 Jul 2016, at 18:43, Jan Lehnardt
> > &lt;jan@apache.org>;
> wrote:
> > &gt;&gt;
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; On 19 Jul 2016, at 22:07, Jenn Turner
> &lt;jenn@thehoodiefirm.com>; wrote:
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Hello there!
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; We’re getting closer to releasing CouchDB 2.0 and
> > leading up to
> its official
> > &gt;&gt;&gt; release, we want to publish a series of blog posts
> > examining
> topics like the
> > &gt;&gt;&gt; history of the project, differences between the 2.0
> > and 1.0
> architecture,
> > &gt;&gt;&gt; unpacking the new features, and so forth.
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; To accomplish this **we need your help**, we need 7-8
> > CouchDB
> users to help
> > &gt;&gt;&gt; write these posts. Don’t worry, we’re not after
> > Shakespeare
> here, just
> > &gt;&gt;&gt; introducing an idea in 200-300 words, to get folks
> > interested
> in CouchDB 2.0.
> > &gt;&gt;&gt; I’ll be available to help with editing and
> > coordinating the
> publication
> > &gt;&gt;&gt; schedule.
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Ideally, we’ll be able to release two posts a week,
> > one on
> Monday and
> > &gt;&gt;&gt; Wednesday, with the weekly news still going out on
> > Thursdays,
> so we’re not
> > &gt;&gt;&gt; over saturating the blog. Jan Lehnardt has volunteered
> > to kick
> off the series
> > &gt;&gt;&gt; next week, with a post on the The Road to CouchDB 2.0
> > on
> Monday.
> > &gt;&gt;
> > &gt;&gt; Here’s my first draft:
> > https://docs.google.com/document/d/1S-
> LMaEsVQD0MXX4VEzbC8j_nWJcnbmlTKuMK8NksLKk/edit#
> &lt;https://docs.google.com/document/d/1S-
> LMaEsVQD0MXX4VEzbC8j_nWJcnbmlTKuMK8NksLKk/edit#&gt;
> > &gt;&gt;
> > &gt;&gt; Jenn has editing permissions, everybody else, please leave
> comments.
> > &gt;&gt;
> > &gt;&gt; Paul or Bob, if you have the photo of Bob on Paul’s couch
> somewhere, we could include it :)
> > &gt;&gt;
> > &gt;&gt; Best
> > &gt;&gt; Jan
> > &gt;&gt; \--
> > &gt;&gt;
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; That means we need a volunteer to write one for next
> > Wednesday,
> July 27. We’re
> > &gt;&gt;&gt; still tossing around ideas for giving the 7-8 authors
> > of these
> posts a special
> > &gt;&gt;&gt; kind of CouchDB swag, if that helps. :)
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Below is a list of topics (also important: if you have
> > an idea
> for a topic you
> > &gt;&gt;&gt; **don’t see** below, please let us know!):
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; **The Road to CouchDB 2.0**: (Jan)
> > &gt;&gt;&gt; \\- History of the big Couch fork
> > &gt;&gt;&gt; \\- Cloudant
> > &gt;&gt;&gt; \\- Big Couch merge announcement
> > &gt;&gt;&gt; \\- Davisphack (rnewson on the couch)
> > &gt;&gt;&gt; \\- Windsor merge
> > &gt;&gt;&gt; \\- New build system
> > &gt;&gt;&gt; \\- Cluster setup
> > &gt;&gt;&gt; \\- Tests! Tests! Tests!
> > &gt;&gt;&gt; \\- RC1
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; **The CouchDB 2.0 Architecture**: (need volunteer)
> > &gt;&gt;&gt; \\- Dynamo
> > &gt;&gt;&gt; \\- BigCouch
> > &gt;&gt;&gt; \\- Cluster/Shards/Consistency
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; **Release Candidates**: (need volunteer)
> > &gt;&gt;&gt; \\- Please test:
> > &gt;&gt;&gt; \\- Install
> > &gt;&gt;&gt; \\- 1 node
> > &gt;&gt;&gt; \\- 3 node
> > &gt;&gt;&gt; \\- n node
> > &gt;&gt;&gt; \\- App Devs &amp;amp; Library devs:
> > &gt;&gt;&gt; \\- Run your software against each
> > &gt;&gt;&gt; \\- Fix any issues on your side
> > &gt;&gt;&gt; \\- Report any issues to us
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; **Migration Guide**: (need volunteer)
> > &gt;&gt;&gt; \\- 99% is the same
> > &gt;&gt;&gt; \\- update_seq is opaque string now
> > &gt;&gt;&gt; \\- Changes feed can include duplicates
> > &gt;&gt;&gt; \\- JS apps using /_utils/*.js: copy 1.6 files and put
> > into
> your apps
> > &gt;&gt;&gt; \\- /_config is not available on the cluster, but
> > there is
> /_node/&amp;lt;fqdn&amp;gt;/
> > &gt;&gt;&gt; _config/ for your setup needs, make sure you do it on
> > all nodes
> > &gt;&gt;&gt; \\- Test suites:
> > &gt;&gt;&gt; \\- If you are creating and deleting databases in
> > quick
> succession, start using
> > &gt;&gt;&gt; unique db names (and add cleanup)
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; New features posts
> > &gt;&gt;&gt; \\- **Feature: compactor** (need volunteer)
> > &gt;&gt;&gt; \\- faster
> > &gt;&gt;&gt; \\- lower i/o
> > &gt;&gt;&gt; \\- more compact files
> > &gt;&gt;&gt; \\- faster post compaction files
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; \\- **Feature: replicator** (need volunteer)
> > &gt;&gt;&gt; \\- TBD
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; \\- **Feature: fauxton** (need volunteer)
> > &gt;&gt;&gt; \\- Complete rewrite
> > &gt;&gt;&gt; \\- First Backbone
> > &gt;&gt;&gt; \\- Now React
> > &gt;&gt;&gt; \\- Extendable
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; \\- **Feature: Mango query** (need volunteer)
> > &gt;&gt;&gt; \\- Import from Cloudant Query
> > &gt;&gt;&gt; \\- MongoDB-inspired query language
> > &gt;&gt;&gt; \\- Create indexes
> > &gt;&gt;&gt; \\- Query patterns
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; \\- **Miscellaneous improvements and bugfixes** (need
> volunteer)
> > &gt;&gt;&gt; \\- /_db_updates gets persisted, supports ?since like
> > changes
> > &gt;&gt;&gt; \\- Preview: view based changes
> > &gt;&gt;&gt; \\- Uses rebar under the hood for building, ditched
> > autotools
> \o/
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Also, if you have an idea of someone who would be a
> > good
> candidate to write
> > &gt;&gt;&gt; one of these blog posts, let me know so I can reach
> > out to
> them.
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Please help us get the community excited for the
> > changes coming
> to CouchDB. :D
> > &gt;&gt;&gt; :D :D
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Cheers!
> > &gt;&gt;&gt;
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Jenn Turner
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; The Neighbourhoodie Software GmbH
> > &gt;&gt;&gt; Adalbertstr. 7-8, 10999 Berlin
> > &gt;&gt;&gt;
> [neighbourhood.ie](https://link.nylas.com/link/c4yg26doe3du1m7gpdgdrj1jp
> > &gt;&gt;&gt; /local-eda5af1b-
> > &gt;&gt;&gt;
> bbb8/0?redirect=http%3A%2F%2Fneighbourhood.ie%2F&amp;r=bWFya2V0aW5nQGNvdWNoZGIuYXBhY2hlLm9yZw==
> > &gt;&gt;&gt; "http://neighbourhood.ie/" )
> > &gt;&gt;&gt;
> > &gt;&gt;&gt;
> > &gt;&gt;&gt; Handelsregister HRB 157851 B Amtsgericht
> > Charlottenburg
> > &gt;&gt;&gt; Geschäftsführung: Jan Lehnardt
> > &gt;&gt;&gt;
> > &gt;&gt;
> > &gt;&gt; \--
> > &gt;&gt; Professional Support for Apache CouchDB:
> > &gt;&gt; https://neighbourhood.ie/couchdb-support/
> &lt;https://neighbourhood.ie/couchdb-support/&gt;
> > &gt; \--
> > &gt; Professional Support for Apache CouchDB:
> > &gt; https://neighbourhood.ie/couchdb-support/
> > &gt;
> 
> 
> 

Mime
View raw message