Hi
Are there any battle-tested good practices for incrementally replicating LMDB?
Cheers, -Kristoffer
Kristoffer Sjögren wrote:
Hi
Are there any battle-tested good practices for incrementally replicating LMDB?
There are quite a few distributed data systems out there built on top of LMDB. Replication isn't really a subject area that's relevant to an embedded data store.
We are still planning to add incremental backup in LMDB 1.0. Other mechanisms could be built on top of that pretty easily.
Yes, the most non-intrusive I found is dynomite, but i'm not sure how mature it is and there are no bindings for lmdb. But memcachedb with lmdb might be an option?
Incremental backup would be an awesome feature.
On Thu, Jul 23, 2015 at 12:44 AM, Howard Chu hyc@symas.com wrote:
Kristoffer Sjögren wrote:
Hi
Are there any battle-tested good practices for incrementally replicating LMDB?
There are quite a few distributed data systems out there built on top of LMDB. Replication isn't really a subject area that's relevant to an embedded data store.
We are still planning to add incremental backup in LMDB 1.0. Other mechanisms could be built on top of that pretty easily.
-- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/
For anyone interested, I can confirm that memcachedb [1] and dynomite [2] seems to work fine together.
[1] https://github.com/LMDB/memcachedb [2] https://github.com/Netflix/dynomite
On Thu, Jul 23, 2015 at 12:27 PM, Kristoffer Sjögren stoffe@gmail.com wrote:
Yes, the most non-intrusive I found is dynomite, but i'm not sure how mature it is and there are no bindings for lmdb. But memcachedb with lmdb might be an option?
Incremental backup would be an awesome feature.
On Thu, Jul 23, 2015 at 12:44 AM, Howard Chu hyc@symas.com wrote:
Kristoffer Sjögren wrote:
Hi
Are there any battle-tested good practices for incrementally replicating LMDB?
There are quite a few distributed data systems out there built on top of LMDB. Replication isn't really a subject area that's relevant to an embedded data store.
We are still planning to add incremental backup in LMDB 1.0. Other mechanisms could be built on top of that pretty easily.
-- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/
openldap-technical@openldap.org
-
Howard Chu -
Kristoffer Sjögren