openldap-bugs

openldap-bugs@openldap.org

1 participants
21003 discussions

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by quanah＠zimbra.com 07 Jan '14

07 Jan '14

--On Tuesday, January 07, 2014 10:03 PM +0000 wietse(a)porcupine.org wrote: > Having obtained the patch off-list, I confirm that this call-back > feature works satisfactorily, and that this ITS can be closed. > > I am looking forward to the next LMDB release. Hi Wietse, I'm currently working with the dev team to get a new release out in the next week or so. --Quanah -- Quanah Gibson-Mount Architect - Server Zimbra, Inc. -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by wietse＠porcupine.org 07 Jan '14

07 Jan '14

Wietse Venema: > Hallvard Breien Furuseth: > > Pushed to mdb.master. > > > > void assert_callback(MDB_env *env, const char *msg) { > > void *ctx = mdb_env_get_userctx(env); > > ...; > > } > > > > mdb_env_create(&env); > > mdb_env_set_userctx(env, ctx); > > mdb_env_set_assert(env, assert_callback); Having obtained the patch off-list, I confirm that this call-back feature works satisfactorily, and that this ITS can be closed. I am looking forward to the next LMDB release. Wietse

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by wietse＠porcupine.org 07 Jan '14

07 Jan '14

Hallvard Breien Furuseth: > Pushed to mdb.master. > > void assert_callback(MDB_env *env, const char *msg) { > void *ctx = mdb_env_get_userctx(env); > ...; > } > > mdb_env_create(&env); > mdb_env_set_userctx(env, ctx); > mdb_env_set_assert(env, assert_callback); 1) Where can I find this patch? I would like to confirm that the code works without surprises. 2) Will this code be part of LMDB 0.9.11 (or some other number)? That allows me to use the correct #ifdef in my code. 3) What is the expected release time frame for this code? If it's close enough to the Postfix 2.11 stable release late January, then it can include LMDB support. Wietse

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by h.b.furuseth＠usit.uio.no 06 Jan '14

06 Jan '14

Pushed to mdb.master. void assert_callback(MDB_env *env, const char *msg) { void *ctx = mdb_env_get_userctx(env); ...; } mdb_env_create(&env); mdb_env_set_userctx(env, ctx); mdb_env_set_assert(env, assert_callback); -- Hallvard

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by h.b.furuseth＠usit.uio.no 05 Jan '14

05 Jan '14

On 2014-01-05 20:03, hyc(a)symas.com wrote: > I made this comment to Hallvard as well. It should be: > > MDB_assert_func * > mdb_env_set_assert(MDB_env *env, MDB_assert_func *func, void *info); Yes, I missed that. Hadn't intended to take this ITS into such a detour. Maybe such a context argument can be useful outside asserts too though, like a Python wrapper which wants the Python element wrapping the MDB_env of a given txn. If so, instead of passing the context to mdb_env_set_assert(): int mdb_env_set_userctx(env, void *ctx); void *mdb_env_get_userctx(env); assert() could still pass it out to the assert fallback. -- Hallvard

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by hyc＠symas.com 05 Jan '14

05 Jan '14

wietse(a)porcupine.org wrote: > Wietse Venema: >>> env can be NULL. mdb_env_set_assert(env,cb) also sets a static >>> variable with the callback for the asserts which do not know of an >>> env. Could throw away that part later. Currently it only applies >>> to one assert(). >>> >>> The branch also invalidates a transaction on any page allocation >>> error, since the callers do not always clean up afterwards. Too >>> aggressive, can be reverted after updating the callers. But for >>> now it means MDB_MAP_FULL & co won't let the user commit an >>> inconsistent transaction. >> >> Thanks, this is more improvement than I asked for. I don't want to >> slip my schedule, and to avoid last-minute surprises, I will postpone >> the review and impact test of these improvements after the stable >> Postfix release 2-3 weeks from today. > > It looks like you are switching from a stop-gap fix (bare-bones > call-back) to a more permanent solution. > > In that case I must mention again that I need to register not only > a call-back function pointer but also a void* pointer that is > returned to me at call-back time. > > Getting the MDB_env at call-back time does not help me at all, > because my programs open many databases (including non-LMDB). I made this comment to Hallvard as well. It should be: MDB_assert_func * mdb_env_set_assert(MDB_env *env, MDB_assert_func *func, void *info); with the info being passed thru to the callback. > To find out which database is affected I need my own pointer to my > own (DICT) object that encapsulates the LMDB database. Then I can > decide if the problem is with a disposable cache. in which case the > program can continue with degraded performance. > > Wietse > > > -- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by wietse＠porcupine.org 05 Jan '14

05 Jan '14

Wietse Venema: > > env can be NULL. mdb_env_set_assert(env,cb) also sets a static > > variable with the callback for the asserts which do not know of an > > env. Could throw away that part later. Currently it only applies > > to one assert(). > > > > The branch also invalidates a transaction on any page allocation > > error, since the callers do not always clean up afterwards. Too > > aggressive, can be reverted after updating the callers. But for > > now it means MDB_MAP_FULL & co won't let the user commit an > > inconsistent transaction. > > Thanks, this is more improvement than I asked for. I don't want to > slip my schedule, and to avoid last-minute surprises, I will postpone > the review and impact test of these improvements after the stable > Postfix release 2-3 weeks from today. It looks like you are switching from a stop-gap fix (bare-bones call-back) to a more permanent solution. In that case I must mention again that I need to register not only a call-back function pointer but also a void* pointer that is returned to me at call-back time. Getting the MDB_env at call-back time does not help me at all, because my programs open many databases (including non-LMDB). To find out which database is affected I need my own pointer to my own (DICT) object that encapsulates the LMDB database. Then I can decide if the problem is with a disposable cache. in which case the program can continue with degraded performance. Wietse

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by wietse＠porcupine.org 05 Jan '14

05 Jan '14

Hallvard Breien Furuseth: > Drafted a branch "mdb/assert" in > <http://folk.uio.no/hbf/OpenLDAP/mdb.git/> and on Ada, based > roughly on Howard's original message to you. I didn't know about > that at first, which has caused some confusion. > > So the callback usually receives an env after all, and a NULL > context since I don't know what Howard intended there. > > Howard, do I push this? Feel free to grab it and tweak a bit:) > > env can be NULL. mdb_env_set_assert(env,cb) also sets a static > variable with the callback for the asserts which do not know of an > env. Could throw away that part later. Currently it only applies > to one assert(). > > The branch also invalidates a transaction on any page allocation > error, since the callers do not always clean up afterwards. Too > aggressive, can be reverted after updating the callers. But for > now it means MDB_MAP_FULL & co won't let the user commit an > inconsistent transaction. Thanks, this is more improvement than I asked for. I don't want to slip my schedule, and to avoid last-minute surprises, I will postpone the review and impact test of these improvements after the stable Postfix release 2-3 weeks from today. Wietse

1 0

Re: (ITS#7775) LMDB terminates Postfix daemon process without logfile record
by h.b.furuseth＠usit.uio.no 05 Jan '14

05 Jan '14

Drafted a branch "mdb/assert" in <http://folk.uio.no/hbf/OpenLDAP/mdb.git/> and on Ada, based roughly on Howard's original message to you. I didn't know about that at first, which has caused some confusion. So the callback usually receives an env after all, and a NULL context since I don't know what Howard intended there. Howard, do I push this? Feel free to grab it and tweak a bit:) env can be NULL. mdb_env_set_assert(env,cb) also sets a static variable with the callback for the asserts which do not know of an env. Could throw away that part later. Currently it only applies to one assert(). The branch also invalidates a transaction on any page allocation error, since the callers do not always clean up afterwards. Too aggressive, can be reverted after updating the callers. But for now it means MDB_MAP_FULL & co won't let the user commit an inconsistent transaction. -- Hallvard

1 0

Re: (ITS#7774) LMDB assertion failure during Postfix cache cleanup
by wietse＠porcupine.org 03 Jan '14

03 Jan '14

Hallvard Breien Furuseth: > I wrote: > >Wietse Venema writes: > >> I can confirm that with LMDB-0.9.10 + ITS#7756 patch, the assertion > >> failure goes away when I close the cursor (and its read transaction) > >> before changing the map or the database, and restore the cursor > >> afterwards. I guess this got broken when things were changed to use > >> external locks in order to avoid world-writable lockfiles. > > Does this mean we can close this ITS? You can close this ITS. Wietse

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

openldap-bugs