Hello, I've been trying past weeks upgrading my production openldap software. I started from 2.4.11 when it was available, through all available versions, up to 2.4.16. I tried package builds, and my own builds. Each version except 2.4.10 was likely to hang, as it's production, and load is quite high, I haven't too much patience to debug and researching what's actually going on, but I tried disabling syncrepl (no effect), some different settings for bdb backend and slapd thread, concurrency etc ( starting from settings which caused no problems with 2.4.10 ), and finally, got back to 2.4.10 which works fine. Between version change I noticed that 2.4.11+ is build with newer libdb versions (package depends), starting from libdb4.2 (2.4.10), up to libdb4.7 (newer openldap version). I didn't try to build 2.4.15+ with some old (4.2) libdb.
Is it some major significant jump between 2.4.10 and all later versions? some general rewrite of some feature ? It's not syncrepl related, as daemon hang no matter whether configured as slave or standalone. The symptoms was, it was (in general) producing BIGGER server load than 2.4.10, and, although daemon process did not segfaults, server stopped responding for requests (?). With higher load I wasn't able to try logging and use of debug symbols.
I expected it will work without any slapd.conf, anyway nor leaving it untouched, nor some minor reasonable changes had no effect.
So, what's going on? :) Is it possibly related to libdb ? or what? What else could it be ? Except libdb ( 5 different versions available in my system with one default, usually newest ), there was no other software change, just upgrading openldap/libldap.
Any clues you may have? I'm sorry I cannot provide more information, anyway config is rather standard and simple, some custom schemas added with indexing, that's all. 2.4.10 has no problems at all, and significantly lower general machine load. ( if 2.4.10 = 100%, 2.4.11+ makes 300-400% )
Actually I'm not expecting some miracle explanation, anyway it's interesting what could it be.. I have about 25 000 entries total in my directory tree, it's used as NSS source, and other information for various applications.
regards :) P.
--On Tuesday, April 21, 2009 9:11 PM +0200 Piotr Wadas pwadas@dtpw.pl wrote:
Hello, I've been trying past weeks upgrading my production openldap software. I started from 2.4.11 when it was available, through all available versions, up to 2.4.16. I tried package builds, and my own builds. Each version except 2.4.10 was likely to hang, as it's production, and load is quite high, I haven't too much patience to debug and researching what's actually going on, but I tried disabling syncrepl (no effect), some different settings for bdb backend and slapd thread, concurrency etc ( starting from settings which caused no problems with 2.4.10 ), and finally, got back to 2.4.10 which works fine. Between version change I noticed that 2.4.11+ is build with newer libdb versions
No. Only 2.4.12+ requires the higher BDB versions. 2.4.11 and previous have the same BDB requirements.
--Quanah
--
Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration
Quanah Gibson-Mount wrote:
--On Tuesday, April 21, 2009 9:11 PM +0200 Piotr Wadas pwadas@dtpw.pl wrote:
Hello, I've been trying past weeks upgrading my production openldap software. I started from 2.4.11 when it was available, through all available versions, up to 2.4.16. I tried package builds, and my own builds. Each version except 2.4.10 was likely to hang, as it's production, and load is quite high, I haven't too much patience to debug and researching what's actually going on, but I tried disabling syncrepl (no effect), some different settings for bdb backend and slapd thread, concurrency etc ( starting from settings which caused no problems with 2.4.10 ), and finally, got back to 2.4.10 which works fine. Between version change I noticed that 2.4.11+ is build with newer libdb versions
No. Only 2.4.12+ requires the higher BDB versions. 2.4.11 and previous have the same BDB requirements.
What is the minimum level of BDB required to support OpenLDAP > 2.4.11?
As you know, the change log for 2.4.12 says it added support for BDB 4.7.x and removed pre-BDB 4.4 which is very helpful. Should this be read as >= 4.4 is acceptable? Looking through the docs, changes and FAQomatic, I cannot find a definitive list of acceptable/required levels (which could include, OpenSSL, GnuTLS, SASL, etc). I was wondering if that list is somewhere I simply can't find. :-)
I'm running BDB 4.6.x with 2.4 and it seems fine for the tests I've done.
I'd be happy to contribute to the docs as I am sure the OpenLDAP team is swamped with other work. :-)
Cheers, Bill
--Quanah
--
Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc
Zimbra :: the leader in open source messaging and collaboration
--On Wednesday, April 22, 2009 7:17 AM -0400 William Jojo w.jojo@hvcc.edu wrote:
What is the minimum level of BDB required to support OpenLDAP > 2.4.11?
As you know, the change log for 2.4.12 says it added support for BDB 4.7.x and removed pre-BDB 4.4 which is very helpful. Should this be read as >= 4.4 is acceptable? Looking through the docs, changes and FAQomatic, I cannot find a definitive list of acceptable/required levels (which could include, OpenSSL, GnuTLS, SASL, etc). I was wondering if that list is somewhere I simply can't find. :-)
I'm running BDB 4.6.x with 2.4 and it seems fine for the tests I've done.
I'd be happy to contribute to the docs as I am sure the OpenLDAP team is swamped with other work. :-)
Hi Bill,
Did you read the README file shipped with OpenLDAP? I believe it addresses your questions.
REQUIRED SOFTWARE Building OpenLDAP Software requires a number of software packages to be preinstalled. Additional information regarding prerequisite software can be found in the OpenLDAP Administrator's Guide.
Base system (libraries and tools): Standard C compiler (required) Cyrus SASL 2.1.21+ (recommended) OpenSSL 0.9.7+ (recommended) Reentrant POSIX REGEX software (required)
SLAPD: BDB and HDB backends require Oracle Berkeley DB 4.4, 4.5, 4.6, or 4.7. It is highly recommended to apply the patches from Oracle for a given release.
CLIENTS/CONTRIB ware: Depends on package. See per package README.
--Quanah
--
Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration
Quanah Gibson-Mount wrote:
--On Wednesday, April 22, 2009 7:17 AM -0400 William Jojo w.jojo@hvcc.edu wrote:
What is the minimum level of BDB required to support OpenLDAP > 2.4.11?
As you know, the change log for 2.4.12 says it added support for BDB 4.7.x and removed pre-BDB 4.4 which is very helpful. Should this be read as >= 4.4 is acceptable? Looking through the docs, changes and FAQomatic, I cannot find a definitive list of acceptable/required levels (which could include, OpenSSL, GnuTLS, SASL, etc). I was wondering if that list is somewhere I simply can't find. :-)
I'm running BDB 4.6.x with 2.4 and it seems fine for the tests I've done.
I'd be happy to contribute to the docs as I am sure the OpenLDAP team is swamped with other work. :-)
Hi Bill,
Did you read the README file shipped with OpenLDAP? I believe it addresses your questions.
REQUIRED SOFTWARE Building OpenLDAP Software requires a number of software packages to be preinstalled. Additional information regarding prerequisite software can be found in the OpenLDAP Administrator's Guide.
Base system (libraries and tools): Standard C compiler (required) Cyrus SASL 2.1.21+ (recommended) OpenSSL 0.9.7+ (recommended) Reentrant POSIX REGEX software (required)
SLAPD: BDB and HDB backends require Oracle Berkeley DB 4.4, 4.5, 4.6, or 4.7. It is highly recommended to apply the patches from Oracle for a given release.
CLIENTS/CONTRIB ware: Depends on package. See per package README.
Alrighty then! I must have skipped right over that file and spent too much time scanning the CHANGES and INSTALL files.
Thank you very much.
Cheers, Bill
--Quanah
--
Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc
Zimbra :: the leader in open source messaging and collaboration
openldap-technical@openldap.org