On Sep 11, 2012, at 8:14 PM, hyc@symas.com wrote:
marco@schirrmeister.net wrote:
Full_Name: Marco Schirrmeister Version: 2.4.32 OS: CentOS6 x86_64 URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (84.59.6.160)
I'm testing mdb since the last versions with our dataset. If I use my production config slapd does't start up.
The following is in the log file.
Sep 11 16:48:37 ds71 slapd2.4[8349]: @(#) $OpenLDAP: slapd 2.4.32 (Sep 6 2012 13:50:54) $#012#011mschirrmeister@defrsl6bh2.ogilvy.com:/home/mschirrmeister/rpmbuild/BUILD/openldap-2.4.32/servers/slapd Sep 11 16:48:37 ds71 slapd2.4[8349]: mdb_attr_dbs: database "dc=ogilvy,dc=com": mdb_open(omgPublishDate) failed: Too many open files in system (23). Sep 11 16:48:37 ds71 slapd2.4[8349]: backend_startup_one (type=mdb, suffix="dc=ogilvy,dc=com"): bi_db_open failed! (23) Sep 11 16:48:37 ds71 slapd2.4[8349]: slapd stopped.
My /etc/security/limits.conf file has already the following entries.
- soft nofile 65535
- hard nofile 65535
No matter what I try on the OS side, the error above comes up.
I have about 130 index attributes in my config. Looks to me that this is the problem. If I comment 8 attributes, slapd starts fine.
There is a hardcoded limit of 128. This same limit exists in back-bdb/hdb. You can just edit back-mdb.h (or back-bdb.h) to raise the limit. Change the MDB_INDICES (or BDB_INDICES) definition.
Congratulations, no one else has hit this limit in back-bdb in the past 12 years. Seems likely to me that you're indexing too much, but there's not enough information here to judge.
Ok, thanks for that information. I will try to increase it.
But it's weird that there is no error with bdb on startup. I looked at my back-bdb.h and it has 128. I'm definitely over this number.
You are right, some are too much and I could maybe remove a few indexes. Some defaults. But our own schema extension is quite long and many of those attributes are used in searches from the various apps. Normally I also only added an index where I saw the candidate message in the log.
So this is then also no bug and we can close it. Sorry for being to fast with an ITS.
-- Marco