Hi,
we did some further investigation in to that problem and it is not as simple. When we start the slapd, everythin is o.k. But after some time, the behavior of slapd changes, it seems to tilt. Then searching for attributes without index is about 100 to 1000 times slower then with an new ldap. We have set the loglevel to trace and found some differences, we can not explain:
If we search for attributes without index on a slapd before it tilts it looks like that:
o.k.:
Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56172 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56173 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56174 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56175 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56176 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56177 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56178 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56179 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56180 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56181 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56182 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56183 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56184 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56185 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56186 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56187 does not match filter Feb 4 17:48:40 ldapserver slapd[16810]: bdb_search: 56188 does not match filter
an after it tilts:
very very slow:
Feb 4 17:46:53 ldapserver slapd[20989]: bdb_search: 72869 does not match filter Feb 4 17:46:53 ldapserver slapd[20989]: entry_decode: "uid=example3412,ou=unit1,o=example,c=de" Feb 4 17:46:53 ldapserver slapd[20989]: <= entry_decode(uid=example3412,ou=unit1,o=example,c=de) Feb 4 17:46:53 ldapserver slapd[20989]: bdb_search: 72870 does not match filter Feb 4 17:46:53 ldapserver slapd[20989]: entry_decode: "uid=example3413,ou=unit1,o=example,c=de" Feb 4 17:46:53 ldapserver slapd[20989]: <= entry_decode(uid=example3413,ou=unit1,o=example,c=de) Feb 4 17:46:53 ldapserver slapd[20989]: bdb_search: 72871 does not match filter Feb 4 17:46:53 ldapserver slapd[20989]: entry_decode: "uid=example3414,ou=unit1,o=example,c=de" Feb 4 17:46:53 ldapserver slapd[20989]: <= entry_decode(uid=example3414,ou=unit1,o=example,c=de) Feb 4 17:46:54 ldapserver slapd[20989]: bdb_search: 72872 does not match filter Feb 4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3415,ou=unit1,o=example,c=de" Feb 4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3415,ou=unit1,o=example,c=de) Feb 4 17:46:54 ldapserver slapd[20989]: bdb_search: 72873 does not match filter Feb 4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3416,ou=unit1,o=example,c=de" Feb 4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3416,ou=unit1,o=example,c=de) Feb 4 17:46:54 ldapserver slapd[20989]: bdb_search: 72874 does not match filter Feb 4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3417,ou=unit1,o=example,c=de" Feb 4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3417,ou=unit1,o=example,c=de) Feb 4 17:46:54 ldapserver slapd[20989]: bdb_search: 72875 does not match filter Feb 4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3418,ou=unit1,o=example,c=de" Feb 4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3418,ou=unit1,o=example,c=de) Feb 4 17:46:54 ldapserver slapd[20989]: bdb_search: 72876 does not match filter Feb 4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3419,ou=unit1,o=example,c=de" Feb 4 17:46:54 ldapserver slapd[20989]: <= entry_decode(uid=example3419,ou=unit1,o=example,c=de) Feb 4 17:46:54 ldapserver slapd[20989]: bdb_search: 72877 does not match filter Feb 4 17:46:54 ldapserver slapd[20989]: entry_decode: "uid=example3420,ou=unit1,o=example,c=de" Feb 4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3420,ou=unit1,o=example,c=de) Feb 4 17:46:55 ldapserver slapd[20989]: bdb_search: 72878 does not match filter Feb 4 17:46:55 ldapserver slapd[20989]: entry_decode: "uid=example3421,ou=unit1,o=example,c=de" Feb 4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3421,ou=unit1,o=example,c=de) Feb 4 17:46:55 ldapserver slapd[20989]: bdb_search: 72879 does not match filter Feb 4 17:46:55 ldapserver slapd[20989]: entry_decode: "uid=example3422,ou=unit1,o=example,c=de" Feb 4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3422,ou=unit1,o=example,c=de) Feb 4 17:46:55 ldapserver slapd[20989]: bdb_search: 72880 does not match filter Feb 4 17:46:55 ldapserver slapd[20989]: entry_decode: "uid=example3423,ou=unit1,o=example,c=de" Feb 4 17:46:55 ldapserver slapd[20989]: <= entry_decode(uid=example3423,ou=unit1,o=example,c=de) Feb 4 17:46:55 ldapserver slapd[20989]: bdb_search: 72881 does not match filter
Why the slapd does these entry_decode thing? And why is it so slow with entry_decode? We used the same searchfilter for both searches.
Furthermore we changed the backend database from bdb-4.5 to bdb-4.8.24, but the behavior is still the same.
regards
Christoph &:-)
-----Ursprüngliche Nachricht----- Von: Christoph Herrmann C.Herrmann@science-computing.de Gesendet: Fr 11.12.2009 00:30 An: openldap-software@openldap.org; Betreff: searching for attributes without index in 2.4.19 with bdb 4.5
Hello,
after upgrading from openldap-2.3.39 with bdb-4.2.52 to openldap 2.4.19 with bdb-4.5 searching for attributes without index is about three times slower. (same machine, same data, all data fit in DB cache)
Are there any known problems or magic tuning options we have missed?
regards
Christoph &:-)--