Hello, Further investigation shows this issue is caused by operator LE search failing with indexed attributes. Also this indexed search issue is NOT limited to DDS.=20 I have reproduced the issue with integerOrderingMatch and generalizedTimeOrderingMatch.=20 The piece of code I find suspicious is in servers/back-bdb/idl.c, somewhere in the middle it reads /* skip presence key on range inequality lookups */ while (rc =3D=3D 0&& kptr->size !=3D len) { rc =3D cursor->c_get( cursor, kptr,&data, flags | DB_NEXT_NODUP ); } If I remove this block then LE search works as expected with indexed attributes. The key here seems to be the DB_NEXT_NODUP flag. This flag causes the iterator block a few lines below to return partial matches.

Thanks, Petteri -----Original Message----- From: openldap-bugs-bounces(a)OpenLDAP.org [mailto:openldap-bugs-bounces@OpenLDAP.org] On Behalf Of petteri.stenius(a)ubisecure.com Sent: Monday, October 25, 2010 1:35 PM To: openldap-its(a)openldap.org Subject: (ITS#6683) DDS fails with expired branches Full_Name:=20 Version: 2.4.23 OS: Linux URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (195.197.205.34) Hello, I have a directory with branches of dynamicObject entries. It looks like if the entryExpireTimestamp value is the same on objects within a branch then DDS search for expired objects will only find the top-most object. This results in remove failing with message DDS dn=3D"cn=3Dtop,cn=3Droot,dc=3Dtest" is non-leaf; deferring. To reproduce OpenLDAP 2.4.23, Berkeley DB 4.6.21 Use slapadd to prepare directory with following dn: cn=3DRoot,dc=3Dtest objectClass: top objectClass: applicationProcess cn: Root dn: cn=3Dtop,cn=3DRoot,dc=3Dtest objectClass: top objectClass: device objectClass: dynamicObject entryTTL: 60 entryExpireTimestamp: 20101024113626Z cn: top dn: cn=3Dleaf1,cn=3Dtop,cn=3DRoot,dc=3Dtest objectClass: top objectClass: device objectClass: dynamicObject entryTTL: 60 entryExpireTimestamp: 20101024113626Z cn: leaf1 dn: cn=3Dleaf2,cn=3Dtop,cn=3DRoot,dc=3Dtest objectClass: top objectClass: device objectClass: dynamicObject entryTTL: 60 entryExpireTimestamp: 20101024113626Z cn: leaf2 dn: cn=3Dleaf3,cn=3Dtop,cn=3DRoot,dc=3Dtest objectClass: top objectClass: device objectClass: dynamicObject entryTTL: 60 entryExpireTimestamp: 20101024113626Z cn: leaf3 Relevant slapd.conf entries database bdb suffix "cn=3DRoot,dc=3Dtest" rootdn "cn=3DRoot,dc=3Dtest" rootpw "password" overlay dds dds-default-ttl 3600 dds-min-ttl 60 dds-interval 60 dds-state true index entryExpireTimestamp eq,pres access to dn.subtree=3D"cn=3DRoot,dc=3Dtest" by users write by * read Running "slapd -d 1 -d 256" produces following put_filter: "(&(objectClass=3DdynamicObject)(entryExpireTimestamp<=3D20101025082446Z)= )" put_filter: AND put_filter_list "(objectClass=3DdynamicObject)(entryExpireTimestamp<=3D20101025082446Z)" put_filter: "(objectClass=3DdynamicObject)" put_filter: simple put_simple_filter: "objectClass=3DdynamicObject" put_filter: "(entryExpireTimestamp<=3D20101025082446Z)" put_filter: simple put_simple_filter: "entryExpireTimestamp<=3D20101025082446Z" ber_scanf fmt ({mm}) ber: ber_scanf fmt ({mm}) ber: =3D> bdb_search bdb_dn2entry("cn=3Droot,dc=3Dtest") =3D> bdb_dn2id("cn=3Droot,dc=3Dtest") <=3D bdb_dn2id: got id=3D0x1 entry_decode: "cn=3DRoot,dc=3Dtest" <=3D entry_decode(cn=3DRoot,dc=3Dtest) search_candidates: base=3D"cn=3Droot,dc=3Dtest" (0x00000001) scope=3D2 =3D> bdb_dn2idl("cn=3Droot,dc=3Dtest") =3D> bdb_equality_candidates (objectClass) =3D> key_read <=3D bdb_index_read: failed (-30989) <=3D bdb_equality_candidates: id=3D0, first=3D0, last=3D0 =3D> bdb_equality_candidates (objectClass) =3D> key_read <=3D bdb_index_read 4 candidates <=3D bdb_equality_candidates: id=3D4, first=3D2, last=3D5 =3D> bdb_inequality_candidates (entryExpireTimestamp) =3D> key_read <=3D bdb_index_read 1 candidates =3D> key_read <=3D bdb_index_read: failed (-30989) <=3D bdb_inequality_candidates: id=3D1, first=3D2, last=3D2 bdb_search_candidates: id=3D1 first=3D2 last=3D2 entry_decode: "cn=3Dtop,cn=3DRoot,dc=3Dtest" <=3D entry_decode(cn=3Dtop,cn=3DRoot,dc=3Dtest) =3D> bdb_dn2id("cn=3Dtop,cn=3Droot,dc=3Dtest") <=3D bdb_dn2id: got id=3D0x2 send_ldap_result: conn=3D-1 op=3D0 p=3D0 bdb_dn2entry("cn=3Dtop,cn=3Droot,dc=3Dtest") =3D> bdb_dn2id_children("cn=3Dtop,cn=3Droot,dc=3Dtest") <=3D bdb_dn2id_children("cn=3Dtop,cn=3Droot,dc=3Dtest"): (0) send_ldap_result: conn=3D-1 op=3D0 p=3D0 DDS dn=3D"cn=3Dtop,cn=3Droot,dc=3Dtest" is non-leaf; deferring. DDS expired=3D0 ldapsearch "(entryExpireTimestamp=3D*)" produces dn: cn=3Dtop,cn=3DRoot,dc=3Dtest entryExpireTimestamp: 20101024113626Z dn: cn=3Dleaf1,cn=3Dtop,cn=3DRoot,dc=3Dtest entryExpireTimestamp: 20101024113626Z dn: cn=3Dleaf2,cn=3Dtop,cn=3DRoot,dc=3Dtest entryExpireTimestamp: 20101024113626Z dn: cn=3Dleaf3,cn=3Dtop,cn=3DRoot,dc=3Dtest entryExpireTimestamp: 20101024113626Z where ldapsearch "(entryExpireTimestamp<=3D20101024113626Z)" only finds dn: cn=3Dtop,cn=3DRoot,dc=3Dtest entryExpireTimestamp: 20101024113626Z If I change all timestamps to distinct values then expiration of complete branches works as expected. Thanks, Petteri