From hyc@symas.com Thu May 1 00:11:50 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5492) Ignore password longer than pwdMinLength specified in PPOLICY Date: Thu, 01 May 2008 00:11:50 +0000 Message-ID: <200805010011.m410BoeW030378@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1617736505242815943==" --===============1617736505242815943== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable huynh.tuan(a)comcast.net wrote: > Full_Name: Tuan Huynh > Version: 2.3.39 > OS: Solaris > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (216.39.129.66) > > > My password is 10 characters long, however system allowed me to login as lo= ng as > I enter first 8 characters and it ignored the rest even if I enter garbage.= For > example: > > my password is !thisIsATest! > when I login it'll accept password such as !thisIsA or !thisIsAdkdkdkdkdkdk= dkdk > > I used ppolicy and pwdMinLength is set at 8 Sounds like a configuration error in your Solaris system, or possibly a poor = choice of password hash mechanism. I don't see any evidence of an OpenLDAP bu= g=20 here. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============1617736505242815943==-- From huynh.tuan@comcast.net Thu May 1 00:52:10 2008 From: huynh.tuan@comcast.net To: openldap-bugs@openldap.org Subject: (ITS#5492) Date: Thu, 01 May 2008 00:52:09 +0000 Message-ID: <200805010052.m410q9pF032438@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4207636168414795872==" --===============4207636168414795872== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable --NextPart_Webmail_9m3u9jl4l_14399_1209603117_0 Content-Type: text/plain Content-Transfer-Encoding: 8bit I by pass the OS by using JAVA frontend LDAPBrowser v2.8.1, and the symtom ap= peared to be the same. =20 Used crypt to hash password. --NextPart_Webmail_9m3u9jl4l_14399_1209603117_0 Content-Type: text/html Content-Transfer-Encoding: 8bit
> On Mon, May 26, 2008 at 01:07:22PM +0100, Gavin Henry wrote: > >> I've patched security.sdf and I'm abotu to clean up some typos and >> formating. > > Thanks. > >> Should we also mention that CRYPT is platform specific? > > I put in a note about the glibc2 version, but I was not aware of any > platform oddities on the traditional 13-character version. Are there > other MD5 variants? See http://www.openldap.org/faq/index.cgi?_highlightWords=crypt&file=344 > > We could also mention the LANMAN scheme which I forgot to include as > it is a compile-time option. Sure, could do. > >> Lastly, should I also put: >> >> Portions Copyright 2008 Andrew Findlay>> >> into doc/guide/COPYRIGHT ? > > Yes please. Done. Check in HEAD -- Kind Regards, Gavin Henry. OpenLDAP Engineering Team. E ghenry(a)OpenLDAP.org Community developed LDAP software. http://www.openldap.org/project/ --===============5991895188521238080==-- From hyc@symas.com Tue May 27 05:10:27 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5530) OpenLDAP fails to compile Date: Tue, 27 May 2008 05:10:27 +0000 Message-ID: <200805270510.m4R5ARKq042581@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5451837353934108950==" --===============5451837353934108950== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable mike(a)tedder.cc wrote: > Full_Name: Mike Tedder > Version: 2.4.9 > OS: powerpc-linux > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (210.170.158.22) > > > The back-bdb backend for the OpenLDAP slapd server fails to compile when be= ing > built using Berkeley DB 4.7: This was already reported in ITS#5523. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============5451837353934108950==-- From hai.zhao@gmail.com Tue May 27 10:10:13 2008 From: hai.zhao@gmail.com To: openldap-bugs@openldap.org Subject: (ITS#5532) incorrect timestamp of slapd replica log Date: Tue, 27 May 2008 10:10:13 +0000 Message-ID: <200805271010.m4RAADtR079025@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1719907435595076995==" --===============1719907435595076995== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Full_Name: Zhao Hai Version: 2.3.41 OS: Linux 2.4.21 arm URL: ftp://ftp.openldap.org/incoming/zhaohai-080527.patch Submission from: (NULL) (205.209.140.4) Problem: race condition makes incorrect timestamp in replogfile, cause certain modification of entries not replicate to slurp slaves. replica: 180.0.10.2:1234 replica: 180.0.10.3:1234 time: 1211855467 ^^^^^^^^^^ this timestamp How to reproduce the problem: 1) run under very slow machines (my environ: arm 266MHz) 2) slapd is configed to generate replogfile 3) ldapadd about 5 entries, then ldapmodify 2 entries without delay. Patch: Please look the attached patch. It works for me. --===============1719907435595076995==-- From Kurt@OpenLDAP.org Tue May 27 17:04:19 2008 From: Kurt@OpenLDAP.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5524) Additions to the Security section of the Admin Guide Date: Tue, 27 May 2008 17:04:19 +0000 Message-ID: <200805271704.m4RH4JqS030111@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2708604382965963392==" --===============2708604382965963392== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On May 26, 2008, at 12:48 PM, andrew.findlay(a)skills-1st.co.uk wrote: > On Mon, May 26, 2008 at 01:07:22PM +0100, Gavin Henry wrote: > >> I've patched security.sdf and I'm abotu to clean up some typos and >> formating. > > Thanks. > >> Should we also mention that CRYPT is platform specific? > > I put in a note about the glibc2 version, but I was not aware of any > platform oddities on the traditional 13-character version. Are there > other MD5 variants? > > We could also mention the LANMAN scheme which I forgot to include as > it is a compile-time option. > >> Lastly, should I also put: >> >> Portions Copyright 2008 Andrew Findlay > > >> >> into doc/guide/COPYRIGHT ? No. This file is a copy of the main OpenLDAP Software COPYRIGHT file. That file is intended to contain notices of copyright holders which hold signfiicant rights in OpenLDAP Software. Notices for copyright holders, as noted in the COPYRIGHT file, are generally to be placed in the individual source files which the holder holds significant rights in. That is, this notice belongs in security.sdf itself. I have so updated the source documents. Though the preface does clearly say that admin guide is part of OpenLDAP Software, I've also updated the preface to note that portions of the document may be copyright by others as indicated in source files. -- Kurt --===============2708604382965963392==-- From h.b.furuseth@usit.uio.no Tue May 27 18:27:22 2008 From: h.b.furuseth@usit.uio.no To: openldap-bugs@openldap.org Subject: Re: (ITS#5529) test048-syncrepl-multiproxy --without-threads hangs Date: Tue, 27 May 2008 18:27:21 +0000 Message-ID: <200805271827.m4RIRLDb034710@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7682573379864613226==" --===============7682573379864613226== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable ando(a)sys-net.it writes: >h.b.furuseth(a)usit.uio.no wrote: >> RE24 configured with --quiet --without-threads --enable-ldap 'CFLAGS=3D-O0= -g' Sorry, that's RE24 + the ITS#5519 (--without-thread miscompiles) patch: cvs diff -r1.34 -r1.35 -I'[$]OpenLDAP[$:]' libraries/libldap_r/thr_stub.c > Probably, sync replication should not be allowed when building > --without-threads. Or there could be a warning that --without-threads breaks some features. Looking closer I see the server replicates from itself in this test. I can see how that'd be a problem in single-threaded mode... Most other syncrepl tests succeed. Though test050 crashes: daemon.c:979: slapd_set_read: Assertion `((slap_daemon.sd_index[(s)]) !=3D = -1)' failed. (Argh, it refuses to dump core for some reason. I've done ulimit -c unlimited and put it in defines.sh too.) --=20 Hallvard --===============7682573379864613226==-- From ghenry@OpenLDAP.org Tue May 27 18:52:40 2008 From: ghenry@OpenLDAP.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5524) Additions to the Security section of the Admin Guide Date: Tue, 27 May 2008 18:52:40 +0000 Message-ID: <200805271852.m4RIqelJ036584@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4467345022653049751==" --===============4467345022653049751== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit > > On May 26, 2008, at 12:48 PM, andrew.findlay(a)skills-1st.co.uk wrote: > >> On Mon, May 26, 2008 at 01:07:22PM +0100, Gavin Henry wrote: >> >>> I've patched security.sdf and I'm abotu to clean up some typos and >>> formating. >> >> Thanks. >> >>> Should we also mention that CRYPT is platform specific? >> >> I put in a note about the glibc2 version, but I was not aware of any >> platform oddities on the traditional 13-character version. Are there >> other MD5 variants? >> >> We could also mention the LANMAN scheme which I forgot to include as >> it is a compile-time option. >> >>> Lastly, should I also put: >>> >>> Portions Copyright 2008 Andrew Findlay>> > >>> >>> into doc/guide/COPYRIGHT ? > > No. > > This file is a copy of the main OpenLDAP Software COPYRIGHT file. > That file is intended to contain notices of copyright holders which > hold signfiicant rights in OpenLDAP Software. Notices for copyright > holders, as noted in the COPYRIGHT file, are generally to be placed in > the individual source files which the holder holds significant rights > in. That is, this notice belongs in security.sdf itself. I have so > updated the source documents. Good, this clears things up and make it clear going forward. Thanks. > Though the preface does clearly say that admin guide is part of > OpenLDAP Software, I've also updated the preface to note that portions > of the document may be copyright by others as indicated in source files. Thanks again. --===============4467345022653049751==-- From h.b.furuseth@usit.uio.no Tue May 27 20:05:47 2008 From: h.b.furuseth@usit.uio.no To: openldap-bugs@openldap.org Subject: (ITS#5533) test035-meta crashes --without-threads Date: Tue, 27 May 2008 20:05:46 +0000 Message-ID: <200805272005.m4RK5kGO041268@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5625494331920549231==" --===============5625494331920549231== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Full_Name: Hallvard B Furuseth Version: RE24 OS: URL: ftp://ftp.openldap.org/incoming/Hallvard-Furuseth-080527.tgz.1 Submission from: (NULL) (129.240.6.233) Submitted by: hallvard slapd crashes in test035 after 10 runs: daemon.c:979: assert( SLAP_SOCK_IS_ACTIVE( s )); RE24 + libraries/libldap_r/thr_stub.c rev 1.35 ./configure --quiet --without-threads --enable-meta --enable-ldap 'CFLAGS=-O0 -g' (declare -i n=0; while n=n+1 && echo "run #$n" && ./run test035; do sleep 5; done) Testrun directory enclosed, with files OUTPUT (from tty) and slapd.*.GDB. Removed database directories though. (Argh, I messed up with passive mode again. Oh well.) --===============5625494331920549231==-- From quanah@zimbra.com Tue May 27 20:11:08 2008 From: quanah@zimbra.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5533) test035-meta crashes --without-threads Date: Tue, 27 May 2008 20:11:07 +0000 Message-ID: <200805272011.m4RKB7L2043142@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2542100165866817959==" --===============2542100165866817959== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --On Tuesday, May 27, 2008 8:05 PM +0000 h.b.furuseth(a)usit.uio.no wrote: > Full_Name: Hallvard B Furuseth > Version: RE24 > OS: > URL: ftp://ftp.openldap.org/incoming/Hallvard-Furuseth-080527.tgz.1 > Submission from: (NULL) (129.240.6.233) > Submitted by: hallvard > Isn't this just a duplicate of ITS#5489? --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration --===============2542100165866817959==-- From h.b.furuseth@usit.uio.no Tue May 27 21:03:05 2008 From: h.b.furuseth@usit.uio.no To: openldap-bugs@openldap.org Subject: Re: (ITS#5533) test035-meta crashes --without-threads Date: Tue, 27 May 2008 21:03:05 +0000 Message-ID: <200805272103.m4RL35XV049549@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1235194639183933375==" --===============1235194639183933375== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit quanah(a)zimbra.com writes: > Isn't this just a duplicate of ITS#5489? Apparently not. Got it again at 4th run with daemon.c 1.380.2.12. Also in a somewhat patched HEAD with the same configuration. Hm, the crashes happen for extended operations. So far 6 times "Passwd ExOp failed (1)!", once "WhoAmI failed (49)!". -- Hallvard --===============1235194639183933375==-- From hyc@symas.com Tue May 27 23:25:12 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5318) response msgid <= 0 mishandled in libldap Date: Tue, 27 May 2008 23:25:11 +0000 Message-ID: <200805272325.m4RNPBow064819@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8320452758475475600==" --===============8320452758475475600== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit h.b.furuseth(a)usit.uio.no wrote: > Full_Name: Hallvard B Furuseth > Version: HEAD > OS: > URL: > Submission from: (NULL) (129.240.6.233) > Submitted by: hallvard > > > libraries/libldap/result.c:try_read1msg() accesses 'lr' uninitialized > if 'id' (message ID) from line 577's 'ber_get_int( ber,&id )' is<= 0. > > I'm not sure if the client should terminate the connection when it > receives message id< 0, or if it should just toss the response like > it does with unknown message IDs. RFC4511 isn't really explicit here, although it does say that the connection should be dropped for unparsable messages. Anyway, I've patched HEAD to toss the messages for now. > With message ID 0, the code reaches this statement with 'lr' uninitialized: > Debug( LDAP_DEBUG_TRACE, > "read1msg: ld %p msgid %ld message type %s\n", > (void *)ld, (long)lr->lr_msgid, ldap_int_msgtype2str( tag ) ); > As far as I can tell, normally lr->lr_msgid == id. I haven't tracked what > those values are with LDAP_CONNECTIONLESS at the 'nextresp2:' label. For CONNECTIONLESS, it can only jump back there because there were multiple responses to the current request. So the lr is the same as for the first response. No problem there. (Remember this is all within a single datagram. Responses to multiple different requests cannot be interleaved at this point.) > A 700-line function with 5 labels, yuck. > Anyway, I wonder why taht statement and the statement below: > if ( id == 0 ) { > doesn't use the same value, either id or lr->lr_msgid for both. -- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============8320452758475475600==-- From abartlet@samba.org Wed May 28 00:39:11 2008 From: abartlet@samba.org To: openldap-bugs@openldap.org Subject: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Wed, 28 May 2008 00:39:10 +0000 Message-ID: <200805280039.m4S0dABl088350@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5199947554557478680==" --===============5199947554557478680== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Andrew Bartlett Version: CVS HEAD OS: Fedora 9 URL: http://www.openldap.org/lists/openldap-technical/200803/msg00101.html Submission from: (NULL) (59.167.251.137) For Samba4, I need a few things, detailed in the attached URL. This ITS is for internal transactions and validation - the ability to have a openldap overlay roll back all the changes so far, because a precondition is = not met. I need the memberOf and refint modules to ensure that no dangling links ever exist, even over subtree renames and invalid modifies, and that a transaction ensures this is always the case.=20 This needs to occur even between databases on the server, but I won't ask that it occur outside the known trees.=20 --===============5199947554557478680==-- From hyc@symas.com Wed May 28 01:22:30 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Wed, 28 May 2008 01:22:29 +0000 Message-ID: <200805280122.m4S1MTLW002156@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7755595244401000473==" --===============7755595244401000473== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable abartlet(a)samba.org wrote: > Full_Name: Andrew Bartlett > Version: CVS HEAD > OS: Fedora 9 > URL: http://www.openldap.org/lists/openldap-technical/200803/msg00101.html > Submission from: (NULL) (59.167.251.137) > > > For Samba4, I need a few things, detailed in the attached URL. The above message thread had some unanswered questions. We may need to have=20 each point listed out again. > This ITS is for internal transactions and validation - the ability to have a > openldap overlay roll back all the changes so far, because a precondition i= s not > met. I think this one is understood, OK. Just a matter of getting the time to do i= t. > I need the memberOf and refint modules to ensure that no dangling links ever > exist, even over subtree renames and invalid modifies, and that a transacti= on > ensures this is always the case. I think the proper use of memberOf still needs to be addressed. E.g., it's=20 generally a bad idea to search for (memberOf=3Dfoo) when you can simply=20 enumerate the members inside the "foo" entry. If you give us precise examples= =20 of the searches and modifications that you'll be using, we may be able to=20 narrow the scope of this work. > This needs to occur even between databases on the server, but I won't ask t= hat > it occur outside the known trees. It's already possible for operations in one database to reference entries in = a=20 different database, so that aspect of validation should be fine. However, as = noted before, "validation" is generally bogus to begin with. In particular,=20 how do you create entries with circular references? If you disallow reference= s=20 to nonexistent entries, you can't set the references until after all of the=20 entries have been created. This means that you cannot backup a database that = has these references and then later reload it in a single pass. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============7755595244401000473==-- From abartlet@samba.org Wed May 28 01:31:33 2008 From: abartlet@samba.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Wed, 28 May 2008 01:31:32 +0000 Message-ID: <200805280131.m4S1VWMe005464@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7256598207125039053==" --===============7256598207125039053== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --=-I6d9E5fOqbwKcJhhvz+z Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On Tue, 2008-05-27 at 18:22 -0700, Howard Chu wrote: > abartlet(a)samba.org wrote: > > Full_Name: Andrew Bartlett > > Version: CVS HEAD > > OS: Fedora 9 > > URL: http://www.openldap.org/lists/openldap-technical/200803/msg00101.h= tml > > Submission from: (NULL) (59.167.251.137) > > > > > > For Samba4, I need a few things, detailed in the attached URL. >=20 > The above message thread had some unanswered questions. We may need to ha= ve=20 > each point listed out again. >=20 > > This ITS is for internal transactions and validation - the ability to h= ave a > > openldap overlay roll back all the changes so far, because a preconditi= on is not > > met. >=20 > I think this one is understood, OK. Just a matter of getting the time to = do it. >=20 > > I need the memberOf and refint modules to ensure that no dangling links= ever > > exist, even over subtree renames and invalid modifies, and that a trans= action > > ensures this is always the case. >=20 > I think the proper use of memberOf still needs to be addressed. E.g., it'= s=20 > generally a bad idea to search for (memberOf=3Dfoo) when you can simply=20 > enumerate the members inside the "foo" entry. If you give us precise exam= ples=20 > of the searches and modifications that you'll be using, we may be able to= =20 > narrow the scope of this work. I'll be passing on any search that a windows client makes, and trying to return the same result a windows server would return. Bad ideas still have to be implemented in my world :-( > > This needs to occur even between databases on the server, but I won't a= sk that > > it occur outside the known trees. >=20 > It's already possible for operations in one database to reference entries= in a=20 > different database, so that aspect of validation should be fine. However,= as=20 > noted before, "validation" is generally bogus to begin with. In particula= r,=20 > how do you create entries with circular references? If you disallow refer= ences=20 > to nonexistent entries, you can't set the references until after all of t= he=20 > entries have been created. This means that you cannot backup a database t= hat=20 > has these references and then later reload it in a single pass. An interesting point, but I need to match the windows runtime behaviour.=20 Andrew Bartlett --=20 Andrew Bartlett http://samba.org/~abartlet/ Authentication Developer, Samba Team http://samba.org Samba Developer, Red Hat Inc. --=-I6d9E5fOqbwKcJhhvz+z Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) iD8DBQBIPLXqz4A8Wyi0NrsRArp6AJ9OaJP8Cu4MdO69n1k1S8vlBjtPOACdHvDh t0XbDQzXaJya2LR/bhl1RlQ= =/FnH -----END PGP SIGNATURE----- --=-I6d9E5fOqbwKcJhhvz+z-- --===============7256598207125039053==-- From hyc@symas.com Wed May 28 01:43:23 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Wed, 28 May 2008 01:43:22 +0000 Message-ID: <200805280143.m4S1hME0009350@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6226016004471658449==" --===============6226016004471658449== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Andrew Bartlett wrote: > On Tue, 2008-05-27 at 18:22 -0700, Howard Chu wrote: >>> This needs to occur even between databases on the server, but I won't ask= that >>> it occur outside the known trees. >> It's already possible for operations in one database to reference entries = in a >> different database, so that aspect of validation should be fine. However, = as >> noted before, "validation" is generally bogus to begin with. In particular, >> how do you create entries with circular references? If you disallow refere= nces >> to nonexistent entries, you can't set the references until after all of the >> entries have been created. This means that you cannot backup a database th= at >> has these references and then later reload it in a single pass. > > An interesting point, but I need to match the windows runtime > behaviour. Only when it has a visible impact on other clients. What software will break = if the directory allows you to add new entries that contain dangling=20 references? What will break if the directory allows you to modify a reference= =20 attribute to point to a nonexistent entry? There's a lot of Windows behavior that is clearly wrong, by any number of=20 metrics. You need to be a bit more selective in prioritizing the list of=20 things to chase down. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============6226016004471658449==-- From abartlet@samba.org Wed May 28 02:28:09 2008 From: abartlet@samba.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Wed, 28 May 2008 02:28:09 +0000 Message-ID: <200805280228.m4S2S9nN018281@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5745321044289298171==" --===============5745321044289298171== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --=-s2sha8beM9nUssvA07HS Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On Tue, 2008-05-27 at 18:43 -0700, Howard Chu wrote: > Andrew Bartlett wrote: > > On Tue, 2008-05-27 at 18:22 -0700, Howard Chu wrote: >=20 > >>> This needs to occur even between databases on the server, but I won't= ask that > >>> it occur outside the known trees. > >> It's already possible for operations in one database to reference entr= ies in a > >> different database, so that aspect of validation should be fine. Howev= er, as > >> noted before, "validation" is generally bogus to begin with. In partic= ular, > >> how do you create entries with circular references? If you disallow re= ferences > >> to nonexistent entries, you can't set the references until after all o= f the > >> entries have been created. This means that you cannot backup a databas= e that > >> has these references and then later reload it in a single pass. > > > > An interesting point, but I need to match the windows runtime > > behaviour. >=20 > Only when it has a visible impact on other clients. What software will br= eak=20 > if the directory allows you to add new entries that contain dangling=20 > references? What will break if the directory allows you to modify a refer= ence=20 > attribute to point to a nonexistent entry? Sure, I'm not asking for a change to default behaviours. I'm listing the things that our testsuite finds are differences, and looking for solutions.=20 > There's a lot of Windows behavior that is clearly wrong, by any number of= =20 > metrics. You need to be a bit more selective in prioritizing the list of=20 > things to chase down. This is the currently the top priority for an LDAP Backend for Samba4. =20 Andrew Bartlett --=20 Andrew Bartlett http://samba.org/~abartlet/ Authentication Developer, Samba Team http://samba.org Samba Developer, Red Hat Inc. --=-s2sha8beM9nUssvA07HS Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) iD8DBQBIPMMwz4A8Wyi0NrsRAljCAJsEsn1tsq4BdkdenNOEOF3PIGcDDACfVoUR APoU1kbv2ljwVBgjyhPbyGQ= =mXBr -----END PGP SIGNATURE----- --=-s2sha8beM9nUssvA07HS-- --===============5745321044289298171==-- From Guillaume.Rousse@inria.fr Wed May 28 14:07:39 2008 From: Guillaume.Rousse@inria.fr To: openldap-bugs@openldap.org Subject: (ITS#5535) smbk5pwd uses private heimdal functions Date: Wed, 28 May 2008 14:07:38 +0000 Message-ID: <200805281407.m4SE7cZC050548@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5547214827076633565==" --===============5547214827076633565== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Guillaume Rousse Version: 2.4.8 OS: linux URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (193.55.250.67) smbk5pwd uses two private heimdal functions: _kadm5_set_keys _kadm5_free_keys As of heimdal 1.1, those functions are not exported anymore. As a consequence, opendalp crashes as soon as I try to change password when the overlay is activated. According to heimdal maintainers, smb5pwd should rather use hdb_generate_key_set_password and hdb_free_keys to generate the key data. I tried to produce a patch myself (available at http://www.zarb.org/~guillomovitch/openldap-smbk5pwd-2.4.8-dont-use-internal-= functions.patch) by inlining _kadm5_set_keys function directly in smbk5pwd, but I don't know h= ow to deal with members of private kadm_context structure. --===============5547214827076633565==-- From hyc@symas.com Wed May 28 15:14:27 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Wed, 28 May 2008 15:14:27 +0000 Message-ID: <200805281514.m4SFERIk069175@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8266017340636638432==" --===============8266017340636638432== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Andrew Bartlett wrote: > On Tue, 2008-05-27 at 18:43 -0700, Howard Chu wrote: >> Andrew Bartlett wrote: >>> On Tue, 2008-05-27 at 18:22 -0700, Howard Chu wrote: >>>>> This needs to occur even between databases on the server, but I won't a= sk that >>>>> it occur outside the known trees. >>>> It's already possible for operations in one database to reference entrie= s in a >>>> different database, so that aspect of validation should be fine. However= , as >>>> noted before, "validation" is generally bogus to begin with. In particul= ar, >>>> how do you create entries with circular references? If you disallow refe= rences >>>> to nonexistent entries, you can't set the references until after all of = the >>>> entries have been created. This means that you cannot backup a database = that >>>> has these references and then later reload it in a single pass. >>> An interesting point, but I need to match the windows runtime >>> behaviour. >> Only when it has a visible impact on other clients. What software will bre= ak >> if the directory allows you to add new entries that contain dangling >> references? What will break if the directory allows you to modify a refere= nce >> attribute to point to a nonexistent entry? > > Sure, I'm not asking for a change to default behaviours. I'm listing > the things that our testsuite finds are differences, and looking for > solutions. I don't believe your proposed solution will ever be satisfactory. Entries wit= h=20 circular references will also break syncrepl Refresh if the constraint you're= =20 asking for is enforced. That will clearly have visible impact in many=20 deployments. If the only thing that complains with the current behavior is=20 your testsuite and not any real world clients, I suggest you just note the=20 difference and move on. >> There's a lot of Windows behavior that is clearly wrong, by any number of >> metrics. You need to be a bit more selective in prioritizing the list of >> things to chase down. > > This is the currently the top priority for an LDAP Backend for Samba4. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============8266017340636638432==-- From quanah@zimbra.com Wed May 28 17:31:56 2008 From: quanah@zimbra.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5532) incorrect timestamp of slapd replica log Date: Wed, 28 May 2008 17:31:55 +0000 Message-ID: <200805281731.m4SHVtnc087855@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2137601645221394675==" --===============2137601645221394675== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --On Tuesday, May 27, 2008 10:10 AM +0000 hai.zhao(a)gmail.com wrote: > Full_Name: Zhao Hai > Version: 2.3.41 > OS: Linux 2.4.21 arm > URL: ftp://ftp.openldap.org/incoming/zhaohai-080527.patch > Submission from: (NULL) (205.209.140.4) > > > Problem: > race condition makes incorrect timestamp in replogfile, cause certain > modification of entries not replicate to slurp slaves. > > replica: 180.0.10.2:1234 > replica: 180.0.10.3:1234 > time: 1211855467 > ^^^^^^^^^^ this timestamp > > How to reproduce the problem: > 1) run under very slow machines (my environ: arm 266MHz) > 2) slapd is configed to generate replogfile > 3) ldapadd about 5 entries, then ldapmodify 2 entries without delay. This is fixed in RE23. If there is ever a 2.3.43 release, it will be in that. In the meantime, I'd advise using 2.3.42 + your patch. Regards, Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration --===============2137601645221394675==-- From rein@OpenLDAP.org Wed May 28 18:51:28 2008 From: rein@OpenLDAP.org To: openldap-bugs@openldap.org Subject: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Wed, 28 May 2008 18:51:28 +0000 Message-ID: <200805281851.m4SIpST2097609@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1555198727875880247==" --===============1555198727875880247== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Rein Tollevik Version: CVS head OS: linux and solaris URL: ftp://ftp.openldap.org/incoming/rein-serverID.patch Submission from: (NULL) (81.93.160.250) Submitted by: rein Syncrepl includes the serverID in the syncCookie in multi-master mode only, b= ut there are other configuration that would benefit from it as well. A case I have is where a consumer replicates a glue'ed database, with the exception of one subordinate backend where the consumer is the master. The subordinate backend is replicated back to the master of the glue'ed database.= =20 With the current code the master would send the content of the subordinate db back to its master. I currently solve this problem with acl rules on the glue'ed master that prevents the slave from reading the subordinate db it is master for. Differe= nt rootdn's on the glue and subordinate db on the slave prevents syncrepl from succeeding in its attempts to remove the content of the subordinate db during the present phase. But it felt like I got a minor heartache the first time a saw the log of delete messages scroll by before I realized they were all error messages... A patch that fixes this is at the referenced URL. As I am not sure of the consequences if a defaulted serverID=3D0 value was included in the syncCookie= the patch changes the internal default slap_serverID value to -1 to make it possi= ble to differentiate between a configured and defaulted serverID=3D0. Btw, there are potential problems with using serverID=3D0, so it would be bes= t if that value was reserved for the default unconfigured case. I.e, a default serverID=3D0 value could be chosen be slapadd when the two-argument form of serverID is used in the config, as resolving the URL needs the listener argum= ent to slapd to succeed. Enforcing serverID>0 could require changes in existing configurations, but indicating it in the doc. could be a first step? Rein Tollevik Basefarm AS --===============1555198727875880247==-- From hyc@symas.com Wed May 28 19:12:19 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Wed, 28 May 2008 19:12:19 +0000 Message-ID: <200805281912.m4SJCJ7F002455@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6895075019821714960==" --===============6895075019821714960== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable rein(a)OpenLDAP.org wrote: > Full_Name: Rein Tollevik > Version: CVS head > OS: linux and solaris > URL: ftp://ftp.openldap.org/incoming/rein-serverID.patch > Submission from: (NULL) (81.93.160.250) > Submitted by: rein > > > Syncrepl includes the serverID in the syncCookie in multi-master mode only,= but > there are other configuration that would benefit from it as well. > > A case I have is where a consumer replicates a glue'ed database, with the > exception of one subordinate backend where the consumer is the master. The > subordinate backend is replicated back to the master of the glue'ed databas= e. > With the current code the master would send the content of the subordinate = db > back to its master. Understood. In fact, having multiple sources of data in a glued tree is reall= y=20 a form of multi-master. (The separate glued branches cannot cause=20 inconsistencies with each other, but still their contextCSNs must be managed = individually.) > A patch that fixes this is at the referenced URL. As I am not sure of the > consequences if a defaulted serverID=3D0 value was included in the syncCook= ie the > patch changes the internal default slap_serverID value to -1 to make it pos= sible > to differentiate between a configured and defaulted serverID=3D0. > Btw, there are potential problems with using serverID=3D0, so it would be b= est if > that value was reserved for the default unconfigured case. I.e, a default > serverID=3D0 value could be chosen be slapadd when the two-argument form of > serverID is used in the config, as resolving the URL needs the listener arg= ument > to slapd to succeed. You mean the three-argument form? The two-argument form only allows a single = serverID to be configured anyway, so there is no ambiguity there. But you're = right, in tool mode when multiple serverIDs are configured, there's no way fo= r=20 it to choose the right serverID. That's a problem regardless of whether the=20 default is 0 or -1 though. For now I think this is a doc issue; we could simply recommend that slapadd=20 always be performed on the node with ID 0, and you manually change the=20 serverID config if you need to slapadd on some other node. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============6895075019821714960==-- From rein@OpenLDAP.org Wed May 28 19:28:21 2008 From: rein@OpenLDAP.org To: openldap-bugs@openldap.org Subject: (ITS#5537) syncprov updates incorrect contextCSN at startup Date: Wed, 28 May 2008 19:28:20 +0000 Message-ID: <200805281928.m4SJSKA1004007@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0390610662007787669==" --===============0390610662007787669== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Rein Tollevik Version: CVS head + rein-serverID.patch OS: linux and solaris URL: ftp://ftp.openldap.org/incoming/rein-syncprov.patch Submission from: (NULL) (81.93.160.250) Submitted by: rein At startup syncprov searches for any entries with an entryCSN value newer than the newest contextCSN it read from the db and replaces the newest contextCSN value with the newest it finds. But the newest entryCSN could have a differe= nt sid field, which would result in the server loosing one valid contextCSN and instead introduce two contexCSNs with the same sid field. It could also introduce a defaulted contextCSN with sid=3D0, which would never be updated u= nless there exist a server with that sid, ref my previous ITS. A patch that fixes this is at the referenced URL. It only updates the contextCSN from entryCSN values matching the serverID of this server. My initial thought was that all the contextCSNs that has newer entryCSN values with the same sid field should be updated. But I'm afraid that could cause syncrepl to miss some entries if it picks up the updated contextCSN values, as there may be entries from remote servers with entryCSN values newer than the contextCSN received from that server. The exception is delta-syncrepl where a similar update of all the contextCSN values should probably be done at startu= p.=20 But that belongs in syncrepl.c if needed, as it is requiered whether syncprov= is used or not. Rein Tollevik Basefarm AS --===============0390610662007787669==-- From rein@OpenLDAP.org Wed May 28 20:28:24 2008 From: rein@OpenLDAP.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Wed, 28 May 2008 20:28:24 +0000 Message-ID: <200805282028.m4SKSOHX013869@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0539360325933920784==" --===============0539360325933920784== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On Wed, 28 May 2008, Howard Chu wrote: >> A case I have is where a consumer replicates a glue'ed database, with the >> exception of one subordinate backend where the consumer is the master. The >> subordinate backend is replicated back to the master of the glue'ed=20 >> database. >> With the current code the master would send the content of the subordinate= =20 >> db back to its master. > > Understood. In fact, having multiple sources of data in a glued tree is=20 > really a form of multi-master. (The separate glued branches cannot cause=20 > inconsistencies with each other, but still their contextCSNs must be manage= d=20 > individually.) Yes, this is a sort of multi-master configuration, but not what I think=20 of when I hear it (and read the doc). The doc. could be clearer that=20 different serverID values are always required when there are multiple=20 master servers, even if the configuration ensures that there will never be=20 more than one master for any backend. Btw, if I have understood things correctly there cannot safely be more then one subordinate db (in a glued environment) that replicates from any=20 single master, but it is OK as long as all the subordinates replicates=20 from different masters. That's why the syncrepl consumer in this case is=20 used on the glue db itself, not the subordinates. And it definitely tries=20 to interfere with what goes on in the subordinates (as it should). >> A patch that fixes this is at the referenced URL. As I am not sure of the >> consequences if a defaulted serverID=3D0 value was included in the syncCoo= kie=20 >> the >> patch changes the internal default slap_serverID value to -1 to make it=20 >> possible >> to differentiate between a configured and defaulted serverID=3D0. > >> Btw, there are potential problems with using serverID=3D0, so it would be = >> best if >> that value was reserved for the default unconfigured case. I.e, a default >> serverID=3D0 value could be chosen be slapadd when the two-argument form of >> serverID is used in the config, as resolving the URL needs the listener=20 >> argument >> to slapd to succeed. > > You mean the three-argument form? The two-argument form only allows a singl= e=20 > serverID to be configured anyway, so there is no ambiguity there. But you'r= e=20 > right, in tool mode when multiple serverIDs are configured, there's no way = > for it to choose the right serverID. That's a problem regardless of whether= =20 > the default is 0 or -1 though. Yes, I didn't count the serverID itself as an argument. If it was clear that different serverID values are always required if=20 there are more than one master server in a replication setup then it=20 should be safe to always include the sid in the syncrepl cookie. And the=20 internal distinction between a configured and defaulted serverID=3D0 value=20 this patch introduces would probably not be needed. > For now I think this is a doc issue; we could simply recommend that slapadd= =20 > always be performed on the node with ID 0, and you manually change the=20 > serverID config if you need to slapadd on some other node. My thought was that with serverID=3D0 reserved for the true single-master=20 configuration and tool mode we could safely ignore a contextCSN with 0 in=20 the sid field when serverID>0 is in use (to get rid of values already=20 in the databases). At startup syncprov could update its own contextCSN=20 value with newer entryCSN values that has 0 in the sid field. Ref=20 ITS#5537. Slapadd'ing on more than one master without synchronizing them between each run could still be a potential problem though.. Rein --===============0539360325933920784==-- From ghenry@OpenLDAP.org Wed May 28 20:39:54 2008 From: ghenry@OpenLDAP.org To: openldap-bugs@openldap.org Subject: (ITS#5538) Spelling of Respository at http://www.openldap.org/software/ Date: Wed, 28 May 2008 20:39:54 +0000 Message-ID: <200805282039.m4SKdsF2016288@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5196818019274165863==" --===============5196818019274165863== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Full_Name: Gavin Henry Version: N/A OS: URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (212.159.59.85) Submitted by: ghenry Spelling: Respository at: http://www.openldap.org/software/ --===============5196818019274165863==-- From hyc@symas.com Wed May 28 22:01:04 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5538) Spelling of Respository at http://www.openldap.org/software/ Date: Wed, 28 May 2008 22:01:03 +0000 Message-ID: <200805282201.m4SM13nt027341@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7933071922105898515==" --===============7933071922105898515== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable ghenry(a)OpenLDAP.org wrote: > Full_Name: Gavin Henry > Version: N/A > OS: > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (212.159.59.85) > Submitted by: ghenry > > > Spelling: > > Respository > > at: > > http://www.openldap.org/software/ I've fixed this in CVS. Kurt will have to handle pushing the update to the we= b=20 server. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============7933071922105898515==-- From hoshahrokhi@gmail.com Wed May 28 22:39:00 2008 From: hoshahrokhi@gmail.com To: openldap-bugs@openldap.org Subject: (ITS#5539) openLDAP Date: Wed, 28 May 2008 22:39:00 +0000 Message-ID: <200805282239.m4SMd0It032219@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2351661830250464320==" --===============2351661830250464320== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Homa Shahrokhi Version: 2.2.13-8.e14-6.4 OS: Red hat 4 URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (216.18.65.57) It is the first time that I am configuring an openLDAP. I download these four rpms : 1)openldap-2.3.30-3.fc6.i386.rpm 2)openldap-clients-2.3.30-3.fc6.i386.rpm 3)openldap-devel-2.3.30-3.fc6.i386.rpm 4)openldap-servers-2.3.30-3.fc6.i386.rpm and used "yum" to install all of them individual. And change the conf file. The ldap status is running. here is my sldap.conf: =20 database bdb suffix "dc=3Dexample,dc=3Dcom" rootdn "cn=3DManager,dc=3Dexample,dc=3Dcom" rootpw password directory /var/lib/ldap index objectClass eq,pres index ou,cn,mail,surname,givenname eq,pres,sub index uidNumber,gidNumber,loginShell eq,pres index uid,memberUid eq,pres,sub index nisMapName,nisMapEntry eq,pres,sub and here is my ldif file: dn: dc=3Dexample,dc=3Dcom objectClass:dcobject objectClass:organization objectClass:top dc: example and ran this command: ldappadd -x -D "cn=3DManager,dc=3Dexample,dc=3Dcom" -w password -f test.ldif and here is the result: ldap_add:Server is unwilling to perform (53) additional info: no global superior knowledge I add this part to the ldif file: dn: cn=3DManager,dc=3Dexample,dc=3Dcom objectClass: organizatiolRole cn: Manager and ran the same command and git the same error. I tried to use LDAP browser and I am able to connect but can not add any entr= y. Could you please let me know what to do and why it happens? I would really appreciate if someone can help. Thanks....Homa --===============2351661830250464320==-- From quanah@zimbra.com Wed May 28 23:14:35 2008 From: quanah@zimbra.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5539) openLDAP Date: Wed, 28 May 2008 23:14:34 +0000 Message-ID: <200805282314.m4SNEYfc036821@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7570731360519743339==" --===============7570731360519743339== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --On Wednesday, May 28, 2008 10:39 PM +0000 hoshahrokhi(a)gmail.com wrote: > Full_Name: Homa Shahrokhi > Version: 2.2.13-8.e14-6.4 > OS: Red hat 4 > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (216.18.65.57) > > > It is the first time that I am configuring an openLDAP. > I download these four rpms : > 1)openldap-2.3.30-3.fc6.i386.rpm > 2)openldap-clients-2.3.30-3.fc6.i386.rpm > 3)openldap-devel-2.3.30-3.fc6.i386.rpm > 4)openldap-servers-2.3.30-3.fc6.i386.rpm This is not provided by the OpenLDAP foundation. If you have support issues with things provided by Redhat, you need to contact them. Also, your issue seems to be basic knowledge questions. I suggest you read the online documentation, and if you have further questions, send them to openldap-software(a)openldap.org. The issue tracking system is for reporting bugs only. This ITS will be closed. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration --===============7570731360519743339==-- From hai.zhao@gmail.com Thu May 29 03:16:52 2008 From: hai.zhao@gmail.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5532) incorrect timestamp of slapd replica log Date: Thu, 29 May 2008 03:16:51 +0000 Message-ID: <200805290316.m4T3GpE5067126@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8871982405828839779==" --===============8871982405828839779== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable ------=3D_Part_7580_3624331.1212031000971 Content-Type: text/plain; charset=3DUTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, Quanah: I'm considering upgrading from 2.3 to 2.4.x. I haven't test 2.4.x yet. Does this bug exist in 2.4.x too? Regards, Hai On Thu, May 29, 2008 at 1:31 AM, Quanah Gibson-Mount wrote: > --On Tuesday, May 27, 2008 10:10 AM +0000 hai.zhao(a)gmail.com wrote: > > Full_Name: Zhao Hai >> Version: 2.3.41 >> OS: Linux 2.4.21 arm >> URL: ftp://ftp.openldap.org/incoming/zhaohai-080527.patch >> Submission from: (NULL) (205.209.140.4) >> >> >> Problem: >> race condition makes incorrect timestamp in replogfile, cause certain >> modification of entries not replicate to slurp slaves. >> >> replica: 180.0.10.2:1234 >> replica: 180.0.10.3:1234 >> time: 1211855467 >> ^^^^^^^^^^ this timestamp >> >> How to reproduce the problem: >> 1) run under very slow machines (my environ: arm 266MHz) >> 2) slapd is configed to generate replogfile >> 3) ldapadd about 5 entries, then ldapmodify 2 entries without delay. >> > > This is fixed in RE23. If there is ever a 2.3.43 release, it will be in > that. In the meantime, I'd advise using 2.3.42 + your patch. > > Regards, > Quanah > > > > -- > > Quanah Gibson-Mount > Principal Software Engineer > Zimbra, Inc > -------------------- > Zimbra :: the leader in open source messaging and collaboration > ------=3D_Part_7580_3624331.1212031000971 Content-Type: text/html; charset=3DUTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, Quanah:
I'm considering upgrading from 2.3 to 2.4.x. I haven= 39;t test 2.4.x yet. Does this bug exist in 2.4.x too?
Regards,
Hai=On Thu, May 29, 2008 at 1:31 AM, Quanah Gi= bson-Mount <quanah(a)zimbra.com= > wrote:
This is fixed in RE23. If there is ever a 2.3.43 release, it will be in= that. In the meantime, I'd advise using 2.3.42 + your patch.--On Tuesday, May 27, 2008 10:10 AM +0000 hai.zhao(a)gmail.com wrote:
Full_Name: Zhao Hai
Version: 2.3.41
OS: Linux 2.4.21 arm
URL: ftp://ftp.openldap.org/incoming/zhaohai-080527.patch
Submission from: (NULL) (2= 05.209.140.4)
Problem:
race condition makes incorrect timestamp in replogfile, cause certain
modification of entries not replicate to slurp slaves.
replica: 180.0.10.2:1234=
replica: 180.0.10.3:1234=
time: 1211855467
^^^^^^^^^^ this timestamp
How to reproduce the problem:
1) run under very slow machines (my environ: arm 266MHz)
2) slapd is configed to generate replogfile
3) ldapadd about 5 entries, then ldapmodify 2 entries without delay.
Regards,
Quanah
--
Quanah Gibson-Mount
Principal Software Engineer
Zimbra, Inc
--------------------
Zimbra :: the leader in open source messaging and collaboration
------=3D_Part_7580_3624331.1212031000971-- --===============8871982405828839779==-- From quanah@zimbra.com Thu May 29 04:02:53 2008 From: quanah@zimbra.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5532) incorrect timestamp of slapd replica log Date: Thu, 29 May 2008 04:02:52 +0000 Message-ID: <200805290402.m4T42qFR068053@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3240205975939719948==" --===============3240205975939719948== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --On Thursday, May 29, 2008 11:16 AM +0800 Haiwrote: > Hi, Quanah: > > I'm considering upgrading from 2.3 to 2.4.x. I haven't test 2.4.x yet. > Does this bug exist in 2.4.x too? Since slurpd was removed because it is completely unreliable and buggy, no, it does not exist. Sane people use syncrepl replication. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration --===============3240205975939719948==-- From abartlet@samba.org Thu May 29 11:25:13 2008 From: abartlet@samba.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5534) Samba4 needs internal transactions/consistancy Date: Thu, 29 May 2008 11:25:12 +0000 Message-ID: <200805291125.m4TBPClT014080@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1658699867368807714==" --===============1658699867368807714== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit --=-8f0GY55a/Qq8n0F+gHZS Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On Wed, 2008-05-28 at 08:14 -0700, Howard Chu wrote: > Andrew Bartlett wrote: > > On Tue, 2008-05-27 at 18:43 -0700, Howard Chu wrote: > >> Andrew Bartlett wrote: > >>> On Tue, 2008-05-27 at 18:22 -0700, Howard Chu wrote: > >>>>> This needs to occur even between databases on the server, but I won= 't ask that > >>>>> it occur outside the known trees. > >>>> It's already possible for operations in one database to reference en= tries in a > >>>> different database, so that aspect of validation should be fine. How= ever, as > >>>> noted before, "validation" is generally bogus to begin with. In part= icular, > >>>> how do you create entries with circular references? If you disallow = references > >>>> to nonexistent entries, you can't set the references until after all= of the > >>>> entries have been created. This means that you cannot backup a datab= ase that > >>>> has these references and then later reload it in a single pass. > >>> An interesting point, but I need to match the windows runtime > >>> behaviour. > >> Only when it has a visible impact on other clients. What software will= break > >> if the directory allows you to add new entries that contain dangling > >> references? What will break if the directory allows you to modify a re= ference > >> attribute to point to a nonexistent entry? > > > > Sure, I'm not asking for a change to default behaviours. I'm listing > > the things that our testsuite finds are differences, and looking for > > solutions. >=20 > I don't believe your proposed solution will ever be satisfactory. Entries= with=20 > circular references will also break syncrepl Refresh if the constraint yo= u're=20 > asking for is enforced.=20 Only if you don't consider them in replication. If the backlinks are added on each node, and not replicated, then surely you just need to import a set of replicated data, and then in the same transaction update the links.=20 Is there perhaps another way to implement this - say using a search-based virtual attribute for one half of the problem? I'm in no position to set your priorities, and my wishlist remains only that I hope to someday be able to make this work with OpenLDAP, but these issues remain. Andrew Bartlett --=20 Andrew Bartlett http://samba.org/~abartlet/ Authentication Developer, Samba Team http://samba.org Samba Developer, Red Hat Inc. --=-8f0GY55a/Qq8n0F+gHZS Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) iD8DBQBIPpKIz4A8Wyi0NrsRAhu+AJ9fRq1o5INcGiX1ZYJTAmjmBUMBogCfQ8gC zrbftn69NpgTvb546qKvGKA= =kiKt -----END PGP SIGNATURE----- --=-8f0GY55a/Qq8n0F+gHZS-- --===============1658699867368807714==-- From rein@OpenLDAP.org Thu May 29 12:47:27 2008 From: rein@OpenLDAP.org To: openldap-bugs@openldap.org Subject: Re: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Thu, 29 May 2008 12:47:26 +0000 Message-ID: <200805291247.m4TClQbW025196@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5089660210574103518==" --===============5089660210574103518== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On Wed, 28 May 2008, Howard Chu wrote: > rein(a)OpenLDAP.org wrote: >> Syncrepl includes the serverID in the syncCookie in multi-master mode only= ,=20 >> but >> there are other configuration that would benefit from it as well. The commited fix for this bug causes test033-glue-syncrepl to fail. The=20 serverID is not set by the config, which makes syncprov_qresp() skip the delete when it fins that the consumer presented a cookie with its own sid=20 value. Rein --===============5089660210574103518==-- From hyc@symas.com Thu May 29 14:49:32 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Thu, 29 May 2008 14:49:31 +0000 Message-ID: <200805291449.m4TEnVgA035948@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7027495900025592806==" --===============7027495900025592806== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable rein(a)OpenLDAP.org wrote: > On Wed, 28 May 2008, Howard Chu wrote: > >> rein(a)OpenLDAP.org wrote: > >>> Syncrepl includes the serverID in the syncCookie in multi-master mode onl= y, >>> but >>> there are other configuration that would benefit from it as well. > > The commited fix for this bug causes test033-glue-syncrepl to fail. The > serverID is not set by the config, which makes syncprov_qresp() skip the > delete when it fins that the consumer presented a cookie with its own sid > value. OK then I guess you're right and we need the default to be -1. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============7027495900025592806==-- From hyc@symas.com Thu May 29 19:22:08 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Thu, 29 May 2008 19:22:07 +0000 Message-ID: <200805291922.m4TJM7Yk061350@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5539602957918802231==" --===============5539602957918802231== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Rein Tollevik wrote: > Yes, this is a sort of multi-master configuration, but not what I think > of when I hear it (and read the doc). The doc. could be clearer that > different serverID values are always required when there are multiple > master servers, even if the configuration ensures that there will never be > more than one master for any backend. We should update the manpages with this ITS as well then. > Btw, if I have understood things correctly there cannot safely be more > then one subordinate db (in a glued environment) that replicates from any > single master, If the master has multiple DBs, and they're being separately replicated into = a=20 single DB, that would be a problem (regardless of glue on the consumer). If=20 the DBs are glued on the master, then there's no problem. > My thought was that with serverID=3D0 reserved for the true single-master > configuration and tool mode we could safely ignore a contextCSN with 0 in > the sid field when serverID>0 is in use (to get rid of values already > in the databases). At startup syncprov could update its own contextCSN > value with newer entryCSN values that has 0 in the sid field. Ref > ITS#5537. Slapadd'ing on more than one master without synchronizing > them between each run could still be a potential problem though.. That's not a viable solution. The syncprov startup check is primarily to recover from unclean shutdowns.=20 I.e., it's looking for newer CSNs that may have been saved before syncprov go= t=20 a chance to write its final checkpoint. Ignoring values, or giving special=20 treatment to sid 0 isn't going to work for that purpose. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============5539602957918802231==-- From hyc@symas.com Thu May 29 21:01:20 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5536) Always use a configured serverID in the syncrepl cookie Date: Thu, 29 May 2008 21:01:19 +0000 Message-ID: <200805292101.m4TL1J8n065637@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8594202805519397985==" --===============8594202805519397985== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable hyc(a)symas.com wrote: > Rein Tollevik wrote: >> My thought was that with serverID=3D0 reserved for the true single-master >> configuration and tool mode we could safely ignore a contextCSN with 0 in >> the sid field when serverID>0 is in use (to get rid of values already >> in the databases). At startup syncprov could update its own contextCSN >> value with newer entryCSN values that has 0 in the sid field. Ref >> ITS#5537. Slapadd'ing on more than one master without synchronizing >> them between each run could still be a potential problem though.. > > That's not a viable solution. > > The syncprov startup check is primarily to recover from unclean shutdowns. > I.e., it's looking for newer CSNs that may have been saved before syncprov = got > a chance to write its final checkpoint. Ignoring values, or giving special > treatment to sid 0 isn't going to work for that purpose. Hm, have to think about this some more. Generally, slapadd/slapindex require the directory to be offline. As such, if= =20 you have any running servers, you should be adding entries using ldapadd, not= =20 slapadd. So I'm going to ignore this case for now. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============8594202805519397985==-- From unix.gurus@gmail.com Fri May 30 00:01:05 2008 From: unix.gurus@gmail.com To: openldap-bugs@openldap.org Subject: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 00:01:05 +0000 Message-ID: <200805300001.m4U015rk075771@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8296824736058897926==" --===============8296824736058897926== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Sean Burford Version: 2.4.9 OS: Linux x86_64 URL: ftp://ftp.openldap.org/incoming/sean-burford-080529.tar.gz.1 Submission from: (NULL) (76.104.224.20) Adding equality and substring matching to an existing in use attribute causes the schema and database contents to mismatch. I added equality and substring matching to an attribute in my schema. A modification of an attribute value = was propogated a few days later, triggering the assertion and taking my replicas offline. Each restart replicated the change and triggered the assertion agai= n. When no matching is specified, new database entries do not have their normali= zed value populated in the database. When the matching is added, new database entries with have their normalized value populated in the database. There is= an assertion in attr.c that checks that attributes from the database have the expected normalization. I have attached a script and config to demonstrate the issue (ftp://ftp.openldap.org/incoming/sean-burford-080529.tar.gz.1) These files are in the tarball: slapd.d/ contains a server configuration that is suitable for reproducing the problem. script/trigger-assertion.sh performs the ldap operations necessary to trigger the assertion. The important ones are: - An attribute is added to the schema without equality matching. - An entry is added to the directory that uses the new attribute. - The schema is modified so that the attribute has equality matching. - Another attribute value is added to the entry, triggering the assertion. patch/attr-assertion.patch causes the operation to be rejected and logged, rather than triggering the assertion. It might not be the optimal patch for this problem, but it prevents the assertion and rejects the operation. --===============8296824736058897926==-- From unix.gurus@gmail.com Fri May 30 00:20:41 2008 From: unix.gurus@gmail.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 00:20:41 +0000 Message-ID: <200805300020.m4U0KfJe076743@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7403097769792543574==" --===============7403097769792543574== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ------=_Part_4694_18767492.1212106829556 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 Content-Disposition: inline VGhpcyBiYWNrdHJhY2UgbWF5IHByb3ZpZGUgc29tZSBmdXJ0aGVyIGluZm86CgojMCAgMHgwMDAw N2Y3MjU1OGFhMDk1IGluIHJhaXNlICgpIGZyb20gL2xpYi9saWJjLnNvLjYKIzEgIDB4MDAwMDdm NzI1NThhYmFmMCBpbiBhYm9ydCAoKSBmcm9tIC9saWIvbGliYy5zby42CiMyICAweDAwMDA3Zjcy NTU4YTMyZGYgaW4gX19hc3NlcnRfZmFpbCAoKSBmcm9tIC9saWIvbGliYy5zby42CiMzICAweDAw MDAwMDAwMDA0MjZlNDEgaW4gYXR0cl9tZXJnZSAoZT08dmFsdWUgb3B0aW1pemVkIG91dD4sCiAg ICBkZXNjPTx2YWx1ZSBvcHRpbWl6ZWQgb3V0PiwgdmFscz0weDk4Y2ViMCwgbnZhbHM9MHg5NTNi ZjApIGF0IGF0dHIuYzo0NzcKIzQgIDB4MDAwMDAwMDAwMDQ2ODFiYyBpbiBtb2RpZnlfYWRkX3Zh bHVlcyAoZT0weDQwODVmN2IwLCBtb2Q9MHg5OGNlNzAsCiAgICBwZXJtaXNzaXZlPTAsIHRleHQ9 MHg0MDg2MGNkMCwgdGV4dGJ1Zj0weDQwODVmOGIwICIw77+9XDIzMCIsIHRleHRsZW49MjU2KQog ICAgYXQgbW9kcy5jOjE1NQojNSAgMHgwMDAwMDAwMDAwNDhlNGJmIGluIGhkYl9tb2RpZnlfaW50 ZXJuYWwgKG9wPTB4OTUyNDAwLCB0aWQ9MHg5NTM2NDAsCiAgICBtb2RsaXN0PTB4OThjZTcwLCBl PTB4NDA4NWY3YjAsIHRleHQ9MHg0MDg2MGNkMCwKICAgIHRleHRidWY9MHg0MDg1ZjhiMCAiMO+/ vVwyMzAiLCB0ZXh0bGVuPTI1NikgYXQgbW9kaWZ5LmM6MTAxCiM2ICAweDAwMDAwMDAwMDA0OGVl YWQgaW4gaGRiX21vZGlmeSAob3A9MHg5NTI0MDAsIHJzPTB4NDA4NjBjYjApCiAgICBhdCBtb2Rp ZnkuYzo1NzgKIzcgIDB4MDAwMDAwMDAwMDQzNDZlZCBpbiBmZV9vcF9tb2RpZnkgKG9wPTB4OTUy NDAwLCBycz0weDQwODYwY2IwKQogICAgYXQgbW9kaWZ5LmM6MzAwCiM4ICAweDAwMDAwMDAwMDA0 MzRmZGEgaW4gZG9fbW9kaWZ5IChvcD0weDk1MjQwMCwgcnM9MHg0MDg2MGNiMCkKICAgIGF0IG1v ZGlmeS5jOjE3NQojOSAgMHgwMDAwMDAwMDAwNDFlMTkzIGluIGNvbm5lY3Rpb25fb3BlcmF0aW9u IChjdHg9MHg0MDg2MGUwMCwKICAgIGFyZ192PTx2YWx1ZSBvcHRpbWl6ZWQgb3V0PikgYXQgY29u bmVjdGlvbi5jOjEwODQKIzEwIDB4MDAwMDAwMDAwMDQxZTk5NSBpbiBjb25uZWN0aW9uX3JlYWRf dGhyZWFkIChjdHg9MHg0MDg2MGUwMCwKICAgIGFyZ3Y9PHZhbHVlIG9wdGltaXplZCBvdXQ+KSBh dCBjb25uZWN0aW9uLmM6MTIxMQojMTEgMHgwMDAwMDAwMDAwNTQzMGRhIGluIGxkYXBfaW50X3Ro cmVhZF9wb29sX3dyYXBwZXIgKHhwb29sPTB4OGQ3YzYwKQogICAgYXQgdHBvb2wuYzo2NjMKIzEy IDB4MDAwMDdmNzI1NmU2ZDNmNyBpbiBzdGFydF90aHJlYWQgKCkgZnJvbSAvbGliL2xpYnB0aHJl YWQuc28uMAojMTMgMHgwMDAwN2Y3MjU1OTRmYjJkIGluIGNsb25lICgpIGZyb20gL2xpYi9saWJj LnNvLjYKIzE0IDB4MDAwMDAwMDAwMDAwMDAwMCBpbiA/PyAoKQo= ------=_Part_4694_18767492.1212106829556 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 Content-Disposition: inline VGhpcyBiYWNrdHJhY2UgbWF5IHByb3ZpZGUgc29tZSBmdXJ0aGVyIGluZm86PGJyPjxicj4jMCZu YnNwOyAweDAwMDA3ZjcyNTU4YWEwOTUgaW4gcmFpc2UgKCkgZnJvbSAvbGliL2xpYmMuc28uNjxi cj4jMSZuYnNwOyAweDAwMDA3ZjcyNTU4YWJhZjAgaW4gYWJvcnQgKCkgZnJvbSAvbGliL2xpYmMu c28uNjxicj4jMiZuYnNwOyAweDAwMDA3ZjcyNTU4YTMyZGYgaW4gX19hc3NlcnRfZmFpbCAoKSBm cm9tIC9saWIvbGliYy5zby42PGJyPgojMyZuYnNwOyAweDAwMDAwMDAwMDA0MjZlNDEgaW4gYXR0 cl9tZXJnZSAoZT0mbHQ7dmFsdWUgb3B0aW1pemVkIG91dCZndDssPGJyPiZuYnNwOyZuYnNwOyZu YnNwOyBkZXNjPSZsdDt2YWx1ZSBvcHRpbWl6ZWQgb3V0Jmd0OywgdmFscz0weDk4Y2ViMCwgbnZh bHM9MHg5NTNiZjApIGF0IGF0dHIuYzo0Nzc8YnI+IzQmbmJzcDsgMHgwMDAwMDAwMDAwNDY4MWJj IGluIG1vZGlmeV9hZGRfdmFsdWVzIChlPTB4NDA4NWY3YjAsIG1vZD0weDk4Y2U3MCw8YnI+CiZu YnNwOyZuYnNwOyZuYnNwOyBwZXJtaXNzaXZlPTAsIHRleHQ9MHg0MDg2MGNkMCwgdGV4dGJ1Zj0w eDQwODVmOGIwICZxdW90OzDvv71cMjMwJnF1b3Q7LCB0ZXh0bGVuPTI1Nik8YnI+Jm5ic3A7Jm5i c3A7Jm5ic3A7IGF0IG1vZHMuYzoxNTU8YnI+IzUmbmJzcDsgMHgwMDAwMDAwMDAwNDhlNGJmIGlu IGhkYl9tb2RpZnlfaW50ZXJuYWwgKG9wPTB4OTUyNDAwLCB0aWQ9MHg5NTM2NDAsPGJyPiZuYnNw OyZuYnNwOyZuYnNwOyBtb2RsaXN0PTB4OThjZTcwLCBlPTB4NDA4NWY3YjAsIHRleHQ9MHg0MDg2 MGNkMCw8YnI+CiZuYnNwOyZuYnNwOyZuYnNwOyB0ZXh0YnVmPTB4NDA4NWY4YjAgJnF1b3Q7MO+/ vVwyMzAmcXVvdDssIHRleHRsZW49MjU2KSBhdCBtb2RpZnkuYzoxMDE8YnI+IzYmbmJzcDsgMHgw MDAwMDAwMDAwNDhlZWFkIGluIGhkYl9tb2RpZnkgKG9wPTB4OTUyNDAwLCBycz0weDQwODYwY2Iw KTxicj4mbmJzcDsmbmJzcDsmbmJzcDsgYXQgbW9kaWZ5LmM6NTc4PGJyPiM3Jm5ic3A7IDB4MDAw MDAwMDAwMDQzNDZlZCBpbiBmZV9vcF9tb2RpZnkgKG9wPTB4OTUyNDAwLCBycz0weDQwODYwY2Iw KTxicj4KJm5ic3A7Jm5ic3A7Jm5ic3A7IGF0IG1vZGlmeS5jOjMwMDxicj4jOCZuYnNwOyAweDAw MDAwMDAwMDA0MzRmZGEgaW4gZG9fbW9kaWZ5IChvcD0weDk1MjQwMCwgcnM9MHg0MDg2MGNiMCk8 YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGF0IG1vZGlmeS5jOjE3NTxicj4jOSZuYnNwOyAweDAwMDAw MDAwMDA0MWUxOTMgaW4gY29ubmVjdGlvbl9vcGVyYXRpb24gKGN0eD0weDQwODYwZTAwLDxicj4m bmJzcDsmbmJzcDsmbmJzcDsgYXJnX3Y9Jmx0O3ZhbHVlIG9wdGltaXplZCBvdXQmZ3Q7KSBhdCBj b25uZWN0aW9uLmM6MTA4NDxicj4KIzEwIDB4MDAwMDAwMDAwMDQxZTk5NSBpbiBjb25uZWN0aW9u X3JlYWRfdGhyZWFkIChjdHg9MHg0MDg2MGUwMCw8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7IGFyZ3Y9 Jmx0O3ZhbHVlIG9wdGltaXplZCBvdXQmZ3Q7KSBhdCBjb25uZWN0aW9uLmM6MTIxMTxicj4jMTEg MHgwMDAwMDAwMDAwNTQzMGRhIGluIGxkYXBfaW50X3RocmVhZF9wb29sX3dyYXBwZXIgKHhwb29s PTB4OGQ3YzYwKTxicj4mbmJzcDsmbmJzcDsmbmJzcDsgYXQgdHBvb2wuYzo2NjM8YnI+CiMxMiAw eDAwMDA3ZjcyNTZlNmQzZjcgaW4gc3RhcnRfdGhyZWFkICgpIGZyb20gL2xpYi9saWJwdGhyZWFk LnNvLjA8YnI+IzEzIDB4MDAwMDdmNzI1NTk0ZmIyZCBpbiBjbG9uZSAoKSBmcm9tIC9saWIvbGli Yy5zby42PGJyPiMxNCAweDAwMDAwMDAwMDAwMDAwMDAgaW4gPz8gKCk8YnI+PGJyPgo= ------=_Part_4694_18767492.1212106829556-- --===============7403097769792543574==-- From hyc@symas.com Fri May 30 00:41:24 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 00:41:23 +0000 Message-ID: <200805300041.m4U0fN47077805@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3907181159977752298==" --===============3907181159977752298== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable unix.gurus(a)gmail.com wrote: > ------=3D_Part_4694_18767492.1212106829556 > Content-Type: text/plain; charset=3DUTF-8 > Content-Transfer-Encoding: base64 > Content-Disposition: inline > > VGhpcyBiYWNrdHJhY2UgbWF5IHByb3ZpZGUgc29tZSBmdXJ0aGVyIGluZm86CgojMCAgMHgwMDAw > N2Y3MjU1OGFhMDk1IGluIHJhaXNlICgpIGZyb20gL2xpYi9saWJjLnNvLjYKIzEgIDB4MDAwMDdm > NzI1NThhYmFmMCBpbiBhYm9ydCAoKSBmcm9tIC9saWIvbGliYy5zby42CiMyICAweDAwMDA3Zjcy > NTU4YTMyZGYgaW4gX19hc3NlcnRfZmFpbCAoKSBmcm9tIC9saWIvbGliYy5zby42CiMzICAweDAw Thanks, the original report was sufficient. It surfaces a larger problem,=20 which we've been ignoring up till now. The correct action would be to iterate= =20 through all the databases and generate the normalized values for all the=20 affected attributes. There is currently no code to make that happen though.=20 (Likewise, if deleting matching rules, the normalized values must also be=20 deleted.) As such, the only way to progress after such a change would be to=20 dump and reload the DBs (slapcat/slapadd). We'll probably need to discuss on the -devel list what steps to take from her= e. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============3907181159977752298==-- From hyc@symas.com Fri May 30 09:40:56 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 09:40:56 +0000 Message-ID: <200805300940.m4U9euZn040707@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4745193279106658114==" --===============4745193279106658114== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------050600010007030200030106 Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed Content-Transfer-Encoding: 7bit hyc(a)symas.com wrote: > We'll probably need to discuss on the -devel list what steps to take from h= ere. > I wrote the attached patch for the original issue. Unfortunately it asserted = right away: [Switching to Thread 1090525504 (LWP 23577)] 0x00002b55e738d535 in raise () from /lib64/libc.so.6 (gdb) bt #0 0x00002b55e738d535 in raise () from /lib64/libc.so.6 #1 0x00002b55e738e990 in abort () from /lib64/libc.so.6 #2 0x00002b55e7386c16 in __assert_fail () from /lib64/libc.so.6 #3 0x00000000004410e5 in attr_valadd (a=3D0xb866c8, vals=3D0x41000670, nvals= =3D0x0,=20 nn=3D1) at ../../../r24/servers/slapd/attr.c:394 #4 0x0000000000441a06 in attr_merge_one (e=3D0xb72c08, desc=3D0x8b3780,=20 val=3D0x41000670, nval=3D0x0) at ../../../r24/servers/slapd/attr.c:599 #5 0x000000000043ea0f in slap_add_opattrs (op=3D0x965ec0, text=3D , textbuf=3D , textlen=3D , manage_ctxcsn=3D ) = at=20 ../../../r24/servers/slapd/add.c:664 #6 0x00000000004d9c42 in hdb_add (op=3D0x965ec0, rs=3D0x41000ca0) at add.c:1= 08 #7 0x000000000043f1a6 in fe_op_add (op=3D0x965ec0, rs=3D0x41000ca0) at=20 ../../../r24/servers/slapd/add.c:334 #8 0x000000000043fa12 in do_add (op=3D0x965ec0, rs=3D0x41000ca0) at=20 ../../../r24/servers/slapd/add.c:194 #9 0x00000000004383a7 in connection_operation (ctx=3D0x41000de0,=20 arg_v=3D0x965ec0) at ../../../r24/servers/slapd/connection.c:1084 #10 0x00000000004388cf in connection_read_thread (ctx=3D0x41000de0, argv=3D0x= c) at=20 ../../../r24/servers/slapd/connection.c:1211 #11 0x000000000054b8ca in ldap_int_thread_pool_wrapper (xpool=3D0x8bf070) at = ../../../r24/libraries/libldap_r/tpool.c:663 #12 0x00002b55e655e09e in start_thread () from /lib64/libpthread.so.0 #13 0x00002b55e741e4cd in clone () from /lib64/libc.so.6 #14 0x0000000000000000 in ?? () It was adding the createTimestamp attribute, without providing normalized=20 values. slap_add_opattrs was written before the generalizedTimeNormalize=20 function was written... I suspect there will be a fair number of cases that=20 need to be cleaned up. I don't have time at the moment to chase them all down= .=20 Anyone else want to jump in here? If not, we may have to push this back a bit= .=20 Note that this patch will probably require a fair number of databases to be=20 reloaded. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --------------050600010007030200030106 Content-Type: text/plain; name=3D"dif.txt" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename=3D"dif.txt" Index: attr.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D RCS file: /repo/OpenLDAP/pkg/ldap/servers/slapd/attr.c,v retrieving revision 1.112.2.7 diff -u -r1.112.2.7 attr.c --- attr.c 11 Feb 2008 23:26:43 -0000 1.112.2.7 +++ attr.c 30 May 2008 09:33:43 -0000 @@ -366,8 +366,39 @@ BerVarray nvals, int nn ) { - int i; BerVarray v2; + int i; + + { + /* FIXME: if the schema has been edited, and an equality matching rule + * has been added or removed from the attribute definition, the database + * values may no longer be in sync with our expectations. Currently this + * means the DB must be reloaded. + */ + int have_norm, have_nval, new_nval; + have_norm =3D a->a_desc->ad_type->sat_equality->smr_normalize !=3D NULL; + have_nval =3D a->a_nvals !=3D a->a_vals; + new_nval =3D nvals !=3D NULL; + + /* this check is only relevant if any values already exist */ + if ( a->a_vals !=3D NULL && have_norm !=3D have_nval ) { + Debug(LDAP_DEBUG_ANY, + "attr_valadd: database inconsistent with schema definition of %s, reload= the DB\n", + a->a_desc->ad_cname.bv_val, 0, 0 ); + return LDAP_OTHER; + /* no need to compare have_nval with new_nval; by transitivity they will = match if + * the above check and the following check succeed. + */ + } + + assert( have_norm =3D=3D new_nval ); + if ( have_norm !=3D new_nval ) { + Debug(LDAP_DEBUG_ANY, + "attr_valadd: new values of %s not properly normalized (should never hap= pen!)\n", + a->a_desc->ad_cname.bv_val, 0, 0 ); + return LDAP_OTHER; + } + } =20 v2 =3D (BerVarray) SLAP_REALLOC( (char *) a->a_vals, (a->a_numvals + nn + 1) * sizeof(struct berval) ); @@ -469,15 +500,6 @@ =20 if ( *a =3D=3D NULL ) { *a =3D attr_alloc( desc ); - } else { - /* - * FIXME: if the attribute already exists, the presence - * of nvals and the value of (*a)->a_nvals must be consistent - */ - assert( ( nvals =3D=3D NULL && (*a)->a_nvals =3D=3D (*a)->a_vals ) - || ( nvals !=3D NULL && ( - ( (*a)->a_vals =3D=3D NULL && (*a)->a_nvals =3D=3D NULL ) - || ( (*a)->a_nvals !=3D (*a)->a_vals ) ) ) ); } =20 if ( vals !=3D NULL ) { --------------050600010007030200030106-- --===============4745193279106658114==-- From pwadas@jewish.org.pl Fri May 30 10:24:22 2008 From: pwadas@jewish.org.pl To: openldap-bugs@openldap.org Subject: (ITS#5541) slapd segfaults with specific search on string bdb and hdb backend Date: Fri, 30 May 2008 10:24:22 +0000 Message-ID: <200805301024.m4UAOMG5045690@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3857303622780603765==" --===============3857303622780603765== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Piotr Wadas Version: 2.4.7 upto 2.4.9 OS: debian 2.6.18+ kernel URL:=20 Submission from: (NULL) (195.95.182.4) The issue is discussed at http://www.openldap.org/lists/openldap-software/200805/msg00136.html List message contains debug information, steps to reproduce, backtrace logs etc. Issue appears since 2.4.7 in 2.4 series. gdb bt quick ref: #0 0xb7b4842c in free () from /usr/lib/i486-linux-gnu/i686/cmov/libc.so.6 #1 0xb7e901aa in ber_memfree_x (p=3D0x0, ctx=3D0x0) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/liblber/memory.c:152 #2 0xb7e9019c in ber_memfree_x (p=3D0x0, ctx=3D0x0) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/liblber/memory.c:159 #3 0xb7e90235 in ber_bvarray_free_x (a=3D0xa96e3354, ctx=3D0x8279658) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/liblber/memory.c:731 #4 0xb73028e5 in bdb_filter_candidates (op=3D0x82792e0, locker=3D34, f=3D0xa= 96e325c, ids=3D0xa9062008, tmp=3D0xa8ee2008, stack=3D0xa90e2008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:803 #5 0xb7303064 in list_candidates (op=3D0x82792e0, locker=3D34, flist=3D0xa96= e31ec, ftype=3D160, ids=3D0xa8fe2008, tmp=3D0xa8ee2008, save=3D0xa9062008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:581 #6 0xb73017c7 in bdb_filter_candidates (op=3D0x82792e0, locker=3D34, f=3D0xa= 96e32bc, ids=3D0xa8fe2008, tmp=3D0xa8ee2008, stack=3D0xa9062008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:198 #7 0xb7303064 in list_candidates (op=3D0x82792e0, locker=3D34, flist=3D0xa9b= e2ec8, ftype=3D161, ids=3D0xa8f62008, tmp=3D0xa8ee2008, save=3D0xa8fe2008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:581 #8 0xb73015ca in bdb_filter_candidates (op=3D0x82792e0, locker=3D34, f=3D0xa= 9be2ebc, ids=3D0xa8f62008, tmp=3D0xa8ee2008, stack=3D0xa8fe2008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:204 #9 0xb7303064 in list_candidates (op=3D0x82792e0, locker=3D34, flist=3D0xa9b= e2eb0, ftype=3D160, ids=3D0xa9b22e1c, tmp=3D0xa8ee2008, save=3D0xa8f62008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:581 #10 0xb73017c7 in bdb_filter_candidates (op=3D0x82792e0, locker=3D34, f=3D0xa= 9be2ed4, ids=3D0xa9b22e1c, tmp=3D0xa8ee2008, stack=3D0xa8f62008) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb= /filterindex.c:198 #11 0xb72fc858 in bdb_search (op=3D0x82792e0, rs=3D0xa9be4168) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-bdb/search= .c:1109 #12 0x080d76f1 in overlay_op_walk (op=3D0x82792e0, rs=3D0xa9be4168, which=3Do= p_search, oi=3D0x81f63d8, on=3D0x81f64d8) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/backover.c:646 #13 0x080d7c5d in over_op_func (op=3D0x82792e0, rs=3D0xa9be4168, which=3Dop_s= earch) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/backover.c:698 #14 0x08077fd3 in fe_op_search (op=3D0x82792e0, rs=3D0xa9be4168) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/search.c:366 #15 0x080787fc in do_search (op=3D0x82792e0, rs=3D0xa9be4168) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/search.c:217 #16 0x08075a9f in connection_operation (ctx=3D0xa9be4248, arg_v=3D0x82792e0) = at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/connection.c:10= 84 #17 0x08076196 in connection_read_thread (ctx=3D0xa9be4248, argv=3D0x10) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/connection.c:12= 11 #18 0xb7ea1d64 in ldap_int_thread_pool_wrapper (xpool=3D0x81b09b8) at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/libldap_r/tpool.c:6= 63 #19 0xb7c2c4fb in start_thread () from /usr/lib/i486-linux-gnu/i686/cmov/libpthread.so.0 #20 0xb7bafe8e in clone () from /usr/lib/i486-linux-gnu/i686/cmov/libc.so.6 --===============3857303622780603765==-- From emmanuel.duru@atosorigin.com Fri May 30 11:26:46 2008 From: emmanuel.duru@atosorigin.com To: openldap-bugs@openldap.org Subject: (ITS#5542) Bug in libldap/t61.c (for your information) Date: Fri, 30 May 2008 11:26:45 +0000 Message-ID: <200805301126.m4UBQj8L048723@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2292729465002135752==" --===============2292729465002135752== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Full_Name: Emmanuel Duru Version: 2.3.39 OS: Windows URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (195.68.44.148) In t61.c/ldap_utf8s_to_t61s(), the second loop is an infinite loop, there mis= ses a "i +=3D j; c +=3D j" at the end of the loop. --===============2292729465002135752==-- From hyc@symas.com Fri May 30 15:34:28 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5542) Bug in libldap/t61.c (for your information) Date: Fri, 30 May 2008 15:34:28 +0000 Message-ID: <200805301534.m4UFYSTD076818@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2167578760131256018==" --===============2167578760131256018== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable emmanuel.duru(a)atosorigin.com wrote: > Full_Name: Emmanuel Duru > Version: 2.3.39 > OS: Windows > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (195.68.44.148) > In t61.c/ldap_utf8s_to_t61s(), the second loop is an infinite loop, there m= isses > a "i +=3D j; c +=3D j" at the end of the loop. Congratulations, you're the first person to use this code in over 6 years. Ou= t=20 of curiosity, why do you need it? Thanks for the report, fixed in CVS. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============2167578760131256018==-- From hyc@symas.com Fri May 30 16:10:45 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5541) slapd segfaults with specific search on string bdb and hdb backend Date: Fri, 30 May 2008 16:10:44 +0000 Message-ID: <200805301610.m4UGAiYX081449@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7868789302420530660==" --===============7868789302420530660== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable pwadas(a)jewish.org.pl wrote: > Full_Name: Piotr Wadas > Version: 2.4.7 upto 2.4.9 > OS: debian 2.6.18+ kernel > URL: > Submission from: (NULL) (195.95.182.4) > > > The issue is discussed at > http://www.openldap.org/lists/openldap-software/200805/msg00136.html > > List message contains debug information, steps to reproduce, > backtrace logs etc. > Issue appears since 2.4.7 in 2.4 series. The config info you posted is missing your index configuration, which is most= =20 relevant here. From your traces, we could use a little more info as well: frame 4 print *ava->aa_desc print *mr > > gdb bt quick ref: > > #0 0xb7b4842c in free () from /usr/lib/i486-linux-gnu/i686/cmov/libc.so.6 > #1 0xb7e901aa in ber_memfree_x (p=3D0x0, ctx=3D0x0) at > /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/liblber/memory.c:= 152 > #2 0xb7e9019c in ber_memfree_x (p=3D0x0, ctx=3D0x0) at > /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/liblber/memory.c:= 159 > #3 0xb7e90235 in ber_bvarray_free_x (a=3D0xa96e3354, ctx=3D0x8279658) at > /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/libraries/liblber/memory.c:= 731 > #4 0xb73028e5 in bdb_filter_candidates (op=3D0x82792e0, locker=3D34, f=3D0= xa96e325c, > ids=3D0xa9062008, tmp=3D0xa8ee2008, stack=3D0xa90e2008) > at /home/pwadas/SRC/SLAPD/DEB249/openldap2.3-2.4.9/servers/slapd/back-= bdb/filterindex.c:803 --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============7868789302420530660==-- From unix.gurus@gmail.com Fri May 30 17:15:11 2008 From: unix.gurus@gmail.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 17:15:10 +0000 Message-ID: <200805301715.m4UHFAGE095457@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5820745493737057365==" --===============5820745493737057365== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable ------=3D_Part_7327_2415938.1212167698754 Content-Type: text/plain; charset=3DISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, On Fri, May 30, 2008 at 2:40 AM, wrote: > This is a multi-part message in MIME format. > --------------050600010007030200030106 > Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed > Content-Transfer-Encoding: 7bit > > hyc(a)symas.com wrote: > > We'll probably need to discuss on the -devel list what steps to take from > here. > > > I wrote the attached patch for the original issue. Unfortunately it > asserted > right away: > > [Switching to Thread 1090525504 (LWP 23577)] > 0x00002b55e738d535 in raise () from /lib64/libc.so.6 > (gdb) bt > #0 0x00002b55e738d535 in raise () from /lib64/libc.so.6 > #1 0x00002b55e738e990 in abort () from /lib64/libc.so.6 > #2 0x00002b55e7386c16 in __assert_fail () from /lib64/libc.so.6 > #3 0x00000000004410e5 in attr_valadd (a=3D0xb866c8, vals=3D0x41000670, > nvals=3D0x0, > nn=3D1) at ../../../r24/servers/slapd/attr.c:394 > #4 0x0000000000441a06 in attr_merge_one (e=3D0xb72c08, desc=3D0x8b3780, > val=3D0x41000670, nval=3D0x0) > at ../../../r24/servers/slapd/attr.c:599 > #5 0x000000000043ea0f in slap_add_opattrs (op=3D0x965ec0, text=3D optimized > out>, textbuf=3D , > textlen=3D , manage_ctxcsn=3D )= at > ../../../r24/servers/slapd/add.c:664 > #6 0x00000000004d9c42 in hdb_add (op=3D0x965ec0, rs=3D0x41000ca0) at add.c= :108 > #7 0x000000000043f1a6 in fe_op_add (op=3D0x965ec0, rs=3D0x41000ca0) at > ../../../r24/servers/slapd/add.c:334 > #8 0x000000000043fa12 in do_add (op=3D0x965ec0, rs=3D0x41000ca0) at > ../../../r24/servers/slapd/add.c:194 > #9 0x00000000004383a7 in connection_operation (ctx=3D0x41000de0, > arg_v=3D0x965ec0) at ../../../r24/servers/slapd/connection.c:1084 > #10 0x00000000004388cf in connection_read_thread (ctx=3D0x41000de0, argv=3D= 0xc) > at > ../../../r24/servers/slapd/connection.c:1211 > #11 0x000000000054b8ca in ldap_int_thread_pool_wrapper (xpool=3D0x8bf070) at > ../../../r24/libraries/libldap_r/tpool.c:663 > #12 0x00002b55e655e09e in start_thread () from /lib64/libpthread.so.0 > #13 0x00002b55e741e4cd in clone () from /lib64/libc.so.6 > #14 0x0000000000000000 in ?? () > > It was adding the createTimestamp attribute, without providing normalized > values. slap_add_opattrs was written before the generalizedTimeNormalize > function was written... I suspect there will be a fair number of cases that > need to be cleaned up. I don't have time at the moment to chase them all > down. > Anyone else want to jump in here? If not, we may have to push this back a > bit. > Note that this patch will probably require a fair number of databases to be > reloaded. > > -- > -- Howard Chu > CTO, Symas Corp. http://www.symas.com > Director, Highland Sun http://highlandsun.com/hyc/ > Chief Architect, OpenLDAP http://www.openldap.org/project/ > > --------------050600010007030200030106 > Content-Type: text/plain; > name=3D"dif.txt" > Content-Transfer-Encoding: 7bit > Content-Disposition: inline; > filename=3D"dif.txt" > > Index: attr.c > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > RCS file: /repo/OpenLDAP/pkg/ldap/servers/slapd/attr.c,v > retrieving revision 1.112.2.7 > diff -u -r1.112.2.7 attr.c > --- attr.c 11 Feb 2008 23:26:43 -0000 1.112.2.7 > +++ attr.c 30 May 2008 09:33:43 -0000 > @@ -366,8 +366,39 @@ > BerVarray nvals, > int nn ) > { > - int i; > BerVarray v2; > + int i; > + > + { > + /* FIXME: if the schema has been edited, and an equality > matching rule > + * has been added or removed from the attribute definition, > the database > + * values may no longer be in sync with our expectations. > Currently this > + * means the DB must be reloaded. > + */ > + int have_norm, have_nval, new_nval; > + have_norm =3D a->a_desc->ad_type->sat_equality->smr_normali= ze > !=3D NULL; Not all attributes have an equality matching rule. This causes your patch to segfault since sat_equality is NULL: > have_norm =3D a->a_desc->ad_type->sat_equality->smr_normalize !=3D NULL; > This seems to be a better way to generate have_norm: > have_norm =3D a->a_desc->ad_type->sat_equality !=3D NULL && > a->a_desc->ad_type->sat_equality->smr_normalize !=3D NULL; > Once that is fixed the config backend causes an assert for me when it attempts to add createTimestamp, which is exactly the problem you describe. I'll create a patch that addresses any of these normalization issues that I can identify and send it to one of the openldap lists. Would openldap-its or openldap-devel be preferable? + have_nval =3D a->a_nvals !=3D a->a_vals; > + new_nval =3D nvals !=3D NULL; > + > + /* this check is only relevant if any values already exist > */ > + if ( a->a_vals !=3D NULL && have_norm !=3D have_nval ) { > + Debug(LDAP_DEBUG_ANY, > + "attr_valadd: database inconsistent with > schema definition of %s, reload the DB\n", > + a->a_desc->ad_cname.bv_val, 0, 0 ); > + return LDAP_OTHER; > + /* no need to compare have_nval with new_nval; by > transitivity they will match if > + * the above check and the following check succeed. > + */ > + } > + > + assert( have_norm =3D=3D new_nval ); > + if ( have_norm !=3D new_nval ) { > + Debug(LDAP_DEBUG_ANY, > + "attr_valadd: new values of %s not properly > normalized (should never happen!)\n", > + a->a_desc->ad_cname.bv_val, 0, 0 ); > + return LDAP_OTHER; > + } > + } > > v2 =3D (BerVarray) SLAP_REALLOC( (char *) a->a_vals, > (a->a_numvals + nn + 1) * sizeof(struct berval) ); > @@ -469,15 +500,6 @@ > > if ( *a =3D=3D NULL ) { > *a =3D attr_alloc( desc ); > - } else { > - /* > - * FIXME: if the attribute already exists, the presence > - * of nvals and the value of (*a)->a_nvals must be > consistent > - */ > - assert( ( nvals =3D=3D NULL && (*a)->a_nvals =3D=3D (*a)->a= _vals ) > - || ( nvals !=3D NULL && ( > - ( (*a)->a_vals =3D=3D NULL && > (*a)->a_nvals =3D=3D NULL ) > - || ( (*a)->a_nvals !=3D (*a)->a_vals > ) ) ) ); > } > > if ( vals !=3D NULL ) { > > --------------050600010007030200030106-- > > > --=20 Thanks, Sean Burford ------=3D_Part_7327_2415938.1212167698754 Content-Type: text/html; charset=3DISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, On Fri, May 30, 2008 at 2:40 AM, <<= a href=3D"mailto:hyc(a)symas.com">hyc(a)symas.com> wrote:This is a multi-part message in MIME format.
--------------050600010007030200030106
Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed
Content-Transfer-Encoding: 7bit
I wrote the attached patch for the original issue. Unfortunately it ass= erted
hyc(a)symas.com wrote:
> We'll probably need to discuss on the -devel list what steps to take= from here.
>
right away:
[Switching to Thread 1090525504 (LWP 23577)]
0x00002b55e738d535 in raise () from /lib64/libc.so.6
(gdb) bt
#0 0x00002b55e738d535 in raise () from /lib64/libc.so.6
#1 0x00002b55e738e990 in abort () from /lib64/libc.so.6
#2 0x00002b55e7386c16 in __assert_fail () from /lib64/libc.so.6
#3 0x00000000004410e5 in attr_valadd (a=3D0xb866c8, vals=3D0x41000670, = nvals=3D0x0,
nn=3D1) at ../../../r24/servers/slapd/attr.c:394
#4 0x0000000000441a06 in attr_merge_one (e=3D0xb72c08, desc=3D0x8b3780,=
val=3D0x41000670, nval=3D0x0)
at ../../../r24/servers/slapd/attr.c:599
#5 0x000000000043ea0f in slap_add_opattrs (op=3D0x965ec0, text=3D<va= lue optimized
out>, textbuf=3D<value optimized out>,
textlen=3D<value optimized out>, manage_ctxcsn=3D<val= ue optimized out>) at
../../../r24/servers/slapd/add.c:664
#6 0x00000000004d9c42 in hdb_add (op=3D0x965ec0, rs=3D0x41000ca0) at ad= d.c:108
#7 0x000000000043f1a6 in fe_op_add (op=3D0x965ec0, rs=3D0x41000ca0) at<= br> ../../../r24/servers/slapd/add.c:334
#8 0x000000000043fa12 in do_add (op=3D0x965ec0, rs=3D0x41000ca0) at
../../../r24/servers/slapd/add.c:194
#9 0x00000000004383a7 in connection_operation (ctx=3D0x41000de0,
arg_v=3D0x965ec0) at ../../../r24/servers/slapd/connection.c:1084
#10 0x00000000004388cf in connection_read_thread (ctx=3D0x41000de0, argv=3D0x= c) at
../../../r24/servers/slapd/connection.c:1211
#11 0x000000000054b8ca in ldap_int_thread_pool_wrapper (xpool=3D0x8bf070) at<= br> ../../../r24/libraries/libldap_r/tpool.c:663
#12 0x00002b55e655e09e in start_thread () from /lib64/libpthread.so.0
#13 0x00002b55e741e4cd in clone () from /lib64/libc.so.6
#14 0x0000000000000000 in ?? ()
It was adding the createTimestamp attribute, without providing normalized
values. slap_add_opattrs was written before the generalizedTimeNormalize
function was written... I suspect there will be a fair number of cases that need to be cleaned up. I don't have time at the moment to chase them all = down.
Anyone else want to jump in here? If not, we may have to push this back a bit= .
Note that this patch will probably require a fair number of databases to be reloaded.
--------------050600010007030200030106
--
-- Howard Chu
CTO, Symas Corp. http://www.symas.com
Director, Highland Sun http://highlandsun.com/hyc/
Chief Architect, OpenLDAP http://www.openldap.org/project/
Content-Type: text/plain;
name=3D"dif.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename=3D"dif.txt"
Index: attr.c
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
RCS file: /repo/OpenLDAP/pkg/ldap/servers/slapd/attr.c,v
retrieving revision 1.112.2.7<= /a>
diff -u -r1.112.2.7 attr.c
--- attr.c 11 Feb 2008 23:26:43 -0000  = ;1.112.2.7
+++ attr.c 30 May 2008 09:33:43 -0000
@@ -366,8 +366,39 @@
BerVarray nvals,
int nn )
{
- int i;
BerVarray v2;
+ int i;
+
+ {
+ /* FIXME: if the schema ha= s been edited, and an equality matching rule
+ * has been added or = removed from the attribute definition, the database
+ * values may no long= er be in sync with our expectations. Currently this
+ * means the DB must = be reloaded.
+ */
+ int have_norm, have_nval, = new_nval;
+ have_norm =3D a->a_desc= ->ad_type->sat_equality->smr_normalize !=3D NULL;<= br>Not all attributes have an equality matching rule. This causes your = patch to segfault since sat_equality is NULL:
have_norm =3D a->a_desc->ad_type->sat_equality->= smr_normalize !=3D NULL;
This seems to be a better way to generate have_norm:have_norm =3D a->a_desc->a= d_type->sat_equality !=3D NULL &&
&= nbsp; a->a_desc->ad_type->sat_equality->s= mr_normalize !=3D NULL;
Once that is fixed the con= fig backend causes an assert for me when it attempts to add createTimestamp, = which is exactly the problem you describe.
I'll create a patch that addresses any of these normalization issues = that I can identify and send it to one of the openldap lists. Would ope= nldap-its or openldap-devel be preferable?+ have_nval =3D a->a_nval= s !=3D a->a_vals;
+ new_nval =3D nvals !=3D NU= LL;
+
+ /* this check is only rele= vant if any values already exist */
+ if ( a->a_vals !=3D NUL= L && have_norm !=3D have_nval ) {
+  = ; Debug(LDAP_DEBUG_ANY,
+  = ; "attr_valadd: database inconsistent with s= chema definition of %s, reload the DB\n",
+  = ; a->a_desc->ad= _cname.bv_val, 0, 0 );
+  = ; return LDAP_OTHER;
+  = ; /* no need to compare have_nval with new_nval; by transitivity they will ma= tch if
+  = ; * the above check and the following check succeed.
+  = ; */
+ }
+
+ assert( have_norm =3D=3D n= ew_nval );
+ if ( have_norm !=3D new_nv= al ) {
+  = ; Debug(LDAP_DEBUG_ANY,
+  = ; "attr_valadd: new values of %s not properl= y normalized (should never happen!)\n",
+  = ; a->a_desc->ad= _cname.bv_val, 0, 0 );
+  = ; return LDAP_OTHER;
+ }
+ }
v2 =3D (BerVarray) SLAP_REALLOC( (char *) a->a= _vals,
(a->= a_numvals + nn + 1) * sizeof(struct berval) );
@@ -469,15 +500,6 @@
if ( *a =3D=3D NULL ) {
*a =3D attr_alloc( de= sc );
- } else {
- /*
- * FIXME: if the attr= ibute already exists, the presence
- * of nvals and the v= alue of (*a)->a_nvals must be consistent
- */
- assert( ( nvals =3D=3D NUL= L && (*a)->a_nvals =3D=3D (*a)->a_vals )
-  = ; || ( nvals !=3D NULL && (
-  = ; ( (*a)->a_vals = =3D=3D NULL && (*a)->a_nvals =3D=3D NULL )
-  = ; || ( (*a)->a_nva= ls !=3D (*a)->a_vals ) ) ) );
}
if ( vals !=3D NULL ) {
--------------050600010007030200030106--
--
Thanks,
Sean Burford ------=3D_Part_7327_2415938.1212167698754-- --===============5820745493737057365==-- From hyc@symas.com Fri May 30 17:51:39 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 17:51:39 +0000 Message-ID: <200805301751.m4UHpdsa097787@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6228782186583100687==" --===============6228782186583100687== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Sean Burford wrote: > Not all attributes have an equality matching rule. This causes your > patch to segfault since sat_equality is NULL: > > have_norm = a->a_desc->ad_type->sat_equality->smr_normalize != NULL; > > > This seems to be a better way to generate have_norm: > > have_norm = a->a_desc->ad_type->sat_equality != NULL && > a->a_desc->ad_type->sat_equality->smr_normalize != NULL; Thanks, looks fine. > Once that is fixed the config backend causes an assert for me when it > attempts to add createTimestamp, which is exactly the problem you describe. > > I'll create a patch that addresses any of these normalization issues > that I can identify and send it to one of the openldap lists. Would > openldap-its or openldap-devel be preferable? Just continue to reply to this ITS for now. -- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============6228782186583100687==-- From unix.gurus@gmail.com Fri May 30 23:49:27 2008 From: unix.gurus@gmail.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Fri, 30 May 2008 23:49:27 +0000 Message-ID: <200805302349.m4UNnREn036353@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7214912691769261649==" --===============7214912691769261649== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, On Fri, May 30, 2008 at 2:40 AM,wrote: > > I wrote the attached patch for the original issue. Unfortunately it asserted > right away: ... > It was adding the createTimestamp attribute, without providing normalized > values. slap_add_opattrs was written before the generalizedTimeNormalize > function was written... I suspect there will be a fair number of cases that > need to be cleaned up. I don't have time at the moment to chase them all do= wn. > Anyone else want to jump in here? If not, we may have to push this back a b= it. I've modified my copy of the source to normalize data where needed. slapd starts up and my test can run. With the old assertion in place it fails exactly as it did before, because the old attr_merge() assertion runs before your new attr_valadd() normalization check. Removing the old attr_merge() assertion results in your new attr_valadd() check being triggered. Removing the old assertion looks safe, since attr_merge() calls attr_valadd() almost immediately after the assertion anyway. With these changes, running my test script from the original tarball results = in: bdb_modify_internal: add testAttribute attr_valadd: database inconsistent with schema definition of testAttribute, reload the DB bdb_modify_internal: 80 modify/add: testAttribute: merge error (80) hdb_modify: modify failed (80) I'm working through 'make test' now to find more instances that need fixing. After that I'll send some patches. > Note that this patch will probably require a fair number of databases to be > reloaded. I'm not even sure that attributes can be automatically renormalized when a problem is detected, since bugs (eg. with the generation of timestamps, CSNs or referalls) can also trigger the normalization checks. -- Thanks, Sean Burford --===============7214912691769261649==-- From unix.gurus@gmail.com Sat May 31 01:32:15 2008 From: unix.gurus@gmail.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Sat, 31 May 2008 01:32:14 +0000 Message-ID: <200805310132.m4V1WECT040521@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5480967268621943701==" --===============5480967268621943701== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I'm having some trouble working out where to set the normalized value for ContextCSN in the modlist for the syncrepl refresh consumer (test017-syncreplication-refresh fails). The assertion backtrace looks like this: #0 0x00007f472879d095 in raise () from /lib/libc.so.6 #1 0x00007f472879eaf0 in abort () from /lib/libc.so.6 #2 0x00007f47287962df in __assert_fail () from /lib/libc.so.6 #3 0x0000000000425903 in attr_valadd (a=3D0x8fb380, vals=3D0xc72130, nvals=3D0x0, nn=3D1) at attr.c:398 #4 0x000000000046714c in modify_add_values (e=3D0x41ff5bb0, mod=3D0x41ff60e0, permissive=3D0, text=3D0x41ff6090, textbuf=3D0x41ff5cb0 "", textlen=3D256) at mods.c:155 #5 0x000000000048147d in bdb_modify_internal (op=3D0x41ff6780, tid=3D0xc71f50, modlist=3D0x41ff60e0, e=3D0x41ff5bb0, text=3D0x41ff6090, textbuf=3D0x41ff5cb0 "", textlen=3D256) at modify.c:133 #6 0x0000000000481f6d in bdb_modify (op=3D0x41ff6780, rs=3D0x41ff6070) at modify.c:578 #7 0x0000000000477d32 in overlay_op_walk (op=3D0x41ff6780, rs=3D0x41ff6070, which=3Dop_modify, oi=3D0x858990, on=3D0x0) at backover.c:646 #8 0x00000000004782b3 in over_op_func (op=3D0x41ff6780, rs=3D0x41ff6070, which=3Dop_modify) at backover.c:698 #9 0x000000000046dc59 in syncrepl_updateCookie (si=3D0x858560, op=3D0x249e, pdn=3D , syncCookie=3D0x41ff6310) at syncrepl.c:2785 #10 0x0000000000472bea in do_syncrep2 (op=3D0x41ff6780, si=3D0x858560) at syncrepl.c:961 #11 0x0000000000475072 in do_syncrepl (ctx=3D0x0, arg=3D0x8588f0) at syncrepl= .c:1276 #12 0x00000000004daa4a in ldap_int_thread_pool_wrapper (xpool=3D0x82e440) at tpool.c:663 #13 0x00007f47296d03f7 in start_thread () from /lib/libpthread.so.0 #14 0x00007f4728842b2d in clone () from /lib/libc.so.6 #15 0x0000000000000000 in ?? () In frame 3 a->a_desc->ad_type->sat_equality has a value but nvals has not been set, which is why the assertion triggers: (gdb) print a->a_desc->ad_type->sat_equality $39 =3D (MatchingRule *) 0x821be0 Way back in frame 10 do_syncrepl passes a modlist containing an unnormalized contextCSN to do_syncrep2, leading me to believe that I've missed something in syncrepl.c: (gdb) print *op->o_request->oq_modify->rs_mods->rs_modlist $44 =3D {sml_mod =3D {sm_desc =3D 0x824b70, sm_values =3D 0xc72130, sm_nvalues =3D 0x0, sm_numvals =3D 1, sm_op =3D 2, sm_flags =3D 0, sm_type =3D {bv_len = =3D 10, bv_val =3D 0x824be0 "contextCSN"}}, sml_next =3D 0x0} The debug output up to the assertion is: slap_queue_csn: queing 0xc72ae0 20080531010928.580166Z#000000#000#000000 daemon: epoll: listen=3D10 active_threads=3D0 tvp=3Dzero =3D> bdb_entry_get: ndn: "dc=3Dexample,dc=3Dcom" =3D> bdb_entry_get: oc: "(null)", at: "(null)" bdb_dn2entry("dc=3Dexample,dc=3Dcom") =3D> bdb_entry_get: found entry: "dc=3Dexample,dc=3Dcom" bdb_entry_get: rc=3D0 bdb_modify: dc=3Dexample,dc=3Dcom bdb_dn2entry("dc=3Dexample,dc=3Dcom") bdb_modify_internal: 0x00000001: dc=3Dexample,dc=3Dcom <=3D acl_access_allowed: granted to database root bdb_modify_internal: replace contextCSN slapd: attr.c:398: attr_valadd: Assertion `have_norm =3D=3D new_nval' failed. --=20 Thanks, Sean Burford --===============5480967268621943701==-- From hyc@symas.com Sat May 31 13:57:48 2008 From: hyc@symas.com To: openldap-bugs@openldap.org Subject: Re: (ITS#5540) Normalization assertion in attr.c Date: Sat, 31 May 2008 13:57:48 +0000 Message-ID: <200805311357.m4VDvmrK068701@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5528918455079687122==" --===============5528918455079687122== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Sean Burford wrote: > Hi, > > On Fri, May 30, 2008 at 2:40 AM, wrote: >> I wrote the attached patch for the original issue. Unfortunately it assert= ed >> right away: > ... >> It was adding the createTimestamp attribute, without providing normalized >> values. slap_add_opattrs was written before the generalizedTimeNormalize >> function was written... I suspect there will be a fair number of cases that >> need to be cleaned up. I don't have time at the moment to chase them all d= own. >> Anyone else want to jump in here? If not, we may have to push this back a = bit. > > I've modified my copy of the source to normalize data where needed. > slapd starts up and my test can run. With the old assertion in place > it fails exactly as it did before, because the old attr_merge() > assertion runs before your new attr_valadd() normalization check. That aspect of the patch is not optional. The old check is in the wrong place= =20 and must be removed. It misses the other places where attrs are being added, = while attr_valadd catches all of them. > Removing the old attr_merge() assertion results in your new > attr_valadd() check being triggered. Removing the old assertion looks > safe, since attr_merge() calls attr_valadd() almost immediately after > the assertion anyway. > > With these changes, running my test script from the original tarball result= s in: > bdb_modify_internal: add testAttribute > attr_valadd: database inconsistent with schema definition of > testAttribute, reload the DB > bdb_modify_internal: 80 modify/add: testAttribute: merge error (80) > hdb_modify: modify failed (80) > > I'm working through 'make test' now to find more instances that need > fixing. After that I'll send some patches. > >> Note that this patch will probably require a fair number of databases to be >> reloaded. > > I'm not even sure that attributes can be automatically renormalized > when a problem is detected, since bugs (eg. with the generation of > timestamps, CSNs or referalls) can also trigger the normalization > checks. I think it's important to continue to assert as in my patch, at least at this= =20 stage, so we can catch all of those bugs. I also don't think we can silently = renormalize just the cases that the "reload the DB" message detects, because = that's obviously only going to happen on entries that are explicitly modified= ,=20 and the rest of the DB will still have problems. --=20 -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/ --===============5528918455079687122==-- From pierangelo.masarati@sys-net.it Sat May 31 18:59:11 2008 From: pierangelo.masarati@sys-net.it To: openldap-bugs@openldap.org Subject: Re: (ITS#5533) test035-meta crashes --without-threads Date: Sat, 31 May 2008 18:59:11 +0000 Message-ID: <200805311859.m4VIxBkb084630@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7860304694396592278==" --===============7860304694396592278== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit h.b.furuseth(a)usit.uio.no wrote: > quanah(a)zimbra.com writes: > >> Isn't this just a duplicate of ITS#5489? >> > > Apparently not. Got it again at 4th run with daemon.c 1.380.2.12. > Also in a somewhat patched HEAD with the same configuration. > > Hm, the crashes happen for extended operations. So far > 6 times "Passwd ExOp failed (1)!", once "WhoAmI failed (49)!". > I couldn't reproduce this issue with HEAD; do you confirm it's a re24 only? p. Ing. Pierangelo Masarati OpenLDAP Core Team SysNet s.r.l. via Dossi, 8 - 27100 Pavia - ITALIA http://www.sys-net.it --------------------------------------- Office: +39 02 23998309 Mobile: +39 333 4963172 Email: pierangelo.masarati(a)sys-net.it --------------------------------------- --===============7860304694396592278==-- From h.b.furuseth@usit.uio.no Sat May 31 20:38:19 2008 From: h.b.furuseth@usit.uio.no To: openldap-bugs@openldap.org Subject: Re: (ITS#5533) test035-meta crashes --without-threads Date: Sat, 31 May 2008 20:38:18 +0000 Message-ID: <200805312038.m4VKcIUH088288@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0888270059954985274==" --===============0888270059954985274== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit pierangelo.masarati(a)sys-net.it writes: > I couldn't reproduce this issue with HEAD; do you confirm it's a re24 only? Still happens in HEAD as well as RE24. Not RE23 though. -- Hallvard --===============0888270059954985274==-- From pierangelo.masarati@sys-net.it Sat May 31 20:39:51 2008 From: pierangelo.masarati@sys-net.it To: openldap-bugs@openldap.org Subject: Re: (ITS#5533) test035-meta crashes --without-threads Date: Sat, 31 May 2008 20:39:51 +0000 Message-ID: <200805312039.m4VKdp9W088950@boole.openldap.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5619167176819425977==" --===============5619167176819425977== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Hallvard B Furuseth wrote: > pierangelo.masarati(a)sys-net.it writes: > >> I couldn't reproduce this issue with HEAD; do you confirm it's a re24 only? >> > > Still happens in HEAD as well as RE24. Not RE23 though. > Odd. I've been running test035 in HEAD for >100 times after rebuilding --without-threads with no failure. Anything I might be missing? p. Ing. Pierangelo Masarati OpenLDAP Core Team SysNet s.r.l. via Dossi, 8 - 27100 Pavia - ITALIA http://www.sys-net.it --------------------------------------- Office: +39 02 23998309 Mobile: +39 333 4963172 Email: pierangelo.masarati(a)sys-net.it --------------------------------------- --===============5619167176819425977==--