- openldap-bugs - openldap.org

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

That is exactly what I will do, thanks again. Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by quanah＠zimbra.com 15 Oct '09

15 Oct '09

--On Thursday, October 15, 2009 6:48 PM +0000 j(a)telepaths.org wrote: > Quanah, > > I wasn't sure what you meant, but I figured out gdb (never used it > before): > > This is what I did (on both servers), so I'm putting it here so people > aren't left in the dark: > > dpkg -i slapd-dbg (whatever version applicable) > apt-get install gdb > gdb (enter gdb console) > gdb> file /usr/sbin/slapd > gdb> set args -d -1 -u openldap -g openldap -h ldap:/// ldaps:/// > ldapi:/// -f /etc/ldap/slapd.conf > gdb> run > > Running on both servers now .... Great! After one crashes, run "thr apply all bt" and send that output to the ITS. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

Quanah, I wasn't sure what you meant, but I figured out gdb (never used it before): This is what I did (on both servers), so I'm putting it here so people aren't left in the dark: dpkg -i slapd-dbg (whatever version applicable) apt-get install gdb gdb (enter gdb console) gdb> file /usr/sbin/slapd gdb> set args -d -1 -u openldap -g openldap -h ldap:/// ldaps:/// ldapi:/// -f /etc/ldap/slapd.conf gdb> run Running on both servers now .... Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by quanah＠zimbra.com 15 Oct '09

15 Oct '09

--On Thursday, October 15, 2009 6:06 PM +0000 j(a)telepaths.org wrote: > We are in luck. I started fresh with my two servers (deleted the data > and repopulated). > > During the INITIAL sync-up on "server1" (receiving data from server2): > > <= index_entry_add( 225, > "krb5PrincipalName=host/seven.relay.example.com(a)RELAY.EXAMPLE.COM > ,cn=RELAY.EXAMPLE.COM,cn=gssapi,cn=auth,dc=real,dc=example,dc=com" ) > success > => entry_encode(0x000000e1): > <= entry_encode(0x000000e1): > => acl_get: [2] matched > => acl_get: [2] attr userPassword > => match[dn0]: 0 60 > uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com > => match[dn1]: 0 3 uid > => match[dn2]: 4 14 plainproxy > => acl_mask: access to entry > "uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com", attr > "userPassword" requested > => acl_mask: to value by "", (=0) > <= check a_dn_pat: self > <= check a_dn_pat: > uid=plainchange,cn=plain,cn=auth,dc=real,dc=example,dc=com > <= check a_dn_pat: > uid=plainmodify,cn=plain,cn=auth,dc=real,dc=example,dc=com > <= check a_dn_pat: anonymous > <= acl_mask: [4] applying auth(=xd) (stop) > <= acl_mask: [4] mask: auth(=xd) > => slap_access_allowed: auth access granted by auth(=xd) > => access_allowed: auth access granted by auth(=xd) > conn=1 op=1 BIND > dn="uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com" > mech=SIMPLE ssf=0 > do_bind: v3 bind: > "uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com" to > "uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com" > send_ldap_result: conn=1 op=1 p=3 > send_ldap_result: err=0 matched="" text="" > send_ldap_response: msgid=2 tag=97 err=0 > ber_flush2: 22 bytes to sd 33 > 0000: 30 84 00 00 00 10 02 01 02 61 84 00 00 00 07 0a > 0........a...... > 0010: 01 00 04 00 04 00 ...... > tls_write: want=101, written=101 > 0000: 17 03 02 00 60 3e 98 2a 48 b2 d9 ae 12 70 ab > db ....`>.*H....p.. > 0010: 5e 46 c2 ef 7f c3 32 72 d4 41 ef 4d 58 07 d0 50 ^F.... > 2r.A.MX..P > 0020: 53 a2 da 54 69 d7 1c 61 ed a7 ce 53 14 16 46 73 > S..Ti..a...S..Fs > 0030: 91 74 c4 92 9e 35 24 84 ce 8c 6f 18 18 6a 68 0a .t... > 5$...o..jh. > 0040: b0 69 70 75 0d 6a 5d fa 02 38 89 e9 d7 99 c9 99 .ipu.j].. > 8...... > 0050: bb 7b be 62 5d 50 91 2f a9 a2 6e d5 88 47 f8 ed .{.b] > P./..n..G.. > 0060: 5e 3c a7 dd 17 ^<... > ldap_write: want=22, written=22 > 0000: 30 84 00 00 00 10 02 01 02 61 84 00 00 00 07 0a > 0........a...... > 0010: 01 00 04 00 04 00 ...... > daemon: activity on 1 descriptor > daemon: activity on: 33r > daemon: read active on 33 > daemon: epoll: listen=7 active_threads=0 tvp=zero > daemon: epoll: listen=8 active_threads=0 tvp=zero > daemon: epoll: listen=9 active_threads=0 tvp=zero > daemon: epoll: listen=10 active_threads=0 tvp=zero > daemon: epoll: listen=11 active_threads=0 tvp=zero > connection_get(33) > connection_get(33): got connid=1 > connection_read(33): checking for input on id=1 > ber_get_next > tls_read: want=5, got=5 > 0000: 17 03 02 00 c0 ..... > tls_read: want=192, got=192 > 0000: 60 a2 1b 5e 6f 13 18 52 f1 86 c7 b5 ff ae ec bf > `..^o..R........ > 0010: 7e 7f 65 19 30 c0 4a 3a 7d de 76 77 5b bf 0b dc ~.e. > 0.J:}.vw[... > 0020: 22 15 34 f9 5b dd 2d 8f f5 19 e3 25 0d 25 a8 b6 ".4. > [.-....%.%.. > 0030: 07 34 75 a5 08 c6 3e c2 8e 18 58 11 ee 5d 25 7c . > 4u...>...X..]%| > 0040: 00 9b fb 14 a4 9c 7d c1 37 bf 92 f7 ee ef 04 94 ......}. > 7....... > 0050: 81 a8 98 d8 eb 5b 80 0f ce 7d 21 3c 24 fa ba ca ..... > [...}!<$... > 0060: 3f 9a 94 ef dd 7f 47 17 e0 f2 cb 08 04 a5 25 > a3 ?.....G.......%. > 0070: f0 3e 92 a4 75 a2 6e d3 34 1a 82 29 7b 9f b0 07 .>..u.n. > 4..){... > 0080: fd 4e 5f 1e 8f f2 55 33 c5 eb 5f 34 a1 f6 3d > 0a .N_...U3.._4..=. > 0090: c3 e7 4f 4a 77 85 a5 1e 40 f8 d4 60 8e bd 08 > 8c ..OJw...@..`.... > 00a0: 8e 87 7d 93 50 11 da c1 ea b0 e1 74 60 34 ad > b8 ..}.P......t`4.. > 00b0: c0 9a f3 66 44 3c e5 bf 6e b1 4f 4f f8 51 18 > df ...fD<..n.OO.Q.. > ldap_read: want=8, got=8 > 0000: 30 53 02 01 03 63 4e 04 0S...cN. > ldap_read: want=77, got=77 > 0000: 2e 63 6e 3d 70 6c 61 69 6e 2c 63 6e 3d 61 75 > 74 .cn=plain,cn=aut > 0010: 68 2c 64 63 3d 76 65 72 69 6f 2c 64 63 3d 61 6e > h,dc=relay,dc=ex > 0020: 6f 6e 79 6d 69 7a 65 72 2c 64 63 3d 63 6f 6d 0a > ample ,dc=com. > 0030: 01 01 0a 01 00 02 01 01 02 01 00 01 01 00 a3 > 0b ................ > 0040: 04 03 75 69 64 04 04 72 6f 6f 74 30 > 00 ..uid..root0. > ber_get_next: tag 0x30 len 83 contents: > ber_dump: buf=0x2a0d1d0 ptr=0x2a0d1d0 end=0x2a0d223 len=83 > 0000: 02 01 03 63 4e 04 2e 63 6e 3d 70 6c 61 69 6e > 2c ...cN..cn=plain, > 0010: 63 6e 3d 61 75 74 68 2c 64 63 3d 76 65 72 69 6f > cn=auth,dc=relay > 0020: 2c 64 63 3d 61 6e 6f 6e 79 6d 69 7a 65 72 2c > 64 ,dc=example,dc=com > 0030: 63 3d 63 6f 6d 0a 01 01 0a 01 00 02 01 01 02 01 ........... > 0040: 00 01 01 00 a3 0b 04 03 75 69 64 04 04 72 6f > 6f ........uid..roo > 0050: 74 30 00 t0. > op tag 0x63, time 1255629604 > connection_input: conn=1 deferring operation: binding > ber_get_next > tls_read: want=5 error=Resource temporarily unavailable > ldap_read: want=8, got=0 > > daemon: activity on 1 descriptor > daemon: activity on: > daemon: epoll: listen=7 active_threads=0 tvp=zero > daemon: epoll: listen=8 active_threads=0 tvp=zero > daemon: epoll: listen=9 active_threads=0 tvp=zero > daemon: epoll: listen=10 active_threads=0 tvp=zero > daemon: epoll: listen=11 active_threads=0 tvp=zero > Segmentation fault <--------- HERE IT IS > > Again, this was just the initial sync-up. This is not a gdb backtrace from a core file, where slapd has debugging symbols. This information is not really useful. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

We are in luck. I started fresh with my two servers (deleted the data and repopulated). During the INITIAL sync-up on "server1" (receiving data from server2): <= index_entry_add( 225, "krb5PrincipalName=host/seven.relay.example.com(a)RELAY.EXAMPLE.COM ,cn=RELAY.EXAMPLE.COM,cn=gssapi,cn=auth,dc=real,dc=example,dc=com" ) success => entry_encode(0x000000e1): <= entry_encode(0x000000e1): => acl_get: [2] matched => acl_get: [2] attr userPassword => match[dn0]: 0 60 uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com => match[dn1]: 0 3 uid => match[dn2]: 4 14 plainproxy => acl_mask: access to entry "uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com", attr "userPassword" requested => acl_mask: to value by "", (=0) <= check a_dn_pat: self <= check a_dn_pat: uid=plainchange,cn=plain,cn=auth,dc=real,dc=example,dc=com <= check a_dn_pat: uid=plainmodify,cn=plain,cn=auth,dc=real,dc=example,dc=com <= check a_dn_pat: anonymous <= acl_mask: [4] applying auth(=xd) (stop) <= acl_mask: [4] mask: auth(=xd) => slap_access_allowed: auth access granted by auth(=xd) => access_allowed: auth access granted by auth(=xd) conn=1 op=1 BIND dn="uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com" mech=SIMPLE ssf=0 do_bind: v3 bind: "uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com" to "uid=plainproxy,cn=plain,cn=auth,dc=real,dc=example,dc=com" send_ldap_result: conn=1 op=1 p=3 send_ldap_result: err=0 matched="" text="" send_ldap_response: msgid=2 tag=97 err=0 ber_flush2: 22 bytes to sd 33 0000: 30 84 00 00 00 10 02 01 02 61 84 00 00 00 07 0a 0........a...... 0010: 01 00 04 00 04 00 ...... tls_write: want=101, written=101 0000: 17 03 02 00 60 3e 98 2a 48 b2 d9 ae 12 70 ab db ....`>.*H....p.. 0010: 5e 46 c2 ef 7f c3 32 72 d4 41 ef 4d 58 07 d0 50 ^F.... 2r.A.MX..P 0020: 53 a2 da 54 69 d7 1c 61 ed a7 ce 53 14 16 46 73 S..Ti..a...S..Fs 0030: 91 74 c4 92 9e 35 24 84 ce 8c 6f 18 18 6a 68 0a .t... 5$...o..jh. 0040: b0 69 70 75 0d 6a 5d fa 02 38 89 e9 d7 99 c9 99 .ipu.j].. 8...... 0050: bb 7b be 62 5d 50 91 2f a9 a2 6e d5 88 47 f8 ed .{.b] P./..n..G.. 0060: 5e 3c a7 dd 17 ^<... ldap_write: want=22, written=22 0000: 30 84 00 00 00 10 02 01 02 61 84 00 00 00 07 0a 0........a...... 0010: 01 00 04 00 04 00 ...... daemon: activity on 1 descriptor daemon: activity on: 33r daemon: read active on 33 daemon: epoll: listen=7 active_threads=0 tvp=zero daemon: epoll: listen=8 active_threads=0 tvp=zero daemon: epoll: listen=9 active_threads=0 tvp=zero daemon: epoll: listen=10 active_threads=0 tvp=zero daemon: epoll: listen=11 active_threads=0 tvp=zero connection_get(33) connection_get(33): got connid=1 connection_read(33): checking for input on id=1 ber_get_next tls_read: want=5, got=5 0000: 17 03 02 00 c0 ..... tls_read: want=192, got=192 0000: 60 a2 1b 5e 6f 13 18 52 f1 86 c7 b5 ff ae ec bf `..^o..R........ 0010: 7e 7f 65 19 30 c0 4a 3a 7d de 76 77 5b bf 0b dc ~.e. 0.J:}.vw[... 0020: 22 15 34 f9 5b dd 2d 8f f5 19 e3 25 0d 25 a8 b6 ".4. [.-....%.%.. 0030: 07 34 75 a5 08 c6 3e c2 8e 18 58 11 ee 5d 25 7c . 4u...>...X..]%| 0040: 00 9b fb 14 a4 9c 7d c1 37 bf 92 f7 ee ef 04 94 ......}. 7....... 0050: 81 a8 98 d8 eb 5b 80 0f ce 7d 21 3c 24 fa ba ca ..... [...}!<$... 0060: 3f 9a 94 ef dd 7f 47 17 e0 f2 cb 08 04 a5 25 a3 ?.....G.......%. 0070: f0 3e 92 a4 75 a2 6e d3 34 1a 82 29 7b 9f b0 07 .>..u.n. 4..){... 0080: fd 4e 5f 1e 8f f2 55 33 c5 eb 5f 34 a1 f6 3d 0a .N_...U3.._4..=. 0090: c3 e7 4f 4a 77 85 a5 1e 40 f8 d4 60 8e bd 08 8c ..OJw...@..`.... 00a0: 8e 87 7d 93 50 11 da c1 ea b0 e1 74 60 34 ad b8 ..}.P......t`4.. 00b0: c0 9a f3 66 44 3c e5 bf 6e b1 4f 4f f8 51 18 df ...fD<..n.OO.Q.. ldap_read: want=8, got=8 0000: 30 53 02 01 03 63 4e 04 0S...cN. ldap_read: want=77, got=77 0000: 2e 63 6e 3d 70 6c 61 69 6e 2c 63 6e 3d 61 75 74 .cn=plain,cn=aut 0010: 68 2c 64 63 3d 76 65 72 69 6f 2c 64 63 3d 61 6e h,dc=relay,dc=ex 0020: 6f 6e 79 6d 69 7a 65 72 2c 64 63 3d 63 6f 6d 0a ample ,dc=com. 0030: 01 01 0a 01 00 02 01 01 02 01 00 01 01 00 a3 0b ................ 0040: 04 03 75 69 64 04 04 72 6f 6f 74 30 00 ..uid..root0. ber_get_next: tag 0x30 len 83 contents: ber_dump: buf=0x2a0d1d0 ptr=0x2a0d1d0 end=0x2a0d223 len=83 0000: 02 01 03 63 4e 04 2e 63 6e 3d 70 6c 61 69 6e 2c ...cN..cn=plain, 0010: 63 6e 3d 61 75 74 68 2c 64 63 3d 76 65 72 69 6f cn=auth,dc=relay 0020: 2c 64 63 3d 61 6e 6f 6e 79 6d 69 7a 65 72 2c 64 ,dc=example,dc=com 0030: 63 3d 63 6f 6d 0a 01 01 0a 01 00 02 01 01 02 01 ........... 0040: 00 01 01 00 a3 0b 04 03 75 69 64 04 04 72 6f 6f ........uid..roo 0050: 74 30 00 t0. op tag 0x63, time 1255629604 connection_input: conn=1 deferring operation: binding ber_get_next tls_read: want=5 error=Resource temporarily unavailable ldap_read: want=8, got=0 daemon: activity on 1 descriptor daemon: activity on: daemon: epoll: listen=7 active_threads=0 tvp=zero daemon: epoll: listen=8 active_threads=0 tvp=zero daemon: epoll: listen=9 active_threads=0 tvp=zero daemon: epoll: listen=10 active_threads=0 tvp=zero daemon: epoll: listen=11 active_threads=0 tvp=zero Segmentation fault <--------- HERE IT IS Again, this was just the initial sync-up. Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

I can - I just wish it wasn't a segfault for no reason. I was not doing any "write testing" at the time of the crash, so I have no idea what will trigger it. Nevertheless, I'll put slapd into trace mode and watch the logs, and will post anything of importance. Thanks again, Jeff On Oct 15, 2009, at 10:49 , Quanah Gibson-Mount wrote: > --On Thursday, October 15, 2009 5:43 PM +0000 j(a)telepaths.org wrote: > >> OK, problems: >> >> slapd just crashed for no apparent reason. >> >> slapd[8131]: segfault at 433e8a00 ip 433e8a00 sp 433e89a8 error 15 >> >> Not good. What version of slapd should I be using to guarantee: >> >> * No deadlocks >> * No replication errors >> * No SEGFAULTS >> >> It just seems like one buggy slapd release after another. Never >> happened with 2.3 releases ..... > > I assume you have core dumps enabled, and built OpenLDAP with > debugging symbols, and can provide the full backtrace of the > generated core? > > --Quanah > > > > -- > > Quanah Gibson-Mount > Principal Software Engineer > Zimbra, Inc > -------------------- > Zimbra :: the leader in open source messaging and collaboration

1 0

hang during ldapmodify?
by Mark Dieterich 15 Oct '09

15 Oct '09

Hi all, I'm not sure if this is a bug or we are doing something wrong. For quite some time now, we have been using ldap to provide group information for our linux/unix desktop machines. I believer there are multiple methods of providing group access, this is the format we are using: # foobar, group, cs.brown.edu dn: cn=foobar,ou=group,dc=cs,dc=brown,dc=edu objectClass: posixGroup objectClass: top cn: ugrad gidNumber: 1200 memberUid: t1 memberUid: t2 memberUid: t3 memberUid: t4 memberUid: t5 . . . Up until recently, this had been working great. We are now experiencing hangs whenever we try to update the records with one particular group. I think the hangs are occur when we try to feed too much data to ldapmodify at a time. For instance, if I have the above group and try to apply the following ldif file: dn: cn=foobar,ou=group,dc=cs,dc=brown,dc=edu changetype: modify replace: memberUid memberUid: t1 memberUid: t2 memberUid: t3 memberUid: t4 memberUid: t5 memberUid: t6 memberUid: t7 memberUid: t8 memberUid: t9 . . . memberUid: t2477 memberUid: t2478 memberUid: t2479 The update simply hangs. Tossing a "-d 65535" shows that the process is sitting in loop spitting out messages similar to: ldap_int_select ldap_result ld 0x1e72bf0 msgid 5 wait4msg ld 0x1e72bf0 msgid 5 (timeout 100000 usec) wait4msg continue ld 0x1e72bf0 msgid 5 all 1 ** ld 0x1e72bf0 Connections: * host: ldapmaster.cs.brown.edu port: 6360 (default) refcnt: 2 status: Connected last used: Thu Oct 15 10:27:45 2009 ** ld 0x1e72bf0 Outstanding Requests: * msgid 5, origid 5, status InProgress outstanding referrals 0, parent count 0 ld 0x1e72bf0 request count 1 (abandoned 0) ** ld 0x1e72bf0 Response Queue: Empty ld 0x1e72bf0 response count 0 ldap_chkResponseList ld 0x1e72bf0 msgid 5 all 1 ldap_chkResponseList returns ld 0x1e72bf0 NULL ldap_int_select Hopefully, this means something more to someone on this list than it does to me;) Interestingly, if I drop the last entry and change the ldif file to be: dn: cn=foobar,ou=group,dc=cs,dc=brown,dc=edu changetype: modify replace: memberUid memberUid: t1 memberUid: t2 memberUid: t3 memberUid: t4 memberUid: t5 memberUid: t6 memberUid: t7 memberUid: t8 memberUid: t9 . . . memberUid: t2476 memberUid: t2477 memberUid: t2478 Then the update proceeds. However, if I change the last entry to read: memberUid: t2478000 Then it hangs again. Whereas with the last entry of memberUid: t247800 it updates just fine. This smells of some buffer filling or something else similar. We are running with debian's lenny version of openldap, version 2.4.11-1 (not sure what's different about the "-1" version). Other details which may be pertinent: - we are running back_bdb - syncprov - GSSAPI authentication I have not tried setting up a test server running 2.4.16/19, but did spend time looking through the chnage logs and bug system and didn't see anything that appeared to apply. However, I certainly could have missed something. Any help would be most appreciated, as we currently have one group which we are no longer able to add any entries to. Thanks! Mark

2 1

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by quanah＠zimbra.com 15 Oct '09

15 Oct '09

--On Thursday, October 15, 2009 5:43 PM +0000 j(a)telepaths.org wrote: > OK, problems: > > slapd just crashed for no apparent reason. > > slapd[8131]: segfault at 433e8a00 ip 433e8a00 sp 433e89a8 error 15 > > Not good. What version of slapd should I be using to guarantee: > > * No deadlocks > * No replication errors > * No SEGFAULTS > > It just seems like one buggy slapd release after another. Never > happened with 2.3 releases ..... I assume you have core dumps enabled, and built OpenLDAP with debugging symbols, and can provide the full backtrace of the generated core? --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

OK, problems: slapd just crashed for no apparent reason. slapd[8131]: segfault at 433e8a00 ip 433e8a00 sp 433e89a8 error 15 Not good. What version of slapd should I be using to guarantee: * No deadlocks * No replication errors * No SEGFAULTS It just seems like one buggy slapd release after another. Never happened with 2.3 releases ..... Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

My apologies On Oct 15, 2009, at 10:26 , Quanah Gibson-Mount wrote: > --On Thursday, October 15, 2009 10:19 AM -0700 Jeff Doyle <j(a)telepaths.org > > wrote: > >> Thank you Gibson, my checkpoints (both definitions) have not changed >> since you last asked, but the fact that it can help with shutdown >> times >> is a very useful tip, thanks! >> >> Jeff > > Just to note, my first name is "Quanah", not "Gibson". "Gibson- > Mount" is my last name. > > Which is why I sign my emails thusly: > > --Quanah > > -- > > Quanah Gibson-Mount > Principal Software Engineer > Zimbra, Inc > -------------------- > Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by quanah＠zimbra.com 15 Oct '09

15 Oct '09

--On Thursday, October 15, 2009 10:19 AM -0700 Jeff Doyle <j(a)telepaths.org> wrote: > Thank you Gibson, my checkpoints (both definitions) have not changed > since you last asked, but the fact that it can help with shutdown times > is a very useful tip, thanks! > > Jeff Just to note, my first name is "Quanah", not "Gibson". "Gibson-Mount" is my last name. Which is why I sign my emails thusly: --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

Thank you Gibson, my checkpoints (both definitions) have not changed since you last asked, but the fact that it can help with shutdown times is a very useful tip, thanks! Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by quanah＠zimbra.com 15 Oct '09

15 Oct '09

--On Thursday, October 15, 2009 4:50 PM +0000 j(a)telepaths.org wrote: > OK, I believe the dead-lock issue is solved, however OCCASIONALLY when > attempting a restart or stop of the slapd process, it throws an error > saying 'slapd stop failed', however the slapd process does quit as > expected, so its a "false failure". > > The one possibility for the reason this is happening, aside from > blaming slapd, is that my two test boxes are VMs ... so I kind of > expect sluggish responses, especially on a VMware server as busy as > ours. I will note that our production LDAP servers are NOT VMs and > will never be ;-) > > I believe you were correct, Pierangelo. I will post my findings over > the next fews days to keep everyone in the loop. Probably the issue. Make sure you have checkpoints defined for all bdb/hdb databases as well, which will help with shutdown times. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

OK, I believe the dead-lock issue is solved, however OCCASIONALLY when attempting a restart or stop of the slapd process, it throws an error saying 'slapd stop failed', however the slapd process does quit as expected, so its a "false failure". The one possibility for the reason this is happening, aside from blaming slapd, is that my two test boxes are VMs ... so I kind of expect sluggish responses, especially on a VMware server as busy as ours. I will note that our production LDAP servers are NOT VMs and will never be ;-) I believe you were correct, Pierangelo. I will post my findings over the next fews days to keep everyone in the loop. Thanks, Jeff

1 0

Re: (ITS#6330) slapd memory leak
by whm＠stanford.edu 15 Oct '09

15 Oct '09

> Apparently, accessing that URL requires a valid account. In any case, you > should run slapd under valgrind for a while, in order to locate the leak. Sorry about that. The URL should be accessible now. I will start the valgrind work a bit later this morning on the left coast. Bill -- Bill MacAllister, System Software Programmer Unix Systems Group, Stanford University

1 0

Re: (ITS#6329) memberof overlay doesn't update entryCSN
by msmith＠cbnco.com 15 Oct '09

15 Oct '09

On Wed, 14 Oct 2009, masarati(a)aero.polimi.it wrote: > Should be fixed in HEAD (one-line fix, see overlays/memberof.c 1.25 -> 1.26). > > Please test. Thanks, p. Thanks - I applied this to openldap 2.4.19 and the entryCSNs now match on all nodes, as long as they're all up when a group is modified. I still get something strange if one node is down: if I remove a user from a group on the working node, then bring the failed node back, the failed node doesn't sync the modified group and user objects. For example, if I remove testuser3 from testgroup2 while node 2 is down, then bring node 2 back, I get this on node 1: dn: uid=testuser3,ou=people,dc=dom memberOf: cn=testgroup1,ou=group,dc=dom entryCSN: 20091015040419.455869Z#000000#001#000000 dn: cn=testgroup2,ou=group,dc=dom member: uid=testuser2,ou=people,dc=dom entryCSN: 20091015040419.455869Z#000000#001#000000 And this on node 2: dn: uid=testuser3,ou=people,dc=dom memberOf: cn=testgroup2,ou=group,dc=dom memberOf: cn=testgroup1,ou=group,dc=dom entryCSN: 20091015033445.046089Z#000000#002#000000 dn: cn=testgroup2,ou=group,dc=dom member: uid=testuser2,ou=people,dc=dom member: uid=testuser3,ou=people,dc=dom entryCSN: 20091015033233.354687Z#000000#001#000000 I don't have this problem with changes that don't involve member/memberOf attributes. For example, I can add a description attr to the group object while node 2 is down, and when I bring it back up, it picks up the change. On both nodes I've got the memberof and syncprov overlays turned on, in that order. dn: olcOverlay={0}memberof,olcDatabase={1}hdb,cn=config objectClass: olcOverlayConfig olcOverlay: {0}memberof dn: olcOverlay={1}syncprov,olcDatabase={1}hdb,cn=config objectClass: olcSyncProvConfig olcSpCheckpoint: 100 10 olcSpSessionlog: 1000 olcOverlay: {1}syncprov Thanks, Mike

1 0

Re: (ITS#6320)
by j＠telepaths.org 15 Oct '09

15 Oct '09

OK, for anyone following this thread, please refer to ITS #6331, as I believe this issue may not be a "replication issue" at all, rather a deadlock PREVENTING replication. Might as well close this ticket, thanks for everyone's help. Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 15 Oct '09

15 Oct '09

OK, I was able to compile a set of Debian packages for version 2.4.19 using the source obtained from openldap.org. I have set up a mirror of our production environment (less a few servers). I have two provider servers in mirrormode, and configured for multimaster syncrepl. So far, no locks, no replication issues, everything seems peachy. Though, in real-life, the problem has a tendency to reappear sometimes a week after a slapd-restart. We'll see what happens. I will continue to update this ticket, detailing any further developments. Thanks again Pierangelo and Gibson, I appreciate your help. Jeff

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 14 Oct '09

14 Oct '09

Thanks for responding, Pierangelo. I am asking (begging) my chief engineer to entertain this idea. Will report back ASAP. Thanks, Jeff On Oct 14, 2009, at 11:52 AM, masarati(a)aero.polimi.it wrote: >> Version: 2.4.17 > >> Occasionally, I will find one of my servers (running Debian/Lenny >> with >> back-ported slapd version 2.4.17) in a state where the following >> occurs: >> >> * Write operations will 'freeze' - leaving the requester at a frozen >> prompt or >> frozen LDAP-client of some kind (from wherever the write-operation >> originated). >> * slapd refuses to 'stop', even though it indicates that its >> waiting for >> "0" >> processes to complete. >> * Logs do not indicate a segfault nor any poorly terminated >> processes. >> * Read operations on same server continue to function normally. >> Any data >> that >> existed before the "freeze" is returned as it should be. > > You probably hit ITS#6276, which was fixed in 2.4.18. Can you > upgrade and > test? > > p. >

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by masarati＠aero.polimi.it 14 Oct '09

14 Oct '09

> Version: 2.4.17 > Occasionally, I will find one of my servers (running Debian/Lenny with > back-ported slapd version 2.4.17) in a state where the following occurs: > > * Write operations will 'freeze' - leaving the requester at a frozen > prompt or > frozen LDAP-client of some kind (from wherever the write-operation > originated). > * slapd refuses to 'stop', even though it indicates that its waiting for > "0" > processes to complete. > * Logs do not indicate a segfault nor any poorly terminated processes. > * Read operations on same server continue to function normally. Any data > that > existed before the "freeze" is returned as it should be. You probably hit ITS#6276, which was fixed in 2.4.18. Can you upgrade and test? p.

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 14 Oct '09

14 Oct '09

Quanah, Thanks for responding. Here are the answers to your questions: ldd /usr/sbin/slapd linux-vdso.so.1 => (0x00007fff4f1ff000) libldap_r-2.4.so.2 => /usr/lib/libldap_r-2.4.so.2 (0x00007f2646c5e000) liblber-2.4.so.2 => /usr/lib/liblber-2.4.so.2 (0x00007f2646a4f000) libdb-4.6.so => /usr/lib/libdb-4.6.so (0x00007f2646705000) libodbc.so.1 => /usr/lib/libodbc.so.1 (0x00007f26464a9000) libslp.so.1 => /usr/lib/libslp.so.1 (0x00007f2646297000) libsasl2.so.2 => /usr/lib/libsasl2.so.2 (0x00007f264607d000) libgnutls.so.26 => /usr/lib/libgnutls.so.26 (0x00007f2645dcb000) libcrypt.so.1 => /lib/libcrypt.so.1 (0x00007f2645b93000) libresolv.so.2 => /lib/libresolv.so.2 (0x00007f264597f000) libltdl.so.3 => /usr/lib/libltdl.so.3 (0x00007f2645778000) libwrap.so.0 => /lib/libwrap.so.0 (0x00007f264556f000) libpthread.so.0 => /lib/libpthread.so.0 (0x00007f2645353000) libc.so.6 => /lib/libc.so.6 (0x00007f2645000000) libnsl.so.1 => /lib/libnsl.so.1 (0x00007f2644de8000) libdl.so.2 => /lib/libdl.so.2 (0x00007f2644be4000) libtasn1.so.3 => /usr/lib/libtasn1.so.3 (0x00007f26449d4000) libgpg-error.so.0 => /usr/lib/libgpg-error.so.0 (0x00007f2646fb5000) libz.so.1 => /usr/lib/libz.so.1 (0x00007f26447bd000) libgcrypt.so.11 => /usr/lib/libgcrypt.so.11 (0x00007f2644556000) /lib64/ld-linux-x86-64.so.2 (0x00007f2646ea9000) From slapd.conf: tool-threads 4 # this has varied between 1 and 4 syncprov-checkpoint 1 5 # we've tried using the default settings, very lax settings, etc - never made a difference. checkpoint 10 1 # checkpointing for Berkeley And the rest of the Berkeley settings in our DIT suffix area: database hdb cachesize 10000 idlcachesize 30000 checksum cachefree 20 dncachesize 100000 dbconfig set_cachesize 1 0 2 dbconfig set_lg_max 10485760 dbconfig set_flags db_log_autoremove dbconfig set_lg_bsize 2097152 dbconfig set_lk_max_objects 5500 dbconfig set_lk_max_locks 5500 dbconfig set_lk_max_lockers 5500 The version of BDB is as fully-patched as Debian keeps up with it. We (as a company) stay on top of updates, while Debian only tends to fix security bugs and pretty much will ignore feature issues and lack- luster functionality in their packages. They do this religiously, which is shameful. Thanks again, Jeff

1 0

Re: (ITS#6329) memberof overlay doesn't update entryCSN
by masarati＠aero.polimi.it 14 Oct '09

14 Oct '09

> It looks like the memberof overlay doesn't update a user object's entryCSN > when > a group object is changed. I believe this causes trouble with syncrepl, at > least > in a multi-master configuration: if one node is down when the group object > is > changed, it won't know it needs to update the user object when it comes > back. Should be fixed in HEAD (one-line fix, see overlays/memberof.c 1.25 -> 1.26). Please test. Thanks, p.

1 0

Re: (ITS#6330) slapd memory leak
by masarati＠aero.polimi.it 14 Oct '09

14 Oct '09

> We have observed what we believe to be a memory leak in OpenLDAP 2.4.18 in > testing > while dynlist support. We have a script that randomly expands the member > lists > > of groups defined using dynlist. Running this script for a period of > about 24 > hours forces the slapd process to swap. > > It is not clear at all that dynlist is the problem because we were not > able to > see the problem with our test script until we surrounded each query with a > bind/unbind. (At least we didn't wait long enough to see it.) All > queries > perform GSSAPI binds to the directory. The problem is unaffected by using > either the MIT or Heimdal GSSAPI libraries. > > Our build of OpenLDAP 2.4.18 follows the debian configuration with the > exceptions: > * Patch for ITS6287 > * Patch for ITS6308 > * Patch to the index slots > * disable support for tcp_wrappers and disable rlookups > > The details of software versions, build options, slapd configuration, > scripts, > db_stat output and testing procedures are at > http://www.stanford.edu/~whm/files/slapd/readme.html. Apparently, accessing that URL requires a valid account. In any case, you should run slapd under valgrind for a while, in order to locate the leak. p.

1 0

Re: (ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by quanah＠zimbra.com 14 Oct '09

14 Oct '09

--On Wednesday, October 14, 2009 1:11 AM +0000 j(a)telepaths.org wrote: > Full_Name: Jeff Doyle > Version: 2.4.17 > OS: Debian/Lenny > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (130.94.106.251) > > > Greetings, > > Occasionally, I will find one of my servers (running Debian/Lenny with > back-ported slapd version 2.4.17) in a state where the following occurs: > > * Write operations will 'freeze' - leaving the requester at a frozen > prompt or frozen LDAP-client of some kind (from wherever the > write-operation originated). * slapd refuses to 'stop', even though it > indicates that its waiting for "0" processes to complete. > * Logs do not indicate a segfault nor any poorly terminated processes. > * Read operations on same server continue to function normally. Any > data that existed before the "freeze" is returned as it should be. > > Modules used: > > * accesslog > * back_hdb > * back_monitor > * back_relay > * back_rwm > * syncprov > > Servers are all fairly new, and reasonably beefy for their purposes: > > * 6GB RAM > * 2+ GHz CPU, all QuadCore Xeon and all running amd64 kernel (current > with Lenny) > * Plenty of Disk Space (gigs and gigs) > * Servers are SLEEPING (0.00 avg load) > > slapd is making use of 'tool-threads' with a value of '4' - however > changing this value has had no effect - Just a side note. tool threads only affects offline operations (slapadd). How many threads do you have configured? What version of BDB is slapd linked against? Is the bdb version fully patched? What is your checkpoint directive set to in both the accesslog and hdb databases? --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

(ITS#6332)
by l.mierzwa＠gmail.com 14 Oct '09

14 Oct '09

--0016e6d7df78582bd90475e3ecd0 Content-Type: text/plain; charset=ISO-8859-1 > but when I add member attribute I mean: when I add it to ldif, so it looks like: dn: cn=shell,ou=access,<basedn> changetype: modify replace: objectClass objectClass: groupOfNames objectClass: top - replace: cn cn: shell - replace: description description: blablabla - replace: member member: uid=user1[...] member: uid=user2[...] member: uid=user3[...] --0016e6d7df78582bd90475e3ecd0 Content-Type: text/html; charset=ISO-8859-1 > but when I add member attribute I mean: when I add it to ldif, so it looks like: dn: cn=shell,ou=access,<basedn> changetype: modify replace: objectClass objectClass: groupOfNames objectClass: top - replace: cn cn: shell - replace: description description: blablabla - replace: member member: uid=user1[...] member: uid=user2[...] member: uid=user3[...] --0016e6d7df78582bd90475e3ecd0--

1 0

(ITS#6332) replication issues
by lmierzwa＠gmail.com 14 Oct '09

14 Oct '09

Full_Name: £ukasz Mierzwa Version: 2.4.18/19 OS: Linux / Freebsd URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (85.232.239.146) I'm using syncrepl with this config on master overlay syncprov syncprov-checkpoint 100 10 syncprov-sessionlog 100 and on slaves syncrepl rid=100 provider=ldap://ldap-master type=refreshOnly interval=00:00:01:00 retry="60 +" searchbase="<base>" filter="(objectClass=*)" scope=sub schemachecking=off bindmethod=sasl saslmech=DIGEST-MD5 authcid="<replicator login>" credentials="<pass>" starttls=yes I modify data on master using ldapmodify with this ldif: dn: cn=shell,ou=access,<basedn> changetype: modify replace: objectClass objectClass: groupOfNames objectClass: top - replace: cn cn: shell - replace: description description: blablabla note that only description is getting new value, cn and objectClass are being set to the same value as before modification and everything works, slaves are getting changed data, but when I add member attribute (which also is set to the same value as it was) slaves are not seeing any change, logs on slaves are only showing "do_syncrep2: rid=100 LDAP_RES_SEARCH_RESULT" Master is ubuntu 9.04 with openldap 2.4.15 + I tested 2.4.18 from 9.10, same result. Slaves are ubuntu 9.04 (2.4.15 and 2.4.18) and Freebsd 7.0 (2.4.19)

1 0

Re: (ITS#6251) GnuTLS cipher suite failure
by kent＠cpttm.org.mo 14 Oct '09

14 Oct '09

Hi, I am having this issue, but setting the cipher suite to +RSA:+AES-256-CBC:+SHA1 doesn't fix the problem. slapd.conf: TLSCipherSuite +RSA:+AES-256-CBC:+SHA1 TLSCACertificateFile /etc/ldap/ssl/cacert.pem TLSCertificateFile /etc/ldap/ssl/cert.pem TLSCertificateKeyFile /etc/ldap/ssl/key.pem Debug log of slapd: tchingRuleUse: ... supportedFeatures $ supportedApplicationContext ) ) TLS: could not set cipher list +RSA:+AES-256-CBC:+SHA1. main: TLS init def ctx failed: -1 slapd destroy: freeing system resources. slapd stopped. Output of "gnutls-cli -l": ... TLS_RSA_EXPORT_ARCFOUR_40_MD5 0x00, 0x03 SSL 3.0 TLS_RSA_ARCFOUR_SHA1 0x00, 0x05 SSL 3.0 TLS_RSA_ARCFOUR_MD5 0x00, 0x04 SSL 3.0 TLS_RSA_3DES_EDE_CBC_SHA1 0x00, 0x0a SSL 3.0 TLS_RSA_AES_128_CBC_SHA1 0x00, 0x2f SSL 3.0 TLS_RSA_AES_256_CBC_SHA1 0x00, 0x35 SSL 3.0 Certificate types: X.509, OPENPGP Protocols: SSL 3.0, TLS 1.0, TLS 1.1, TLS 1.2 Ciphers: AES 256 CBC, AES 128 CBC, 3DES 168 CBC, DES CBC, ARCFOUR 128, ARCFOUR 4 0, RC2 40, NULL MACs: SHA, MD5, SHA256, SHA384, SHA512, MD2, RIPEMD160, NULL Key exchange algorithms: Anon DH, RSA, RSA EXPORT, DHE RSA, DHE DSS, SRP DSS, SR P RSA, SRP, PSK, DHE PSK Compression: LZO, DEFLATE, NULL -- Kent Tong SME accounting software package for just MOP30. See http://www.cpttm.org.mo/index_c.php?pg=cpttm/department/is/ispu/accsys/inde… for more.

1 0

(ITS#6331) slapd freezing, not accepting further 'write' operations while 'read' operations are unaffected
by j＠telepaths.org 14 Oct '09

14 Oct '09

Full_Name: Jeff Doyle Version: 2.4.17 OS: Debian/Lenny URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (130.94.106.251) Greetings, Occasionally, I will find one of my servers (running Debian/Lenny with back-ported slapd version 2.4.17) in a state where the following occurs: * Write operations will 'freeze' - leaving the requester at a frozen prompt or frozen LDAP-client of some kind (from wherever the write-operation originated). * slapd refuses to 'stop', even though it indicates that its waiting for "0" processes to complete. * Logs do not indicate a segfault nor any poorly terminated processes. * Read operations on same server continue to function normally. Any data that existed before the "freeze" is returned as it should be. Modules used: * accesslog * back_hdb * back_monitor * back_relay * back_rwm * syncprov Servers are all fairly new, and reasonably beefy for their purposes: * 6GB RAM * 2+ GHz CPU, all QuadCore Xeon and all running amd64 kernel (current with Lenny) * Plenty of Disk Space (gigs and gigs) * Servers are SLEEPING (0.00 avg load) slapd is making use of 'tool-threads' with a value of '4' - however changing this value has had no effect - Just a side note. Inform me of any further configs and/or information that you need, and I will provide it promptly. Thanks, Jeff

1 0

(ITS#6330) slapd memory leak
by whm＠stanford.edu 14 Oct '09

14 Oct '09

Full_Name: Bill MacAllister Version: 2.4.18 OS: Debian 5.0 URL: http://www.stanford.edu/~whm/files/slapd/readme.html Submission from: (NULL) (75.26.167.150) We have observed what we believe to be a memory leak in OpenLDAP 2.4.18 in testing while dynlist support. We have a script that randomly expands the member lists of groups defined using dynlist. Running this script for a period of about 24 hours forces the slapd process to swap. It is not clear at all that dynlist is the problem because we were not able to see the problem with our test script until we surrounded each query with a bind/unbind. (At least we didn't wait long enough to see it.) All queries perform GSSAPI binds to the directory. The problem is unaffected by using either the MIT or Heimdal GSSAPI libraries. Our build of OpenLDAP 2.4.18 follows the debian configuration with the exceptions: * Patch for ITS6287 * Patch for ITS6308 * Patch to the index slots * disable support for tcp_wrappers and disable rlookups The details of software versions, build options, slapd configuration, scripts, db_stat output and testing procedures are at http://www.stanford.edu/~whm/files/slapd/readme.html.

1 0

(ITS#6329) memberof overlay doesn't update entryCSN
by msmith＠cbnco.com 13 Oct '09

13 Oct '09

Full_Name: Michael Smith Version: 2.4.18-55.1 OS: SLES11 (SUSE) URL: Submission from: (NULL) (207.164.182.8) Hi, It looks like the memberof overlay doesn't update a user object's entryCSN when a group object is changed. I believe this causes trouble with syncrepl, at least in a multi-master configuration: if one node is down when the group object is changed, it won't know it needs to update the user object when it comes back. I'm a little confused because while the entryCSNs don't change on the server where the group is updated, they do change on the other servers in the replication group. For example, if I add a user to a group on node 2, the user's entryCSN on node 2 might be "20091008032402.932100Z#000000#002#000000": old timestamp, correct server ID. On node 1 the entryCSN might be "20091008032142.915412Z#000000#002#000000": current timestamp, correct server ID. I'm using syncrepl with refreshAndPersist and syncprov. The memberof overlay is using its default configuration. In the stacking order, memberof comes before syncprov, but it behaved the same way in both orders. All nodes are configured with memberof and syncprov. The servers' clocks are in sync (NTP). There was a thread on openldap-software here: http://thread.gmane.org/gmane.network.openldap.general/45790/focus=45808 This is what my configuration looks like on node 1: dn: cn=config # ... olcServerID: 1 dn: olcDatabase={1}hdb,cn=config # ... olcAccess: {0}to attrs=userPassword by self write by dn.subtree="ou=service,dc=dom" read by * auth olcAccess: {1}to attrs=shadowLastChange by self write by * read olcAccess: {2}to attrs=userPKCS12 by self read by * none olcAccess: {3}to * by * read olcDbIndex: objectclass eq olcDbIndex: entryUUID eq olcDbIndex: entryCSN eq olcLimits: {0}dn.subtree="ou=service,dc=dom" time.soft=unlimited time.hard=unlimited size.soft=unlimited size.hard=unlimited olcSyncrepl: {0}rid=002 provider=ldap://ldap2.dom binddn="cn=repluser,ou=service,dc=dom" bindmethod=simple credentials=xxxxxx searchbase="dc=dom" attrs="*,+" type=refreshAndPersist schemachecking=off tls_cacert=/etc/openldap/ssl/ca.crt tls_reqcert=demand interval=00:00:05:00 retry="60 +" olcMirrorMode: TRUE dn: olcOverlay={0}memberof,olcDatabase={1}hdb,cn=config objectClass: olcOverlayConfig olcOverlay: {1}memberof dn: olcOverlay={1}syncprov,olcDatabase={1}hdb,cn=config objectClass: olcSyncProvConfig olcSpCheckpoint: 100 10 olcSpSessionlog: 1000 olcOverlay: {0}syncprov Node 2 looks the same, but with olcServerID: 2 and provider=ldap://ldap1.dom. Thanks, Mike

1 0

Re: (ITS#6320)
by j＠telepaths.org 12 Oct '09

12 Oct '09

Just to clear up any confusion: * Issue is not resolved * Waiting for a response from you guys Please advise. Jeff

1 0

Re: (ITS#6328) Configure OpenLDAP with BO
by quanah＠zimbra.com 12 Oct '09

12 Oct '09

--On Monday, October 12, 2009 9:04 AM +0000 hervelam(a)hotmail.com wrote: > Full_Name: HervE > Version: 2.2.29 Usage questions need to go to openldap-software(a)openldap.org or openldap-technical(a)openldap.org. I would note you are using an ancient unsupported release as well. I'd advise moving to something newer. --Quanah -- Quanah Gibson-Mount Principal Software Engineer Zimbra, Inc -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

(ITS#6328) Configure OpenLDAP with BO
by hervelam＠hotmail.com 12 Oct '09

12 Oct '09

Full_Name: HervE Version: 2.2.29 OS: Windows XP URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (213.41.232.181) I am trying to configure BusinessObjects in order to use OpenLDAP with it. In the LDAP authentification menu in BO, I have to map all the following attributes with the appropriate tags: Mappings of LDAP server attributes Object class: Static Group: Member of static group: Dynamic Group: Dynamic Group Filter: Group description: User object Class: Username: Full name of the user: Email User: User Description: Default LDAP search attributes Default group research attribute: Default user research attribute: Can anyone help me please? Regards, HervE

1 0

Re: (ITS#6320)
by j＠telepaths.org 12 Oct '09

12 Oct '09

OpenLDAP ITS: OK the issue is looking more and more like buggy slapd behavior. I have now narrowed down the issue to an instance where slapd is partially "hung" and will not stop nor restart. This directly correlates to replication breaking because SLAPD is breaking: Oct 11 18:22:08 server1 slapd[10771]: <= bdb_equality_candidates: (uidNumber) not indexed Oct 11 18:22:08 server1 slapd[10771]: <= bdb_equality_candidates: (gidNumber) not indexed Oct 11 18:22:08 server1 slapd[10771]: <= bdb_equality_candidates: (uidNumber) not indexed Oct 11 18:46:41 server1 slapd[10771]: <= bdb_equality_candidates: (uidNumber) not indexed Oct 11 18:48:37 server1 slapd[10771]: <= bdb_equality_candidates: (uidNumber) not indexed Oct 11 18:49:05 server1 slapd[10771]: daemon: shutdown requested and initiated. Oct 11 18:49:05 server1 slapd[10771]: slapd shutdown: waiting for 0 operations/tasks to finish As you can see, the exact time when this occurs doesn't bring anything interesting to the logs. You can see the repeated string of index warnings (not an issue, just haven't indexed this attribute yet) followed by my attempt to restart slapd when I receive a notification indicating there is a replication discrepancy. I have grepped through all of my logs (dmesg, debug, syslog) for anything related to slapd. What you see above is the more interesting of the hits returned. PLEASE help -- the issue is getting more serious now, and by the evidence I've presented, is looking more and more out of my control. You've seen my config - can anyone think of why this would happen? It seems vaguely like a locking issue .... Thanks Jeff

1 0

Re: (ITS#6320)
by j＠telepaths.org 11 Oct '09

11 Oct '09

> FYI .... > > Before going to sleep last night, I left a persistent connection > open to an LDAP server: > > > SyncInfo Received > > SyncInfo Received > > SyncInfo Received > > SyncInfo Received > ldap_result: Can't contact LDAP server (-1) <-- > sometime during the night, the connection breaks. > This turned out to be the Kerberos credentials acquired for this test command had expired. Last night, I ran the same command via Simple Bind before going to sleep. The connection is still alive several hours later. This disproves the theory of firewall-induced timeouts for replication that is achieved outside the current local zone. Jeff

1 0

Re: (ITS#6320)
by j＠telepaths.org 10 Oct '09

10 Oct '09

FYI .... Before going to sleep last night, I left a persistent connection open to an LDAP server: SyncInfo Received SyncInfo Received SyncInfo Received SyncInfo Received ldap_result: Can't contact LDAP server (-1) <-- sometime during the night, the connection breaks.

1 0

Re: (ITS#6320)
by j＠telepaths.org 09 Oct '09

09 Oct '09

OK, since my last correspondence, things seemed to be going OK. All changes had been replicated perfectly until last night, I deleted one record, and it only deleted on 4 of 6 of my servers. I removed it manually from one of the other two 'offending' servers. The last one then deleted the record on its own. So it seems as though SyncRepl is highly flaky. I looked into the firewall timeout issue and determined that it is not the cause (if it were, this issue would be happening every 30 minutes (default firewall timeout for the LDAP service)). We're still using the accesslog DB for write-transactions. Jeff

1 0

Re: (ITS#6325) test054: test failed - producer and consumer databases differ
by michael＠stroeder.com 08 Oct '09

08 Oct '09

A syncrepl-related error also happened in test050. I also can not reproduce easily. test failed - server 1 and server 4 configs differ >>>>> ./scripts/test050-syncrepl-multimaster failed for bdb (exit 1) make[2]: *** [bdb-mod] Error 1 make[2]: Leaving directory `/usr/src/michael/openldap/HEAD/openldap/tests' make[1]: *** [test] Error 2 make[1]: Leaving directory `/usr/src/michael/openldap/HEAD/openldap/tests' make: *** [test] Error 2

1 0

Re: (ITS#6310) Slapd with pcache crashes under load
by masarati＠aero.polimi.it 07 Oct '09

07 Oct '09

> masarati(a)aero.polimi.it wrote: >> I didn't make any progress in debugging your issue, as I can't reproduce >> your issue using your configuration. What you see, namely some >> cacheability/answerability messages without a request could be related >> to >> pcache intercepting some internal operation, e.g. related to ACL >> checking? >> This could be intended or a mistake, but I can't tell so far. >> >> As a side note, your configuration seems to be triggering some issues in >> back-ldap. In detail, you set a rootdn, which is probably needed by >> slapo-pcache, but no rootpw. This is sort of confusing back-ldap. I'm >> investigating this a little bit further, although it might not be >> related >> to your issue. >> >> p. > Yes, I have set up rootdn because pcache overlay wanted it. I will set > also some rootpw to see if this makes difference. mmmh, sounds like a red herring, sorry for the noise. p.

1 0

Re: (ITS#6310) Slapd with pcache crashes under load
by karavelov＠spnet.net 07 Oct '09

07 Oct '09

masarati(a)aero.polimi.it wrote: > I didn't make any progress in debugging your issue, as I can't reproduce > your issue using your configuration. What you see, namely some > cacheability/answerability messages without a request could be related to > pcache intercepting some internal operation, e.g. related to ACL checking? > This could be intended or a mistake, but I can't tell so far. > > As a side note, your configuration seems to be triggering some issues in > back-ldap. In detail, you set a rootdn, which is probably needed by > slapo-pcache, but no rootpw. This is sort of confusing back-ldap. I'm > investigating this a little bit further, although it might not be related > to your issue. > > p. Yes, I have set up rootdn because pcache overlay wanted it. I will set also some rootpw to see if this makes difference. Luben

1 0

Re: (ITS#6310) Slapd with pcache crashes under load
by masarati＠aero.polimi.it 07 Oct '09

07 Oct '09

I didn't make any progress in debugging your issue, as I can't reproduce your issue using your configuration. What you see, namely some cacheability/answerability messages without a request could be related to pcache intercepting some internal operation, e.g. related to ACL checking? This could be intended or a mistake, but I can't tell so far. As a side note, your configuration seems to be triggering some issues in back-ldap. In detail, you set a rootdn, which is probably needed by slapo-pcache, but no rootpw. This is sort of confusing back-ldap. I'm investigating this a little bit further, although it might not be related to your issue. p.

1 0

(ITS#6326) back-ldap may leak when building entry with undef objectClass
by masarati＠aero.polimi.it 07 Oct '09

07 Oct '09

Full_Name: Pierangelo Masarati Version: HEAD/re24 OS: irrelevant URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (93.149.38.251) Submitted by: ando The name of the undef objectClass is copied, but never used, and the pointer is lost. A fix is coming... p.

1 0

Re: (ITS#6324) slapd -d ? emits incorrect value for LDAP_DEBUG_ANY on x86_64
by jwm＠horde.net 07 Oct '09

07 Oct '09

On Wed, Oct 07, 2009 at 08:02:53PM +0200, masarati(a)aero.polimi.it wrote: > Should be fixed now. Thanks. john -- John Morrissey _o /\ ---- __o jwm(a)horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__

1 0

Re: (ITS#6324) slapd -d ? emits incorrect value for LDAP_DEBUG_ANY on x86_64
by masarati＠aero.polimi.it 07 Oct '09

07 Oct '09

>> Please check the fix in HEAD. I can't check right now on x86_64, but >> I'll >> probably do it tomorrow. Apparently, I didn't break anything on 32 bit. > > 'slapd -d ?' still lists the 64-bit value for LDAP_DEBUG_ANY on x86_64: > > -- > Installed log subsystems: > > Any (18446744073709551615) > [...] > -- > > As I mentioned, this is due to the unsigned long format specifier (%lu) in > loglevel_print(). Changing the format specifier to %u emits the correct > value (4294967295) on this architecture. > > With your fix, slapd accepts the numeric value 4294967295 for > LDAP_DEBUG_ANY on x86_64. Should be fixed now. Also, please note the slightly changed behavior: the decimal *and* the hexadecimal value are both printed. This can be reversed if anyone fears it breaks anything. Thanks, p.

1 0

Re: (ITS#6310) Slapd with pcache crashes under load
by karavelov＠spnet.net 07 Oct '09

07 Oct '09

masarati(a)aero.polimi.it wrote: > No. Some overlay along the lines apparently mucks with e_private in the > entry that back-ldap is sending. It's probably slapo-pcache. I need to > debug this. You say it happens seldom. Can you recognize anything > special in the operation that triggers the assertion failure? I mean: > either in terms of special data, or in terms of special state of the > cache? This could help narrow down some means to reproduce the issue. > > Thanks, p. I have enabled full debugging info in the logs. So here are the last 1000 lines from the last abort: http://purgatory.spnet.net/~karavelov/abort/slapd.log.9004 I looked closely the generated core. Here is the gdb session: http://purgatory.spnet.net/~karavelov/abort/gdb.9004 Tell me if I could check some other variables that could help you identify the problem. Luben

1 0

Re: (ITS#6324) slapd -d ? emits incorrect value for LDAP_DEBUG_ANY on x86_64
by masarati＠aero.polimi.it 07 Oct '09

07 Oct '09

jwm(a)horde.net wrote: > On Tue, Oct 06, 2009 at 10:04:45PM +0200, masarati(a)aero.polimi.it wrote: >>> The 32-bit value 4294967295 for LDAP_DEBUG_ANY is also rejected. >>> lutil_atoix() declares i as type long and tries to check for overflow(?) >>> with this cast: >>> >>> if ( (long)(int)i != i ) { >>> >>> which always fails in this case on x86_64. lutil_atoux() might be the more >>> appropriate choice here. >>> >>> str2loglevel() seems to behave correctly by virtue of verb_to_mask() >>> returning an index into loglevel_ops, but I haven't checked extensively. >>> loglevel_init(), however, does specify a hardcoded -1 for the Any level >>> instead of LDAP_DEBUG_ANY. >> Please check the fix in HEAD. I can't check right now on x86_64, but I'll >> probably do it tomorrow. Apparently, I didn't break anything on 32 bit. > > 'slapd -d ?' still lists the 64-bit value for LDAP_DEBUG_ANY on x86_64: > > -- > Installed log subsystems: > > Any (18446744073709551615) > [...] > -- > > As I mentioned, this is due to the unsigned long format specifier (%lu) in > loglevel_print(). Changing the format specifier to %u emits the correct > value (4294967295) on this architecture. > > With your fix, slapd accepts the numeric value 4294967295 for > LDAP_DEBUG_ANY on x86_64. OK, I overlooked that. My point was to make sure unsigned values are correctly cast into (unsigned)-1 by routines intended to deal with integers. I'll fix that again. Thanks, p.

1 0

Re: (ITS#6324) slapd -d ? emits incorrect value for LDAP_DEBUG_ANY on x86_64
by jwm＠horde.net 07 Oct '09

07 Oct '09

On Tue, Oct 06, 2009 at 10:04:45PM +0200, masarati(a)aero.polimi.it wrote: > > The 32-bit value 4294967295 for LDAP_DEBUG_ANY is also rejected. > > lutil_atoix() declares i as type long and tries to check for overflow(?) > > with this cast: > > > > if ( (long)(int)i != i ) { > > > > which always fails in this case on x86_64. lutil_atoux() might be the more > > appropriate choice here. > > > > str2loglevel() seems to behave correctly by virtue of verb_to_mask() > > returning an index into loglevel_ops, but I haven't checked extensively. > > loglevel_init(), however, does specify a hardcoded -1 for the Any level > > instead of LDAP_DEBUG_ANY. > > Please check the fix in HEAD. I can't check right now on x86_64, but I'll > probably do it tomorrow. Apparently, I didn't break anything on 32 bit. 'slapd -d ?' still lists the 64-bit value for LDAP_DEBUG_ANY on x86_64: -- Installed log subsystems: Any (18446744073709551615) [...] -- As I mentioned, this is due to the unsigned long format specifier (%lu) in loglevel_print(). Changing the format specifier to %u emits the correct value (4294967295) on this architecture. With your fix, slapd accepts the numeric value 4294967295 for LDAP_DEBUG_ANY on x86_64. john -- John Morrissey _o /\ ---- __o jwm(a)horde.net _-< \_ / \ ---- < \, www.horde.net/ __(_)/_(_)________/ \_______(_) /_(_)__

1 0

Re: (ITS#6325) test054: test failed - producer and consumer databases differ
by michael＠stroeder.com 07 Oct '09

07 Oct '09

Download testrun/ here: http://www.stroeder.com/temp/openldap/its6325-test054-testrun.tar.gz

1 0

(ITS#6325) test054: test failed - producer and consumer databases differ
by michael＠stroeder.com 07 Oct '09

07 Oct '09

Full_Name: Michael Ströder Version: 2.4.19 OS: SLES 10 URL: Submission from: (NULL) (84.163.54.11) slapd built with BDB 4.8.24 and cyrus-sasl 2.4RC1 >>>>> Starting test054-syncreplication-parallel-load for hdb... running defines.sh Starting producer slapd on TCP/IP port 9011... Using ldapsearch to check that producer slapd is running... Using ldapadd to create the context prefix entry in the producer... Starting consumer slapd on TCP/IP port 9014... Using ldapsearch to check that consumer slapd is running... Using ldapadd to populate the producer directory... Waiting 7 seconds for syncrepl to receive changes... Stopping the provider, sleeping 10 seconds and restarting it... Using ldapsearch to check that producer slapd is running... Waiting 10 seconds to let the system catch up Using ldapmodify to modify producer directory... Using ldappasswd to change some passwords... Waiting 7 seconds for syncrepl to receive changes... Stopping consumer to test recovery... Modifying more entries on the producer... Restarting consumer... Waiting 7 seconds for syncrepl to receive changes... Try updating the consumer slapd... Trying to change some passwords on the consumer... Waiting 7 seconds for syncrepl to receive changes... Using ldapsearch to read all the entries from the producer... Using ldapsearch to read all the entries from the consumer... Filtering producer results... Filtering consumer results... Comparing retrieved entries from producer and consumer... test failed - producer and consumer databases differ >>>>> ./scripts/test054-syncreplication-parallel-load failed for hdb (exit 1) make[2]: *** [hdb-mod] Error 1 make[2]: Leaving directory `/source/openldap-2.4.19/tests' make[1]: *** [test] Error 2 make[1]: Leaving directory `/source/openldap-2.4.19/tests' make: *** [test] Error 2

1 0

slapd crash on load
by Ключников А.С. 07 Oct '09

07 Oct '09

Good day. Openldap 2.4.18 with bdb backend used for pam_ldap and nss_ldap on freebsd7.2 amd64 Crashed every 10 - 30 minutes on serches. Load isnt heavy, about 10 req/sec in peak and 20req/min average. Crash probability is higher when over program use the disk. how to mo debug to resolve problem? Some details: #uname -a FreeBSD bazar 7.2-RELEASE FreeBSD 7.2-RELEASE #3: Tue Jun 9 16:46:20 MSD 2009 root@bazar:/usr/obj/usr/src/sys/GENERIC amd64 #/usr/local/libexec/slapd -V @(#) $OpenLDAP: slapd 2.4.18 (Oct 7 2009 13:29:25) tuning in slapd.conf cachesize 150000 idlcachesize 450000 #checkpoint 64 10 threads 8 concurrency 5 tuning in /var/db/openldap-data/DB_CONFIG set_cachesize 0 62428800 0 set_lg_regionmax 1048576 set_lg_max 10485760 set_lg_bsize 2097152 set_lg_dir /var/db/openldap-data crash debug whith truss /usr/local/libexec/slapd -d -1 _umtx_op(0x8022020b0,0x11,0x0,0x0,0x0,0x0) = 0 (0x0) gidNumber_umtx_op(0x8022020b0,0x11,0x0,0x0,0x0,0x7ffffda79308) = 10 (0xa) getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) sendto(3,"<167>Oct 7 11:59:33 slapd[81516"...,91,0x0,NULL,0x0) = 91 (0x5b) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7ffffebfba28) = 0 (0x0) ber_scanf fmt ({im}) ber: write(2,"ber_scanf fmt ({im}) ber:\n",26) = 0 (0x0) ber_dump: buf=0x81141b408 ptr=0x81141b408 end=0x81141b414 len=12 gettimeofday({1254902373.820741 },0x0) = 65 (0x41) 0000: 30 84 00 00 00 06 02 02 03 e8 04 00 0........... write(2," 0000: 30 84 00 00 00 06 02 02"...,79) = 0 (0x0) <= get_ctrls: n=1 rc=0 err="" write(2,"<= get_ctrls: n=1 rc=0 err=""\n",30) = 30 (0x1e) getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) sendto(3,"<167>Oct 7 11:59:33 slapd[81516"...,106,0x0,NULL,0x0) = 106 (0x6a) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7fffff3fcaa8) = 0 (0x0) gettimeofday({1254902373.821208 },0x0) = 0 (0x0) ==> limits_get: conn=92 op=1 self="cn=bind,ou=staff,dc=ulgsm,dc=ru" this="ou=staff,dc=ulgsm,dc=ru" getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) _umtx_op(0x8022020b0,0x11,0x0,0x0,0x0,0x7fffff3fc648) = 105 (0x69) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7ffffda79658) = 0 (0x0) gettimeofday({1254902373.821644 },0x0) = 34669068288 (0x812700000) getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) => bdb_dn2idl("ou=staff,dc=ulgsm,dc=ru") sendto(3,"<167>Oct 7 11:59:33 slapd[81516"...,45,0x0,NULL,0x0) = 41 (0x29) _umtx_op(0x8022020b0,0x11,0x0,0x0,0x0,0x7ffffda79208) = 45 (0x2d) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7ffffe3faaa8) = 0 (0x0) write(2,"\n",1) = 0 (0x0) _umtx_op(0x8022020b0,0x11,0x0,0x0,0x0,0x7ffffe3fa6e8) = 0 (0x0) getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) sendto(3,"<167>Oct 7 11:59:33 slapd[81516"...,64,0x0,NULL,0x0) = 64 (0x40) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7ffffebfba28) = 0 (0x0) attrs:write(2," attrs:",10) = 0 (0x0) gettimeofday({1254902373.822603 },0x0) = 0 (0x0) getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) sendto(3,"<167>Oct 7 11:59:33 slapd[81516"...,45,0x0,NULL,0x0) = 45 (0x2d) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7ffffebfbaa8) = 0 (0x0) cngettimeofday({1254902373.822938 },0x0) = 3 (0x3) getpid(0x80180bf68,0x7fffffffed70,0x0,0x0,0xffff80080f10aaaa,0x0) = 81516 (0x13e6c) sendto(3,"<167>Oct 7 11:59:33 slapd[81516"...,75,0x0,NULL,0x0) = 75 (0x4b) _umtx_op(0x8022020b0,0x12,0x0,0x0,0x0,0x7ffffda795c8) = 0 (0x0) SIGNAL 11 (SIGSEGV) -- alexs

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

openldap-bugs