openldap-bugs

openldap-bugs@openldap.org

1 participants
20960 discussions

Re: (ITS#7735) Memory leaks on Multi-Master replications
by quanah＠zimbra.com 30 Oct '13

30 Oct '13

--Apple-Mail-A17D5106-BB00-42CE-B576-6B323E42E55E Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable > On Oct 29, 2013, at 10:32 PM, Dmitrii Fonariuk <dmitrii.fonariuk(a)gmail.com= > wrote: >=20 > hi. > visually. two days of use 3K load modify per second memory consumption inc= reased from 200 Mb to 16 Gb. After that, the system killed the process. > when modify send only to one server use 200 Mb memory and its consumption d= oes not increase. > no I do not use an alternative memory allocator. >=20 > best regards, > Dmitrii I strongly advise you use tcmalloc and report back.=20 --Quanah >=20 > 2013/10/29 Quanah Gibson-Mount <quanah(a)zimbra.com> >> --On Tuesday, October 29, 2013 10:45 AM +0000 dmitrii.fonariuk(a)gmail.com w= rote: >>=20 >>> Full_Name: Dmitrii Fonariuk >>> Version: 2.4.37 >>> OS: RHEL6.x86_64 >>> URL: ftp://ftp.openldap.org/incoming/ >>> Submission from: (NULL) (91.210.4.1) >>>> memory leaks >>>=20 >>> * in square brackets ranges. >>>=20 >>> Ranges for DN do not overlap for different servers. State is numericStri= ng >>> attribute. >>=20 >> How are you determining there is a memory leak? Are you using an alterna= tive memory allocator like tcmalloc instead of glibc? >>=20 >> --Quanah >>=20 >>=20 >> -- >>=20 >> Quanah Gibson-Mount >> Architect - Server >> Zimbra, Inc. >> -------------------- >> Zimbra :: the leader in open source messaging and collaboration >=20 --Apple-Mail-A17D5106-BB00-42CE-B576-6B323E42E55E Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div><br></div><div><br>On Oct 29, 2013, at 10:32 PM, Dmitrii Fonariuk <<a href="mailto:dmitrii.fonariuk@gmail.com">dmitrii.fonariuk(a)gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr">hi.<div>visually. two days of use 3K load modify per second memory consumption increased from 200 Mb to 16 Gb. After that, the system killed the process.</div><div>when modify send only to one server use 200 Mb memory and its consumption does not increase.</div> <div>no I do not use an <span style="font-family:arial,sans-serif;font-size:13px">alternative memory allocator.</span></div><div><font face="arial, sans-serif"><br></font></div><div><font face="arial, sans-serif">best regards,</font></div> <div><font face="arial, sans-serif">Dmitrii</font></div></div></div></blockquote><div><br></div><div>I strongly advise you use tcmalloc and report back. </div><div><br></div><div>--Quanah</div><div><br></div><div><br></div><br><blockquote type="cite"><div><div dir="ltr"><div><div class="gmail_extra"><br><div class="gmail_quote">2013/10/29 Quanah Gibson-Mount <span dir="ltr"><<a href="mailto:quanah@zimbra.com" target="_blank">quanah(a)zimbra.com</a>></span><br> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">--On Tuesday, October 29, 2013 10:45 AM +0000 <a href="mailto:dmitrii.fonariuk@gmail.com" target="_blank">dmitrii.fonariuk(a)gmail.com</a> wrote:<br> <br> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"> Full_Name: Dmitrii Fonariuk<br> Version: 2.4.37<br> OS: RHEL6.x86_64<br> URL: <a href="ftp://ftp.openldap.org/incoming/" target="_blank">ftp://ftp.openldap.org/<u></u>incoming/</a><br> Submission from: (NULL) (91.210.4.1)<br> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"> memory leaks<br> </blockquote> <br> * in square brackets ranges.<br> <br> Ranges for DN do not overlap for different servers. State is numericString<br> attribute.<br> </blockquote> <br> How are you determining there is a memory leak?  Are you using an alternative memory allocator like tcmalloc instead of glibc?<br> <br> --Quanah<br> <br> <br> --<br> <br> Quanah Gibson-Mount<br> Architect - Server<br> Zimbra, Inc.<br> --------------------<br> Zimbra ::  the leader in open source messaging and collaboration<br> </blockquote></div><br></div></div></div> </div></blockquote></body></html> --Apple-Mail-A17D5106-BB00-42CE-B576-6B323E42E55E--

1 0

Re: (ITS#7735) Memory leaks on Multi-Master replications
by dmitrii.fonariuk＠gmail.com 30 Oct '13

30 Oct '13

--e89a8ff1c04499e9af04e9eea81c Content-Type: text/plain; charset=ISO-8859-1 hi. visually. two days of use 3K load modify per second memory consumption increased from 200 Mb to 16 Gb. After that, the system killed the process. when modify send only to one server use 200 Mb memory and its consumption does not increase. no I do not use an alternative memory allocator. best regards, Dmitrii 2013/10/29 Quanah Gibson-Mount <quanah(a)zimbra.com> > --On Tuesday, October 29, 2013 10:45 AM +0000 dmitrii.fonariuk(a)gmail.comwrote: > > Full_Name: Dmitrii Fonariuk >> Version: 2.4.37 >> OS: RHEL6.x86_64 >> URL: ftp://ftp.openldap.org/**incoming/<ftp://ftp.openldap.org/incoming/> >> Submission from: (NULL) (91.210.4.1) >> >>> memory leaks >>> >> >> * in square brackets ranges. >> >> Ranges for DN do not overlap for different servers. State is numericString >> attribute. >> > > How are you determining there is a memory leak? Are you using an > alternative memory allocator like tcmalloc instead of glibc? > > --Quanah > > > -- > > Quanah Gibson-Mount > Architect - Server > Zimbra, Inc. > -------------------- > Zimbra :: the leader in open source messaging and collaboration > --e89a8ff1c04499e9af04e9eea81c Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr">hi.<div>visually.=A0two days of use 3K load modify per sec= ond memory consumption increased from 200 Mb to 16 Gb. After that, the syst= em killed the process.</div><div>when modify send only to one server use 20= 0 Mb memory and its consumption does not increase.</div> <div>no I do not use an=A0<span style=3D"font-family:arial,sans-serif;font-= size:13px">alternative memory allocator.</span></div><div><font face=3D"ari= al, sans-serif"><br></font></div><div><font face=3D"arial, sans-serif">best= regards,</font></div> <div><font face=3D"arial, sans-serif">Dmitrii<br></font><div class=3D"gmail= _extra"><br><br><div class=3D"gmail_quote">2013/10/29 Quanah Gibson-Mount <= span dir=3D"ltr"><<a href=3D"mailto:quanah@zimbra.com" target=3D"_blank"= >quanah(a)zimbra.com</a>></span><br> <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p= adding-left:1ex">--On Tuesday, October 29, 2013 10:45 AM +0000 <a href=3D"m= ailto:dmitrii.fonariuk@gmail.com" target=3D"_blank">dmitrii.fonariuk(a)gmail.= com</a> wrote:<br> <br> <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p= adding-left:1ex"> Full_Name: Dmitrii Fonariuk<br> Version: 2.4.37<br> OS: RHEL6.x86_64<br> URL: <a href=3D"ftp://ftp.openldap.org/incoming/" target=3D"_blank">ftp://f= tp.openldap.org/<u></u>incoming/</a><br> Submission from: (NULL) (91.210.4.1)<br> <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;p= adding-left:1ex"> memory leaks<br> </blockquote> <br> * in square brackets ranges.<br> <br> Ranges for DN do not overlap for different servers. State is numericString<= br> attribute.<br> </blockquote> <br> How are you determining there is a memory leak? =A0Are you using an alterna= tive memory allocator like tcmalloc instead of glibc?<br> <br> --Quanah<br> <br> <br> --<br> <br> Quanah Gibson-Mount<br> Architect - Server<br> Zimbra, Inc.<br> --------------------<br> Zimbra :: =A0the leader in open source messaging and collaboration<br> </blockquote></div><br></div></div></div> --e89a8ff1c04499e9af04e9eea81c--

1 0

Re: (ITS#7735) Memory leaks on Multi-Master replications
by quanah＠zimbra.com 29 Oct '13

29 Oct '13

--On Tuesday, October 29, 2013 10:45 AM +0000 dmitrii.fonariuk(a)gmail.com wrote: > Full_Name: Dmitrii Fonariuk > Version: 2.4.37 > OS: RHEL6.x86_64 > URL: ftp://ftp.openldap.org/incoming/ > Submission from: (NULL) (91.210.4.1) >> memory leaks > > * in square brackets ranges. > > Ranges for DN do not overlap for different servers. State is numericString > attribute. How are you determining there is a memory leak? Are you using an alternative memory allocator like tcmalloc instead of glibc? --Quanah -- Quanah Gibson-Mount Architect - Server Zimbra, Inc. -------------------- Zimbra :: the leader in open source messaging and collaboration

1 0

(ITS#7735) Memory leaks on Multi-Master replications
by dmitrii.fonariuk＠gmail.com 29 Oct '13

29 Oct '13

Full_Name: Dmitrii Fonariuk Version: 2.4.37 OS: RHEL6.x86_64 URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (91.210.4.1) Hi. I have 2 servers with OpenLDAP 2.4.37 in Multi-Master replication. If I send modify request to only one server no memory leaks. If I send different modify request on both servers I see a memory leaks on both servers. Here are the settings of one of the servers: dn: olcDatabase={1}mdb,cn=config objectClass: olcDatabaseConfig objectClass: olcConfig objectClass: top objectClass: olcMdbConfig olcDatabase: {1}mdb olcDbDirectory: /opt/local/OpenLDAP/data/mdb3 olcDbEnvFlags: writemap olcDbEnvFlags: mapasync olcDbIndex: entryUUID eq olcDbIndex: entryCSN eq olcDbIndex: objectClass eq olcDbMaxSize: 5368709120 olcLimits: {0}dn.exact="uid=replica1,uid=admin,dc=rrr" time.soft=unlimited time.hard=unlimited size.soft=unlimited size.hard=unlimited olcMirrorMode: TRUE olcRootDN: dc=rrr olcRootPW: secret olcSuffix: dc=rrr olcSyncrepl: {0}rid=010 provider=ldap://srv-rrr03:3903 binddn="uid=replica1,uid=admin,dc=rrr" bindmethod=simple credentials=replica1 searchbase="dc=rrr" schemachecking=off type=refreshAndPersist retry="5 5 60 +" dn: olcOverlay={0}syncprov,olcDatabase={1}mdb,cn=config objectClass: olcSyncProvConfig objectClass: olcOverlayConfig objectClass: olcConfig objectClass: top olcOverlay: {0}syncprov olcSpCheckpoint: 1000 5 Requests on one server: dn: id=1000000000[10000-30000],ou=subscriber,o=Megatron,dc=rrr changetype: modify replace: state state: [1-9] no memory leaks Requests on both servers: 1: dn: id=1000000000[10000-20000],ou=subscriber,o=Megatron,dc=rrr changetype: modify replace: state state: [1-9] 2: dn: id=1000000000[20001-30000],ou=subscriber,o=Megatron,dc=rrr changetype: modify replace: state state: [1-9] memory leaks * in square brackets ranges. Ranges for DN do not overlap for different servers. State is numericString attribute.

1 0

Re: (ITS#7705) mdb back-end segfaults sporadically with paged searches
by openldap＠semyon.org 28 Oct '13

28 Oct '13

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 The problem seems to be resolved in OPENLDAP_REL_ENG_2_4_37. Please close this ticket. Best Semyon -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.20 (Darwin) Comment: GPGTools - https://gpgtools.org Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQGcBAEBCgAGBQJSbugyAAoJEDnsppBba4kKtNcL/0YHZaQfYOL7X5LBkYlsHX86 JtLPPT8mCax9ehrTQUmz5ZzuzV2YkQ2KnzO45Gb8K721bNTCuNBwlXvT33yh+I0T QCEOAdMOxAasC27BW3L46Bbw+lW9/GPfxW8p6eGaw2qDCpIwRluxApysi+paRZR1 VCXu/z8/zLIEVMDKq/lktGnCBFR7uNBr575G4ePZVgytDO8aEk/F2VE+LQRBbfVL 25zlQesiO8EEPk5blbBhRFxTUZEBs/0EAnBB7hoBVKDlbog4tjOav6aNq1o4TegS +0oNgZS+K0Krop/3v27dr+LzaFy07jySE4aDgXKstgqzM4uvZzCSxarsFPZyUqbd sJNXBEKM5HUMn6orl6Ip7Z7h0MSkPYAH7OZLWXYTOmgl5wgJ8ArQSMMTD9+vC/yk McIDElkqCoRce/IRfRYjS+Ct+qaEB7AYKhtbzVAwPjJBIj4S5N24xUShjDCvkjay K6oj3GQFq78jp2ehITHn9zytiw12gmhv+V42hEQY+g== =VzO+ -----END PGP SIGNATURE-----

1 0

ITS#7731
by hyc＠symas.com 28 Oct '13

28 Oct '13

The ITS is for actual bug reports, not for software usage questions. This ITS will be closed. Since you're using an RHEL build you should contact RedHat for support. -- -- Howard Chu CTO, Symas Corp. http://www.symas.com Director, Highland Sun http://highlandsun.com/hyc/ Chief Architect, OpenLDAP http://www.openldap.org/project/

1 0

(ITS#7734) MDB_NORDAHEAD missing from valid flags bitfields
by dw＠botanicus.net 28 Oct '13

28 Oct '13

Full_Name: David Wilson Version: LMDB 0.9.9 OS: URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (178.238.153.20) Unless I'm missing something, this new flag cannot be set during mdb_env_open(), and since it is not in CHANGEABLE either, cannot be set with mdb_env_set_flags() commit dd0df21ce0a935955966aa7d3077d666741d027f Author: David Wilson <dw(a)botanicus.net> Date: Mon Oct 28 01:28:00 2013 +0000 Add MDB_NORDAHEAD to CHANGELESS. diff --git a/lib/mdb.c b/lib/mdb.c index 33be876..3ec7302 100644 --- a/lib/mdb.c +++ b/lib/mdb.c @@ -3929,7 +3929,7 @@ fail: * environment and re-opening it with the new flags. */ #define CHANGEABLE (MDB_NOSYNC|MDB_NOMETASYNC|MDB_MAPASYNC) -#define CHANGELESS (MDB_FIXEDMAP|MDB_NOSUBDIR|MDB_RDONLY|MDB_WRITEMAP|MDB_NOTLS|MDB_NOLOCK) +#define CHANGELESS (MDB_FIXEDMAP|MDB_NOSUBDIR|MDB_RDONLY|MDB_WRITEMAP|MDB_NOTLS|MDB_NOLOCK|MDB_NORDAHEAD) int mdb_env_open(MDB_env *env, const char *path, unsigned int flags, mdb_mode_t mode)

1 0

Re: (ITS#7733) Assert failure calling mdb_cursor_del()
by dw＠botanicus.net 28 Oct '13

28 Oct '13

--001a11c350da0b6da604e9c2bb08 Content-Type: text/plain; charset=ISO-8859-1 Repro here: https://raw.github.com/dw/py-lmdb/master/misc/its7733.c --001a11c350da0b6da604e9c2bb08 Content-Type: text/html; charset=ISO-8859-1 <div dir="ltr">Repro here: <a href="https://raw.github.com/dw/py-lmdb/master/misc/its7733.c">https://raw.github.com/dw/py-lmdb/master/misc/its7733.c</a><br></div> --001a11c350da0b6da604e9c2bb08--

1 0

(ITS#7733) Assert failure calling mdb_cursor_del()
by dw＠botanicus.net 28 Oct '13

28 Oct '13

Full_Name: David Wilson Version: LMDB 0.9.9 OS: URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (178.238.153.20) Given a new environment whose main DBI has the following records inserted (in the displayed order): ['a', ''] ['b', ''] ['baa', ''] ['d', ''] mdb_cursor_set(MDB_LAST) then mdb_cursor_del(..., 0) then mdb_cursor_del(..., 0) will cause an abort: Assertion failed: (indx < NUMKEYS(mp)), function mdb_node_del, file lib/mdb.c, line 6380.

1 0

(ITS#7732) CSN too old MMR setup
by lanfeust99＠gmail.com 24 Oct '13

24 Oct '13

Full_Name: Lanfeut Version: 2.4.36 OS: Centos URL: ftp://ftp.openldap.org/incoming/ Submission from: (NULL) (193.42.151.220) sometimes my server a not in sync. because server ignoring entry: do_syncrep2: rid=102 CSN too old, ignoring 20130923090023.266239Z#000000#002#000000 @(#) $OpenLDAP: slapd 2.4.36 (....) 4 server host1 and host 2: only one database c=fr ( contain an ou=apps-ext ) host3 and host 4: tow database: first ou=apps-ext (glued with c=fr ). writable by host1,2,3,4 second c=fr writable only by host1,2 ldap-int1 and ldap-int2 cn=config also into syncrepl mirrorMode ldap-ext1 and ldap-ext2 cn=config also into syncrepl mirrorMode all server are time sync. Configuration: grep serverID /etc/openldap/slapd.d/* /etc/openldap/slapd.d/cn=config.ldif:olcServerID: 1 ldaps://ldap-int1.dom.fr /etc/openldap/slapd.d/cn=config.ldif:olcServerID: 2 ldaps://ldap-int2.dom.fr /etc/openldap/slapd.d/cn=config.ldif:olcServerID: 3 ldaps://ldap-ext1.vlandata.dom.fr /etc/openldap/slapd.d/cn=config.ldif:olcServerID: 4 ldaps://ldap-ext2.vlandata.dom.fr syncrepl: ldap-int1 and ldap-int2 cn=config also into syncrepl olcSyncrepl: {0}rid=101 provider=ldaps://ldap-int1.dom.fr binddn="uid=syncrepl ,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXXXXX sea rchbase="c=fr" tls_reqcert=never type=refreshAndPersist retry="5 5 300 +" timeout=1 olcSyncrepl: {1}rid=102 provider=ldaps://ldap-int2.cdoms.fr binddn="uid=syncrepl ,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXXXXX sea rchbase="c=fr" tls_reqcert=never type=refreshAndPersist retry="5 5 300 +" timeout=1 olcSyncrepl: {2}rid=103 provider=ldaps://ldap-ext2.vlandata.dom.fr binddn="uid =syncrepl,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XX XXXX tls_reqcert=never searchbase="o=apps-ext,c=fr" type=refreshAndPersist r etry="5 5 300 +" timeout=1 olcSyncrepl: {3}rid=104 provider=ldaps://ldap-ext1.vlandata.dom.fr binddn="uid =syncrepl,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXX XXXX searchbase="o=apps-ext,c=fr" tls_reqcert=never type=refreshAndPersist r etry="5 5 300 +" timeout=1 syncrepl host3 and host4: database apps-ext: olcSyncrepl: {0}rid=303 provider=ldaps://ldap-ext1.vlandata.dom.fr binddn="uid =syncrepl,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXX XXXX searchbase="o=apps-ext,c=fr" tls_reqcert=never type=refreshAndPersist r etry="5 5 300 +" timeout=1 olcSyncrepl: {1}rid=304 provider=ldaps://ldap-ext2.vlandata.dom.fr binddn="uid =syncrepl,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXX XXX searchbase="o=apps-ext,c=fr" tls_reqcert=never type=refreshAndPersist r etry="5 5 300 +" timeout=1 database c=fr : olcSyncrepl: {0}rid=201 provider=ldaps://ldap-int1.dom.fr binddn="uid=syncrepl ,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXXXXX sea rchbase="c=fr" tls_reqcert=never type=refreshAndPersist retry="5 5 300 +" tim eout=1 olcSyncrepl: {1}rid=202 provider=ldaps://ldap-int2.dom.fr binddn="uid=syncrepl ,ou=system,ou=dom,o=domgroup,c=fr" bindmethod=simple credentials=XXXXXX tls _reqcert=never searchbase="c=fr" type=refreshAndPersist retry="5 5 300 +" tim eout=1 ldap-int1 receive syncrepl modification from ldap-int2 with this log: ldap-int1 log: syncprov_matchops: skipping original sid 002 Oct 4 15:00:24 ldap-int1 slapd[24555]: slap_graduate_commit_csn: removing 0x7f7bf8200b40 20131004150021.988007Z#000000#002#000000 Oct 4 15:00:24 ldap-int1 slapd[24555]: syncrepl_entry: rid=102 be_add cn=502296-xxxxxx,ou=aaaaa,ou=bbbb,o=cccc,c=dd (0) ... ... ldap-ext2 receive the same modification an reply to ldap-int1 with new cookie ldap-int1 log Oct 4 15:00:24 ldap-int1 slapd[24555]: do_syncrep2: rid=103 NEW_COOKIE: rid=103,sid=004,csn=20130304121522.188962Z#000000#000#000000;20131004082718.688747Z#000000#001#000000;20131004150023.350876Z#000000#002#000000;20130920094950.036431Z#000000#003#000000;20130930134451.718477Z#000000#004#000000;20130304131428.455916Z#000000#00b#000000;20130304125618.164164Z#000000#00c#00000 Another modification from ldap-int2 isn't apply to ldap-int1 because of csn too old Oct 4 15:00:24 ldap-int1 slapd[24555]: syncrepl_entry: rid=102 be_add cn=502296-bbbb,ou=aaaaa,ou=bbbb,o=cccc,c=dd (0) Oct 4 15:00:24 ldap-int1 slapd[24555]: do_syncrep2: rid=102 cookie=rid=102,sid=002,csn=20131004150022.050845Z#000000#002#000000 Oct 4 15:00:24 ldap-int1 slapd[24555]: do_syncrep2: rid=102 CSN too old, ignoring 20131004150022.050845Z#000000#002#000000 (cn=502296-bbbb,ou=aaaaa,ou=bbbb,o=cccc,c=dd) Oct 4 15:00:24 ldap-int1 slapd[24555]: do_syncrep2: rid=102 cookie=rid=102,sid=002,csn=20131004150022.100121Z#000000#002#000000

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

openldap-bugs