--001a1130d27c49538c05232c9dd4 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I cloned the git repository "git://git.openldap.org/openldap.git", then I compiled this version "2.X" as specified in the 1st message. Please consider that, after recompiling this version, I rebooted the server where slapd is running.
As far as I can see, it seems the memory consumption is the same as 2.4.42: it starts to increase up to 60%. In fact, with gdb, I got now an assertion failed due to:
---- 5630f547 connection_get(22): got connid=3D1001 5630f547 connection_read(22): checking for input on id=3D1001 ber_get_next ber_get_next: tag 0x30 len 188 contents: 5630f547 op tag 0x66, time 1446049095 ber_get_next 5630f547 conn=3D1001 op=3D46535 do_modify ber_scanf fmt ({m) ber: ber_scanf fmt ({e{m[W]}}) ber: 5630f547 =3D> get_ctrls ber_scanf fmt ({m) ber: 5630f547 =3D> get_ctrls: oid=3D"2.16.840.1.113730.3.4.2" (noncritical) 5630f547 <=3D get_ctrls: n=3D1 rc=3D0 err=3D"" 5630f547 >>> dnPrettyNormal: <cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch> 5630f547 <<< dnPrettyNormal: <cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch>, <cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivates,c=3Dch> 5630f547 >>> dnPretty: <cn=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch> 5630f547 <<< dnPretty: <cn=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch> 5630f547 >>> dnNormalize: <cn=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch> 5630f547 <<< dnNormalize: <cn=3Dsimon cottet.7601000061447,ou=3Dhcprofessional,dc=3Dhpd,o=3Dvivates,c=3Dch> 5630f547 bdb_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivate= s,c=3Dch") 5630f547 bdb_entry_get: rc=3D0 5630f547 syncprov_matchops: sid ffffffff fscope 1 rc 6 5630f547 =3D=3D> unique_modify <cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch> 5630f547 bdb_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivate= s,c=3Dch") 5630f547 bdb_entry_get: rc=3D0 5630f547 unique_modify: administrative bypass, skipping 5630f547 bdb_modify: txn1 id: 80005c1f 5630f547 bdb_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivate= s,c=3Dch") 5630f547 bdb_modify: txn2 id: 80005c20 5630f547 bdb_modify_internal: 0x00000288: cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch 5630f547 oc_check_required entry (cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch), ob= jectClass "VivatesHCRelationship" 5630f547 oc_check_allowed type "relationshipType" 5630f547 oc_check_allowed type "owner" 5630f547 oc_check_allowed type "objectClass" 5630f547 oc_check_allowed type "cn" 5630f547 oc_check_allowed type "member" 5630f547 oc_check_allowed type "structuralObjectClass" 5630f547 oc_check_allowed type "entryUUID" 5630f547 oc_check_allowed type "creatorsName" 5630f547 oc_check_allowed type "createTimestamp" 5630f547 oc_check_allowed type "entryCSN" 5630f547 oc_check_allowed type "modifiersName" 5630f547 oc_check_allowed type "modifyTimestamp" 5630f547 =3D> key_change(DELETE,288) 5630f547 <=3D key_change 0 5630f547 =3D> key_change(ADD,288) 5630f547 <=3D key_change 0 5630f547 =3D> entry_encode(0x00000288): cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch 5630f547 ch_malloc of 837196 bytes failed slapd: ch_malloc.c:57: ch_malloc: Assertion `0' failed.
Program received signal SIGABRT, Aborted. [Switching to Thread 0x9baffb70 (LWP 3069)] 0x00130424 in __kernel_vsyscall () Missing separate debuginfos, use: debuginfo-install libtool-ltdl-2.2.6-15.5.el6.i686
(gdb) bt #0 0x00130424 in __kernel_vsyscall () #1 0x003ac871 in raise (sig=3D6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #2 0x003ae14a in abort () at abort.c:92 #3 0x003a5b8b in __assert_fail_base (fmt=3D0x4dad58 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=3D0x81c79c9 "0", file=3D0x81ac34= 7 "ch_malloc.c", line=3D57, function=3D0x81ac3df "ch_malloc") at assert.c:96 #4 0x003a5c46 in __assert_fail (assertion=3D0x81c79c9 "0", file=3D0x81ac34= 7 "ch_malloc.c", line=3D57, function=3D0x81ac3df "ch_malloc") at assert.c:105 #5 0x0809768a in ch_malloc (size=3D837196) at ch_malloc.c:57 #6 0x080857d1 in entry_encode (e=3D0x9bafdb9c, bv=3D0x9bafda04) at entry.c= :710 #7 0x0814a4a5 in bdb_id2entry_put (be=3D<value optimized out>, tid=3D<valu= e optimized out>, e=3D<value optimized out>, flag=3D0) at id2entry.c:54 #8 0x080fa6f4 in bdb_modify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c= :679 #9 0x080e884d in overlay_op_walk (op=3D0xa22b3bd8, rs=3D0x9baff0cc, which=3Dop_modify, oi=3D0x8353670, on=3D0x0) at backover.c:696 #10 0x080e94e9 in over_op_func (op=3D0xa22b3bd8, rs=3D0x9baff0cc, which=3Dop_modify) at backover.c:749 #11 0x080944b1 in fe_op_modify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:303 #12 0x08094f27 in do_modify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:= 177 #13 0x0807b043 in connection_operation (ctx=3D0x9baff1e8, arg_v=3D0xa22b3bd= 8) at connection.c:1137 #14 0x0807bb57 in connection_read_thread (ctx=3D0x9baff1e8, argv=3D0x16) at connection.c:1283 #15 0x0013d309 in ldap_int_thread_pool_wrapper (xpool=3D0x8299a40) at tpool.c:956 #16 0x0036db39 in start_thread (arg=3D0x9baffb70) at pthread_create.c:301 #17 0x00464c2e in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:133
----
So, a malloc failed returning NULL. This happens also with the 2.4.42.
Now I relaunch again the loading procedure and see what's happening.
2015-10-28 16:41 GMT+01:00 Michael Str=C3=B6der michael@stroeder.com:
Any chance for you to test RE24 branch with the code to be released as 2.4.43?
There were some fixes for crashing syncrepl added therein.
Ciao, Michael.
--=20 Maurizio Lattuada
--001a1130d27c49538c05232c9dd4 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr">I cloned the git repository "<span style=3D"color:rgb= (0,0,0);font-family:sans-serif;font-size:13px">git://<a href=3D"http://git.= openldap.org/openldap.git">git.openldap.org/openldap.git</a>",=C2=A0</= span><span style=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13px"=
then I compiled this version "2.X" as specified in the 1st messa=
ge.</span><div><span style=3D"color:rgb(0,0,0);font-family:sans-serif;font-= size:13px">Please consider that, after recompiling this version, I rebooted= the server where slapd is running.</span><font color=3D"#000000" face=3D"s= ans-serif"><br></font></div><div><font color=3D"#000000" face=3D"sans-serif= "><br></font><div><span style=3D"color:rgb(0,0,0);font-family:sans-serif;fo= nt-size:13px">As far as I can see, it seems the memory consumption is the s= ame as 2.4.42: it starts to increase up to 60%.</span></div><div><span styl= e=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13px">In fact, with = gdb, I got now an assertion failed due to:</span><br></div><div><span style= =3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13px"><br></span></di= v><div><span style=3D"color:rgb(0,0,0);font-family:sans-serif;font-size:13p= x">----</span></div><div><div style=3D""><font color=3D"#000000" face=3D"sa= ns-serif">5630f547 connection_get(22): got connid=3D1001</font></div><div s= tyle=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 connection_r= ead(22): checking for input on id=3D1001</font></div><div style=3D""><font = color=3D"#000000" face=3D"sans-serif">ber_get_next</font></div><div style= =3D""><font color=3D"#000000" face=3D"sans-serif">ber_get_next: tag 0x30 le= n 188 contents:</font></div><div style=3D""><font color=3D"#000000" face=3D= "sans-serif">5630f547 op tag 0x66, time 1446049095</font></div><div style= =3D""><font color=3D"#000000" face=3D"sans-serif">ber_get_next</font></div>= <div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 conn= =3D1001 op=3D46535 do_modify</font></div><div style=3D""><font color=3D"#00= 0000" face=3D"sans-serif">ber_scanf fmt ({m) ber:</font></div><div style=3D= ""><font color=3D"#000000" face=3D"sans-serif">ber_scanf fmt ({e{m[W]}}) be= r:</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">= 5630f547 =3D> get_ctrls</font></div><div style=3D""><font color=3D"#0000= 00" face=3D"sans-serif">ber_scanf fmt ({m) ber:</font></div><div style=3D""=
<font color=3D"#000000" face=3D"sans-serif">5630f547 =3D> get_ctrls: oi=
d=3D"2.16.840.1.113730.3.4.2" (noncritical)</font></div><div styl= e=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 <=3D get_ctr= ls: n=3D1 rc=3D0 err=3D""</font></div><div style=3D""><font color= =3D"#000000" face=3D"sans-serif">5630f547 >>> dnPrettyNormal: <= cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch></= font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630= f547 <<< dnPrettyNormal: <cn=3D1000000000000_O2HP,ou=3DRelation= ship,dc=3DHPD,o=3Dvivates,c=3Dch>, <cn=3D1000000000000_o2hp,ou=3Drela= tionship,dc=3Dhpd,o=3Dvivates,c=3Dch></font></div><div style=3D""><font = color=3D"#000000" face=3D"sans-serif">5630f547 >>> dnPretty: <c= n=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c= =3Dch></font></div><div style=3D""><font color=3D"#000000" face=3D"sans-= serif">5630f547 <<< dnPretty: <cn=3DSimon Cottet.7601000061447,= ou=3DHCProfessional,dc=3DHPD,o=3Dvivates,c=3Dch></font></div><div style= =3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 >>> dnN= ormalize: <cn=3DSimon Cottet.7601000061447,ou=3DHCProfessional,dc=3DHPD,= o=3Dvivates,c=3Dch></font></div><div style=3D""><font color=3D"#000000" = face=3D"sans-serif">5630f547 <<< dnNormalize: <cn=3Dsimon cotte= t.7601000061447,ou=3Dhcprofessional,dc=3Dhpd,o=3Dvivates,c=3Dch></font><= /div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 b= db_dn2entry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvi= vates,c=3Dch")</font></div><div style=3D""><font color=3D"#000000" fac= e=3D"sans-serif">5630f547 bdb_entry_get: rc=3D0</font></div><div style=3D""=
<font color=3D"#000000" face=3D"sans-serif">5630f547 syncprov_matchops: si=
d ffffffff fscope 1 rc 6</font></div><div style=3D""><font color=3D"#000000= " face=3D"sans-serif">5630f547 =3D=3D> unique_modify <cn=3D1000000000= 000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dch></font></div><div= style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 bdb_dn2ent= ry("cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivates,c= =3Dch")</font></div><div style=3D""><font color=3D"#000000" face=3D"sa= ns-serif">5630f547 bdb_entry_get: rc=3D0</font></div><div style=3D""><font = color=3D"#000000" face=3D"sans-serif">5630f547 unique_modify: administrativ= e bypass, skipping</font></div><div style=3D""><font color=3D"#000000" face= =3D"sans-serif">5630f547 bdb_modify: txn1 id: 80005c1f</font></div><div sty= le=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 bdb_dn2entry(&= quot;cn=3D1000000000000_o2hp,ou=3Drelationship,dc=3Dhpd,o=3Dvivates,c=3Dch&= quot;)</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-ser= if">5630f547 bdb_modify: txn2 id: 80005c20</font></div><div style=3D""><fon= t color=3D"#000000" face=3D"sans-serif">5630f547 bdb_modify_internal: 0x000= 00288: cn=3D1000000000000_O2HP,ou=3DRelationship,dc=3DHPD,o=3Dvivates,c=3Dc= h</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5= 630f547 oc_check_required entry (cn=3D1000000000000_O2HP,ou=3DRelationship,= dc=3DHPD,o=3Dvivates,c=3Dch), objectClass "VivatesHCRelationship"= </font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">56= 30f547 oc_check_allowed type "relationshipType"</font></div><div = style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_al= lowed type "owner"</font></div><div style=3D""><font color=3D"#00= 0000" face=3D"sans-serif">5630f547 oc_check_allowed type "objectClass&= quot;</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-seri= f">5630f547 oc_check_allowed type "cn"</font></div><div style=3D"= "><font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_allowed typ= e "member"</font></div><div style=3D""><font color=3D"#000000" fa= ce=3D"sans-serif">5630f547 oc_check_allowed type "structuralObjectClas= s"</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-se= rif">5630f547 oc_check_allowed type "entryUUID"</font></div><div = style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_al= lowed type "creatorsName"</font></div><div style=3D""><font color= =3D"#000000" face=3D"sans-serif">5630f547 oc_check_allowed type "creat= eTimestamp"</font></div><div style=3D""><font color=3D"#000000" face= =3D"sans-serif">5630f547 oc_check_allowed type "entryCSN"</font><= /div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 o= c_check_allowed type "modifiersName"</font></div><div style=3D"">= <font color=3D"#000000" face=3D"sans-serif">5630f547 oc_check_allowed type = "modifyTimestamp"</font></div><div style=3D""><font color=3D"#000= 000" face=3D"sans-serif">5630f547 =3D> key_change(DELETE,288)</font></di= v><div style=3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 <= =3D key_change 0</font></div><div style=3D""><font color=3D"#000000" face= =3D"sans-serif">5630f547 =3D> key_change(ADD,288)</font></div><div style= =3D""><font color=3D"#000000" face=3D"sans-serif">5630f547 <=3D key_chan= ge 0</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif= ">5630f547 =3D> entry_encode(0x00000288): cn=3D1000000000000_O2HP,ou=3DR= elationship,dc=3DHPD,o=3Dvivates,c=3Dch</font></div><div style=3D""><font c= olor=3D"#000000" face=3D"sans-serif">5630f547 ch_malloc of 837196 bytes fai= led</font></div><div style=3D""><font color=3D"#000000" face=3D"sans-serif"=
slapd: ch_malloc.c:57: ch_malloc: Assertion `0' failed.</font></div><d=
iv style=3D""><font color=3D"#000000" face=3D"sans-serif"><br></font></div>= <div style=3D""><font color=3D"#000000" face=3D"sans-serif">Program receive= d signal SIGABRT, Aborted.</font></div><div style=3D""><font color=3D"#0000= 00" face=3D"sans-serif">[Switching to Thread 0x9baffb70 (LWP 3069)]</font><= /div><div style=3D""><font color=3D"#000000" face=3D"sans-serif">0x00130424= in __kernel_vsyscall ()</font></div><div style=3D""><font color=3D"#000000= " face=3D"sans-serif">Missing separate debuginfos, use: debuginfo-install l= ibtool-ltdl-2.2.6-15.5.el6.i686</font></div></div><div style=3D""><font col= or=3D"#000000" face=3D"sans-serif"><br></font></div><div style=3D""><font c= olor=3D"#000000" face=3D"sans-serif"><div>(gdb) bt</div><div>#0 =C2=A00x001= 30424 in __kernel_vsyscall ()</div><div>#1 =C2=A00x003ac871 in raise (sig= =3D6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64</div><div>#2 =C2=A00x00= 3ae14a in abort () at abort.c:92</div><div>#3 =C2=A00x003a5b8b in __assert_= fail_base (fmt=3D0x4dad58 "%s%s%s:%u: %s%sAssertion `%s' failed.\n= %n", assertion=3D0x81c79c9 "0", file=3D0x81ac347 "ch_ma= lloc.c", line=3D57, function=3D0x81ac3df "ch_malloc") at ass= ert.c:96</div><div>#4 =C2=A00x003a5c46 in __assert_fail (assertion=3D0x81c7= 9c9 "0", file=3D0x81ac347 "ch_malloc.c", line=3D57, fun= ction=3D0x81ac3df "ch_malloc") at assert.c:105</div><div>#5 =C2= =A00x0809768a in ch_malloc (size=3D837196) at ch_malloc.c:57</div><div>#6 = =C2=A00x080857d1 in entry_encode (e=3D0x9bafdb9c, bv=3D0x9bafda04) at entry= .c:710</div><div>#7 =C2=A00x0814a4a5 in bdb_id2entry_put (be=3D<value op= timized out>, tid=3D<value optimized out>, e=3D<value optimized= out>, flag=3D0) at id2entry.c:54</div><div>#8 =C2=A00x080fa6f4 in bdb_m= odify (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:679</div><div>#9 =C2= =A00x080e884d in overlay_op_walk (op=3D0xa22b3bd8, rs=3D0x9baff0cc, which= =3Dop_modify, oi=3D0x8353670, on=3D0x0) at backover.c:696</div><div>#10 0x0= 80e94e9 in over_op_func (op=3D0xa22b3bd8, rs=3D0x9baff0cc, which=3Dop_modif= y) at backover.c:749</div><div>#11 0x080944b1 in fe_op_modify (op=3D0xa22b3= bd8, rs=3D0x9baff0cc) at modify.c:303</div><div>#12 0x08094f27 in do_modify= (op=3D0xa22b3bd8, rs=3D0x9baff0cc) at modify.c:177</div><div>#13 0x0807b04= 3 in connection_operation (ctx=3D0x9baff1e8, arg_v=3D0xa22b3bd8) at connect= ion.c:1137</div><div>#14 0x0807bb57 in connection_read_thread (ctx=3D0x9baf= f1e8, argv=3D0x16) at connection.c:1283</div><div>#15 0x0013d309 in ldap_in= t_thread_pool_wrapper (xpool=3D0x8299a40) at tpool.c:956</div><div>#16 0x00= 36db39 in start_thread (arg=3D0x9baffb70) at pthread_create.c:301</div><div=
#17 0x00464c2e in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:133<=
/div><div><br></div><div>----</div><div><br></div><div><br></div><div>So, a= malloc failed returning NULL.</div><div>This happens also with the 2.4.42.= </div><div><br></div><div><br></div><div>Now I relaunch again the loading p= rocedure and see what's happening.</div></font></div></div></div><div c= lass=3D"gmail_extra"><br><div class=3D"gmail_quote">2015-10-28 16:41 GMT+01= :00 Michael Str=C3=B6der <span dir=3D"ltr"><<a href=3D"mailto:michael@st= roeder.com" target=3D"_blank">michael@stroeder.com</a>></span>:<br><bloc= kquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #cc= c solid;padding-left:1ex">Any chance for you to test RE24 branch with the c= ode to be released as 2.4.43?<br> <br> There were some fixes for crashing syncrepl added therein.<br> <br> Ciao, Michael.<br> </blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><div class= =3D"gmail_signature"><div dir=3D"ltr">=C2=A0Maurizio Lattuada<br></div></di= v> </div>
--001a1130d27c49538c05232c9dd4--