https://bugs.openldap.org/show_bug.cgi?id=9329
Issue ID: 9329 Summary: Intermittent panic: Assertion failed: !BER_BVISNULL( src ), file memory.c, line 705 Product: OpenLDAP Version: 2.4.51 Hardware: All OS: All Status: UNCONFIRMED Severity: normal Priority: --- Component: backends Assignee: bugs@openldap.org Reporter: stacey.marshall@gmail.com Target Milestone: ---
While testing openLDAP 2.4.51 with test target on Sparc the following issue was seen with 32bit build.
Starting test050-syncrepl-multiprovider for mdb...
running defines.sh Initializing server configurations... Starting server 1 on TCP/IP port 9011... Using ldapsearch to check that server 1 is running... Inserting syncprov overlay on server 1... Starting server 2 on TCP/IP port 9012... Using ldapsearch to check that server 2 is running... Configuring syncrepl on server 2... Starting server 3 on TCP/IP port 9013... Using ldapsearch to check that server 3 is running... Configuring syncrepl on server 3... Starting server 4 on TCP/IP port 9014... Using ldapsearch to check that server 4 is running... Configuring syncrepl on server 4... Adding schema and databases on server 1... ldapadd modify for database config (255)!
test050-syncrepl-multiprovider failed for mdb
The part of the test script which is failing is:
echo "Adding schema and databases on server 1..." $LDAPADD -D cn=config -H $URI1 -y $CONFIGPWF <<EOF >>$TESTOUT 2>&1 include: file://$ABS_SCHEMADIR/core.ldif
include: file://$ABS_SCHEMADIR/cosine.ldif
include: file://$ABS_SCHEMADIR/inetorgperson.ldif
include: file://$ABS_SCHEMADIR/openldap.ldif
include: file://$ABS_SCHEMADIR/nis.ldif EOF RC=$? if test $RC != 0 ; then echo "ldapadd failed for schema config ($RC)!" test $KILLSERVERS != no && kill -HUP $KILLPIDS exit $RC fi
Notes on script. - KILLSERVERS : unset. set to "no" to keep servers alive. - LDAPADD : comes from tests/scripts/defines.sh LDAPADD="$CLIENTDIR/ldapmodify -a $TOOLPROTO $TOOLARGS" - TESTOUT : also from defines.sh ./build/sparcv7/tests/testrun/test.out
test.out contains
modifying entry "cn=config"
adding new entry "olcOverlay=syncprov,olcDatabase={0}config,cn=config"
modifying entry "olcDatabase={0}config,cn=config"
modifying entry "olcDatabase={0}config,cn=config"
modifying entry "olcDatabase={0}config,cn=config"
modifying entry "olcDatabase={0}config,cn=config"
adding new entry "cn=core,cn=schema,cn=config"
adding new entry "cn=cosine,cn=schema,cn=config"
adding new entry "cn=inetorgperson,cn=schema,cn=config"
adding new entry "cn=openldap,cn=schema,cn=config"
adding new entry "cn=nis,cn=schema,cn=config"
adding new entry "olcDatabase={1}mdb,cn=config"
adding new entry "olcOverlay=syncprov,olcDatabase={1}mdb,cn=config"
ldap_result: Can't contact LDAP server (-1) modifying entry "olcDatabase={1}mdb,cn=config"
slapd log, ./build/sparcv7/tests/testrun/slapd.1.log contains
ber_scanf fmt ({e{m[W]}}) ber: ** ld fb0410 Outstanding Requests: 5f3e9d3c >>> dnPrettyNormal: <olcDatabase={1}mdb,cn=config> * msgid 2, origid 2, status InProgress => ldap_bv2dn(olcDatabase={1}mdb,cn=config,0) outstanding referrals 0, parent count 0 <= ldap_bv2dn(olcDatabase={1}mdb,cn=config)=0 ld fb0410 request count 1 (abandoned 0) => ldap_dn2bv(272) <= ldap_dn2bv(olcDatabase={1}mdb,cn=config)=0 read1msg: ld fa7f60 msgid 2 all 0 <= ldap_bv2dn(cn=config)=0 ber_get_next => ldap_dn2bv(272) => ldap_dn2bv(272) <= ldap_dn2bv(cn=config)=0 <= ldap_dn2bv(olcDatabase={1}mdb,cn=config)=0 5f3e9d3c <<< dnNormalize: <cn=config> 5f3e9d3c <<< dnPrettyNormal: <olcDatabase={1}mdb,cn=config>, <olcDatabase={1}mdb,cn=config> 5f3e9d3c conn=1011 op=1 modifications: 5f3e9d3c >>> dnNormalize: <cn=config> 5f3e9d3c add: olcDbIndex => ldap_bv2dn(cn=config,0) 5f3e9d3c multiple values 5f3e9d3c conn=1011 op=1 MOD dn="olcDatabase={1}mdb,cn=config" <= ldap_bv2dn(cn=config)=0 5f3e9d3c conn=1011 op=1 MOD attr=olcDbIndex ,** ld fb0410 Response Queue: => ldap_dn2bv(272) 5f3e9d3c syncprov_matchops: sid 004 fscope 1 rc 6 <= ldap_dn2bv(cn=config)=0 5f3e9d3c syncprov_matchops: sid 003 fscope 1 rc 6 5f3e9d3c <<< dnNormalize: <cn=config> 5f3e9d3c slap_queue_csn: queueing 10316d0 20200820155644.190066Z#000000#001#000000 5f3e9d3c <= str2entry(cn=config) -> 0x1076964 Empty ld fb0410 response count 0 ldap_chkResponseList ld fb0410 msgid 2 all 0 ldap_chkResponseList returns ld fb0410 NULL ldap_int_select ber_get_next: tag 0x30 len 35 contents: read1msg: ld fa7f60 msgid 2 message type intermediate ldap_parse_intermediate ber_scanf fmt ({) ber: ber_scanf fmt (a) ber: ber_scanf fmt (O) ber: 5f3e9d3c do_syncrep2: rid=004 LDAP_RES_INTERMEDIATE - REFRESH_DELETE ber_scanf fmt (t{) ber: ber_scanf fmt (}) ber: read1msg: ld 103e468 msgid 2 all 0 Assertion failed: !BER_BVISNULL( src ), file memory.c, line 705 ber_get_next
Core file stack is: $ mdb ./build/sparcv7/tests/testrun/srv1/core slapd:core> ::status debugging core file of slapd (32-bit) from slitheen file:
/builds2/smarshal/openldap-2.4.51-master/components/openldap/build/sparcv7/servers/slapd/.libs/slapd initial argv:
/builds2/smarshal/openldap-2.4.51-master/components/openldap/build/sparcv7/serv threading model: raw lwps status: process terminated by SIGABRT (Abort), pid=949186 uid=521808 code=-1 panic message: Assertion failed: !BER_BVISNULL( src ), file memory.c, line 705 slapd:core> $C e9ffef08 libc.so.1`__lwp_sigqueue+8(6, 0, ffffffef, ffffffec, e9ffef58, 5) e9ffef68 libc.so.1`abort+0x100(e9fff058, 1, ec124b18, 0, b18, 800) e9ffeff8 libc.so.1`_assert+0x68(ebe433a8, ebe4338c, 2c1, ffe8fdf3, ec124000, 170000) e9fff258 liblber-2.4.so.2.10.14`ber_bvreplace_x+0xd4(f84c00, 1ac00, 0, 4, 30303030, ebe5e000) e9fff2b8 merge_state+0x45c(1032230, 28, 102acc0, 1032340, 108787c, 3) e9fff320 check_syncprov+0x36c(e9fff978, 1032230, 102aca8, 10312c0, 102aca8, 29dcd8) e9fff490 do_syncrep2+0x26d4(e9fff978, 1032230, 0, 7acb8, 31, e9fff5f4) e9fff748 do_syncrepl+0x43c(f75a08, 10323d8, 0, f759f0, 1000, 1032340) e9fffd78 libldap_r-2.4.so.2.10.14`ldap_int_thread_pool_wrapper+0x2f8(ebede000, 3 , 1, f417d8, ebef018c, e9fffddc) e9ffff60 libc.so.1`_lwp_start(0, 0, 0, 0, 0, 0) slapd:core>
https://bugs.openldap.org/show_bug.cgi?id=9329
stacey.marshall@gmail.com changed:
What |Removed |Added ---------------------------------------------------------------------------- OS|All |Solaris Hardware|All |Other
https://bugs.openldap.org/show_bug.cgi?id=9329
--- Comment #1 from Howard Chu hyc@openldap.org --- Thanks for the detailed report. This appears to be a regression caused by the patch for ITS#9282, commit 5bbcf38c783.
(In reply to stacey.marshall from comment #0)
Core file stack is: $ mdb ./build/sparcv7/tests/testrun/srv1/core slapd:core> ::status debugging core file of slapd (32-bit) from slitheen file:
/builds2/smarshal/openldap-2.4.51-master/components/openldap/build/sparcv7/ servers/slapd/.libs/slapd initial argv:
/builds2/smarshal/openldap-2.4.51-master/components/openldap/build/sparcv7/ serv threading model: raw lwps status: process terminated by SIGABRT (Abort), pid=949186 uid=521808 code=-1 panic message: Assertion failed: !BER_BVISNULL( src ), file memory.c, line 705 slapd:core> $C e9ffef08 libc.so.1`__lwp_sigqueue+8(6, 0, ffffffef, ffffffec, e9ffef58, 5) e9ffef68 libc.so.1`abort+0x100(e9fff058, 1, ec124b18, 0, b18, 800) e9ffeff8 libc.so.1`_assert+0x68(ebe433a8, ebe4338c, 2c1, ffe8fdf3, ec124000, 170000) e9fff258 liblber-2.4.so.2.10.14`ber_bvreplace_x+0xd4(f84c00, 1ac00, 0, 4, 30303030, ebe5e000) e9fff2b8 merge_state+0x45c(1032230, 28, 102acc0, 1032340, 108787c, 3) e9fff320 check_syncprov+0x36c(e9fff978, 1032230, 102aca8, 10312c0, 102aca8, 29dcd8) e9fff490 do_syncrep2+0x26d4(e9fff978, 1032230, 0, 7acb8, 31, e9fff5f4) e9fff748 do_syncrepl+0x43c(f75a08, 10323d8, 0, f759f0, 1000, 1032340) e9fffd78 libldap_r-2.4.so.2.10.14`ldap_int_thread_pool_wrapper+0x2f8(ebede000, 3 , 1, f417d8, ebef018c, e9fffddc) e9ffff60 libc.so.1`_lwp_start(0, 0, 0, 0, 0, 0) slapd:core>
https://bugs.openldap.org/show_bug.cgi?id=9329
--- Comment #2 from Howard Chu hyc@openldap.org --- (In reply to Howard Chu from comment #1)
Thanks for the detailed report. This appears to be a regression caused by the patch for ITS#9282, commit 5bbcf38c783.
Please test the patch in https://git.openldap.org/openldap/openldap/-/merge_requests/119 and let us know if the problem remains.
https://bugs.openldap.org/show_bug.cgi?id=9329
Howard Chu hyc@openldap.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|UNCONFIRMED |RESOLVED Resolution|--- |TEST
https://bugs.openldap.org/show_bug.cgi?id=9329
Quanah Gibson-Mount quanah@openldap.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Resolution|TEST |FEEDBACK
https://bugs.openldap.org/show_bug.cgi?id=9329
Quanah Gibson-Mount quanah@openldap.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Target Milestone|--- |2.4.52 Resolution|FEEDBACK |TEST
--- Comment #3 from Quanah Gibson-Mount quanah@openldap.org --- Commits: • 9666306d by Howard Chu at 2020-08-25T21:13:22+00:00 ITS#9329 syncrepl: fix regression from ITS#9282
https://bugs.openldap.org/show_bug.cgi?id=9329
Quanah Gibson-Mount quanah@openldap.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Resolution|TEST |FIXED
--- Comment #4 from Quanah Gibson-Mount quanah@openldap.org --- commit 299241129371a6f8017eeac11e0ae82657915ace Author: Howard Chu hyc@openldap.org Date: Tue Aug 25 14:39:35 2020 +0100
ITS#9329 syncrepl: fix regression from ITS#9282
https://bugs.openldap.org/show_bug.cgi?id=9329
--- Comment #5 from stacey.marshall@gmail.com --- Thanks for the quick response and fix. I have applied the patch and tested a couple of times.
https://bugs.openldap.org/show_bug.cgi?id=9329
--- Comment #6 from Quanah Gibson-Mount quanah@openldap.org --- More commits to fix this, as the previous fix had additional issues:
HEAD: Commits: • 9900794a by Howard Chu at 2020-08-26T21:00:00+01:00 ITS#9329 Re-fix merge_state
A bit uglier but more straightforward.
RE24: Commits: • 9900794a by Howard Chu at 2020-08-26T21:00:00+01:00 ITS#9329 Re-fix merge_state
A bit uglier but more straightforward.
https://bugs.openldap.org/show_bug.cgi?id=9329
Quanah Gibson-Mount quanah@openldap.org changed:
What |Removed |Added ---------------------------------------------------------------------------- Status|RESOLVED |VERIFIED